Tensor decomposition model for link prediction in multi-relational networks

Many real-world datasets can be considered as a linked collection of objects with multi-type relations, where each type of relations may play a distinct role. In this paper, we address the problem of link prediction in such multi-relational networks. While traditional link prediction methods are limited to single-type link prediction we attempt here to capture the correlations among the different relation types. For that, we use tensor formalization and formulate the link pattern prediction task as a tensor decomposition model which is solved by quasi-Newton optimization method. Extensive experiments on real-world multi-relational datasets demonstrate the accuracy and effectiveness of our model.

[1]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[2]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[3]  Berkant Savas,et al.  Quasi-Newton Methods on Grassmannians and Multilinear Approximations of Tensors , 2009, SIAM J. Sci. Comput..

[4]  Jennifer Neville,et al.  Using Transactional Information to Predict Link Strength in Online Social Networks , 2009, ICWSM.

[5]  David Liben-Nowell,et al.  The link-prediction problem for social networks , 2007 .

[6]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[7]  T. Kolda Multilinear operators for higher-order decompositions , 2006 .

[8]  Tamara G. Kolda,et al.  Higher-order Web link analysis using multilinear algebra , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[9]  Huan Liu,et al.  Uncoverning Groups via Heterogeneous Interaction Analysis , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[10]  Tamara G. Kolda,et al.  Link Prediction on Evolving Data Using Matrix and Tensor Factorizations , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[11]  Lise Getoor,et al.  Link mining: a survey , 2005, SKDD.

[12]  Michael W. Berry,et al.  Discussion Tracking in Enron Email using PARAFAC. , 2008 .

[13]  Lars Schmidt-Thieme,et al.  Learning optimal ranking with tensor factorization for tag recommendation , 2009, KDD.

[14]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[15]  Yoshihiro Yamanishi,et al.  propagation: A fast semisupervised learning algorithm for link prediction , 2009 .

[16]  Tommi S. Jaakkola,et al.  Weighted Low-Rank Approximations , 2003, ICML.

[17]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations with Missing Data , 2010, SDM.