Local collaborative ranking

Personalized recommendation systems are used in a wide variety of applications such as electronic commerce, social networks, web search, and more. Collaborative filtering approaches to recommendation systems typically assume that the rating matrix (e.g., movie ratings by viewers) is low-rank. In this paper, we examine an alternative approach in which the rating matrix is locally low-rank. Concretely, we assume that the rating matrix is low-rank within certain neighborhoods of the metric space defined by (user, item) pairs. We combine a recent approach for local low-rank approximation based on the Frobenius norm with a general empirical risk minimization for ranking losses. Our experiments indicate that the combination of a mixture of local low-rank matrices each of which was trained to minimize a ranking loss outperforms many of the currently used state-of-the-art recommendation systems. Moreover, our method is easy to parallelize, making it a viable approach for large scale real-world rank-based recommendation systems.

[1]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[2]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[3]  Yoram Singer,et al.  An Efficient Boosting Algorithm for Combining Preferences by , 2013 .

[4]  Michael J. Pazzani,et al.  Learning Collaborative Information Filters , 1998, ICML.

[5]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[6]  Boris Chidlovskii,et al.  Collaborative Re-Ranking of Search Results , 2000 .

[7]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[8]  Thore Graepel,et al.  Large Margin Rank Boundaries for Ordinal Regression , 2000 .

[9]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[10]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[11]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[12]  Guy Lebanon,et al.  Learning Riemannian Metrics , 2002, UAI.

[13]  Edward F. Harrington,et al.  Online Ranking/Collaborative Filtering Using the Perceptron Algorithm , 2003, ICML.

[14]  Alan Murray,et al.  Advances in Neural Information Processing Systems 2003 , 2003 .

[15]  Yoram Singer,et al.  Log-Linear Models for Label Ranking , 2003, NIPS.

[16]  Barry Smyth,et al.  Further Experiments on Collaborative Ranking in Community-Based Web Search , 2004, Artificial Intelligence Review.

[17]  Gregory N. Hullender,et al.  Learning to rank using gradient descent , 2005, ICML.

[18]  Guy Lebanon Axiomatic geometry of conditional models , 2005, IEEE Transactions on Information Theory.

[19]  Nathan Srebro,et al.  Fast maximum margin matrix factorization for collaborative prediction , 2005, ICML.

[20]  Filip Radlinski,et al.  A support vector method for optimizing average precision , 2007, SIGIR.

[21]  Hang Li,et al.  AdaRank: a boosting algorithm for information retrieval , 2007, SIGIR.

[22]  Jian Zhang,et al.  Statistical Translation, Heat Kernels and Expected Distances , 2007, UAI.

[23]  Tie-Yan Liu,et al.  Learning to rank: from pairwise approach to listwise approach , 2007, ICML '07.

[24]  David M. Pennock,et al.  Applying collaborative filtering techniques to movie search for better ranking and browsing , 2007, KDD '07.

[25]  Tao Qin,et al.  FRank: a ranking method with fidelity loss , 2007, SIGIR.

[26]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[27]  Alexander J. Smola,et al.  COFI RANK - Maximum Margin Matrix Factorization for Collaborative Ranking , 2007, NIPS.

[28]  Tie-Yan Liu,et al.  Directly optimizing evaluation measures in learning to rank , 2008, SIGIR.

[29]  Chiranjib Bhattacharyya,et al.  Structured learning for non-smooth ranking losses , 2008, KDD.

[30]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[31]  Stephen E. Robertson,et al.  SoftRank: optimizing non-smooth rank metrics , 2008, WSDM '08.

[32]  Stephen E. Robertson,et al.  Probabilistic relevance ranking for collaborative filtering , 2008, Information Retrieval.

[33]  Alexander Tuzhilin,et al.  The long tail of recommender systems and how to leverage it , 2008, RecSys '08.

[34]  Qiang Yang,et al.  EigenRank: a ranking-oriented approach to collaborative filtering , 2008, SIGIR '08.

[35]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[36]  Luis von Ahn,et al.  Matchin: eliciting user preferences with an online game , 2009, CHI.

[37]  Pinar Donmez,et al.  On the local optimality of LambdaRank , 2009, SIGIR.

[38]  Neil D. Lawrence,et al.  Non-linear matrix factorization with Gaussian processes , 2009, ICML '09.

[39]  Serguei Netessine,et al.  Is Tom Cruise Threatened ? Using Netflix Prize Data to Examine the Long Tail of Electronic Commerce , 2009 .

[40]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[41]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[42]  Heng Ji,et al.  Collaborative Ranking: A Case Study on Entity Linking , 2011, EMNLP.

[43]  Jason Weston,et al.  WSABIE: Scaling Up to Large Vocabulary Image Annotation , 2011, IJCAI.

[44]  Kilian Q. Weinberger,et al.  Web-Search Ranking with Initialized Gradient Boosted Regression Trees , 2010, Yahoo! Learning to Rank Challenge.

[45]  Mingxuan Sun,et al.  A Comparative Study of Collaborative Filtering Algorithms , 2012, Proceedings of the International Conference on Knowledge Discovery and Information Retrieval.

[46]  Maksims Volkovs,et al.  Collaborative Ranking With 17 Parameters , 2012, NIPS.

[47]  Suhrid Balakrishnan,et al.  Collaborative ranking , 2012, WSDM '12.

[48]  Martha Larson,et al.  CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering , 2012, RecSys.

[49]  Mingxuan Sun,et al.  Automatic Feature Induction for Stagewise Collaborative Filtering , 2012, NIPS.

[50]  Mingxuan Sun,et al.  PREA: personalized recommendation algorithms toolkit , 2012, J. Mach. Learn. Res..

[51]  Xueqi Cheng,et al.  Collaborative factorization for recommender systems , 2013, SIGIR.

[52]  Yoram Singer,et al.  Local Low-Rank Matrix Approximation , 2013, ICML.