An Estimation of Generalized Bradley-Terry Models Based on the em Algorithm

The Bradley-Terry model is a statistical representation for one's preference or ranking data by using pairwise comparison results of items. For estimation of the model, several methods based on the sum of weighted Kullback-Leibler divergences have been proposed from various contexts. The purpose of this letter is to interpret an estimation mechanism of the Bradley-Terry model from the viewpoint of flatness, a fundamental notion used in information geometry. Based on this point of view, a new estimation method is proposed on a framework of the em algorithm. The proposed method is different in its objective function from that of conventional methods, especially in treating unobserved comparisons, and it is consistently interpreted in a probability simplex. An estimation method with weight adaptation is also proposed from a viewpoint of the sensitivity. Experimental results show that the proposed method works appropriately, and weight adaptation improves accuracy of the estimate.

[1]  M. C. Jones,et al.  Robust and efficient estimation by minimising a density power divergence , 1998 .

[2]  Shun-ichi Amari,et al.  Information geometry of the EM and em algorithms for neural networks , 1995, Neural Networks.

[3]  R. Beran.  Minimum Hellinger distance estimates for parametric models , 1977 .

[4]  R. A. Bradley,et al.  Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons , 1952 .

[5]  P. V. Rao,et al.  Ties in Paired-Comparison Experiments: A Generalization of the Bradley-Terry Model , 1967 .

[6]  Bregman divergence and density integration , 2009 .

[7]  Hideitsu Hino,et al.  A Grouped Ranking Model for Item Preference Parameter , 2010, Neural Computation.

[8]  Chih-Jen Lin,et al.  Generalized Bradley-Terry Models and Multi-Class Probability Estimates , 2006, J. Mach. Learn. Res..

[9]  H. A. David,et al.  The method of paired comparisons , 1966 .

[10]  Gunnar Rätsch,et al.  Adapting Codes and Embeddings for Polychotomies , 2002, NIPS.

[11]  Ralph A. Bradley,et al.  RANKING IN TRIPLE COMPARISONS , 1959 .

[12]  B. Zadrozny.  Reducing multiclass to binary by coupling probability estimates , 2001, NIPS.

[13]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[14]  S. Amari.  Integration of Stochastic Models by Minimizing -Divergence , 2007, Neural Computation.

[15]  Shinto Eguchi,et al.  Robustifying AdaBoost by Adding the Naive Error Rate , 2004, Neural Computation.

[16]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[17]  Robert J. Beaver,et al.  On Extending the Bradley-Terry Model to Incorporate Within-Pair Order Effects , 1977 .

[18]  L. Bregman.  The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[19]  Yu Fujimoto,et al.  A modified EM algorithm for mixture models based on Bregman divergence , 2007 .

[20]  A. Agresti.  Categorical data analysis , 1993 .

[21]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[22]  Ashutosh Kumar Singh,et al.  The EM Algorithm and Related Statistical Models , 2006, Technometrics.

[23]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[24]  Takafumi Kanamori,et al.  Information Geometry of U-Boost and Bregman Divergence , 2004, Neural Computation.

[25]  Shiro Ikeda.  Learning Binary Classifiers for Multi-Class Problem , 2006 .

[26]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[27]  Takafumi Kanamori,et al.  Robust Boosting Algorithm Against Mislabeling in Multiclass Problems , 2008, Neural Computation.

[28]  Anthony Y. C. Kuk.  Modelling Paired Comparison Data with Large Numbers of Draws and Large Variability of Draw Percentages Among Players , 1995 .

[29]  Yuhong Yang.  Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[30]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS , 1952 .

[31]  R. Plackett.  The Analysis of Permutations , 1975 .

[32]  Christian Genest,et al.  Combining Probability Distributions: A Critique and an Annotated Bibliography , 1986 .