/spl alpha/-parallel prior and its properties

It is known that the Jeffreys prior plays an important role in statistical inference. In this paper, we generalize the Jeffreys prior from the point of view of information geometry and introduce a one-parameter family of prior distributions, which we named the /spl alpha/-parallel priors. The /spl alpha/-parallel prior is defined as the parallel volume element with respect to the /spl alpha/-connection and coincides with the Jeffreys prior when /spl alpha/=0. Further, we analyze asymptotic behavior of the various estimators such as the projected Bayes estimator (the estimator obtained by projecting the Bayes predictive density onto the original class of distributions) and the minimum description length (MDL) estimator, when the /spl alpha/-parallel prior is used. The difference of these estimators from maximum-likelihood estimator (MLE) due to the /spl alpha/-prior is shown to be regulated by an invariant vector field of the statistical model. Although the Jeffreys prior always exists, the existence of /spl alpha/-parallel prior with /spl alpha/ /spl ne/ 0 is not always guaranteed. Hence, we consider conditions for the existence of the /spl alpha/-parallel prior, elucidating the conjugate symmetry in a statistical model.

[1]  Fumiyasu Komaki Bayesian Predictive Distribution with Right Invariant Priors , 2002 .

[2]  A. Barron,et al.  Jeffreys' prior is asymptotically least favorable under entropy risk , 1994 .

[3]  K. Nomizu Affine Differential Geometry , 1994 .

[4]  F. Götze Differential-geometrical methods in statistics. Lecture notes in statistics - A. Shun-ichi. , 1987 .

[5]  J. Bernardo Reference Posterior Distributions for Bayesian Inference , 1979 .

[6]  J. Hartigan The maximum likelihood prior , 1998 .

[7]  Shun-ichi Amari,et al.  Equiaffine structures on statistical manifolds and Bayesian statistics , 2006 .

[8]  A. P. Dawid,et al.  Invariant Prior Distributions , 2006 .

[9]  M. C. Chaki ON STATISTICAL MANIFOLDS , 2000 .

[10]  C. S. Wallace,et al.  Estimation and Inference by Compact Coding , 1987 .

[11]  Alberto Leon-Garcia,et al.  A source matching approach to finding minimax codes , 1980, IEEE Trans. Inf. Theory.

[12]  J. A. Schouten,et al.  Ricci-Calculus: An Introduction to Tensor Analysis and Its Geometrical Applications , 1954 .

[13]  J. Zidek A representation of Bayes invariant procedures in terms of Haar measure , 1969 .

[14]  A. Barron,et al.  Asymptotically minimax regret by Bayes mixtures , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[15]  F. Komaki On asymptotic properties of predictive distributions , 1996 .

[16]  Lawrence D. Brown Fundamentals of Statistical Exponential Families , 1987 .

[17]  Calyampudi R. Rao,et al.  Chapter 4: Statistical Manifolds , 1987 .

[18]  J. A. Hartigan,et al.  THE ASYMPTOTICALLY UNBIASED PRIOR DISTRIBUTION , 1965 .

[19]  J. Takeuchi Characterization of the Bayes estimator and the MDL estimator for exponential families , 1997, IEEE Trans. Inf. Theory.

[20]  Andrew R. Barron,et al.  Minimax redundancy for the class of memoryless sources , 1997, IEEE Trans. Inf. Theory.

[21]  P. Vos Fundamental equations for statistical submanifolds with applications to the Bartlett correction , 1989 .

[22]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[23]  Andrew R. Barron,et al.  Asymptotic minimax regret for data compression, gambling, and prediction , 1997, IEEE Trans. Inf. Theory.

[24]  L. M. M.-T. Theory of Probability , 1929, Nature.