Information–Estimation Relationship in Mismatched Gaussian Channels

In this letter, we investigated the connection between information and estimation measures for mismatched Gaussian models. In addition to the input prior mismatch, we take into account the noise mismatch and establish a new relation between relative entropy and excess mean square error. The derived formula shows that the input prior mismatch may be canceled by the noise mismatch. Finally, an example illustrates the impact of model mismatches on estimation accuracy.

[1]  Fulvio Gini,et al.  Maximum likelihood covariance matrix estimation for complex elliptically symmetric distributions under mismatched conditions , 2014, Signal Process..

[2]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[3]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[4]  T. Minka.  Old and New Matrix Algebra Useful for Statistics , 2000 .

[5]  John D. Lafferty,et al.  Mismatched estimation and relative entropy in vector Gaussian channels , 2013, 2013 IEEE International Symposium on Information Theory.

[6]  Olivier J. J. Michel,et al.  Impact of noise correlation on multimodality , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[7]  Daniel Pérez Palomar,et al.  Gradient of mutual information in linear vector Gaussian channels , 2005, ISIT.

[8]  Sergio Verdú.  Mismatched estimation and relative entropy , 2010, IEEE Trans. Inf. Theory.

[9]  Christian Jutten,et al.  Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects , 2015, Proceedings of the IEEE.

[10]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[11]  H. Luetkepohl.  The Handbook of Matrices , 1996 .

[12]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[13]  Rue Joliot-Curie,et al.  PERFORMANCE BOUNDS UNDER MISSPECIFICATION MODEL FOR MIMO RADAR APPLICATION , 2015 .

[14]  Neri Merhav.  Optimum Estimation via Gradients of Partition Functions and Information Measures: A Statistical-Mechanical Perspective , 2011, IEEE Transactions on Information Theory.

[15]  Joan Jacobs,et al.  Analysis of Mismatched Estimation Errors Using Gradients of Partition Functions , 2013 .

[16]  Dongning Guo,et al.  Relative entropy and score function: New information-estimation relationships through arbitrary additive perturbation , 2009, 2009 IEEE International Symposium on Information Theory.

[17]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[18]  Murat Akçakaya,et al.  MIMO Radar Detection and Adaptive Design Under a Phase Synchronization Mismatch , 2010, IEEE Transactions on Signal Processing.