Statistical Inference Under Multiterminal Data Compression

This paper presents a survey of the literature on the information-theoretic problems of statistical inference under multiterminal data compression with rate constraints. Significant emphasis is put on problems: (1) multiterminal hypothesis testing, (2) multiterminal parameter estimation and (3) multiterminal pattern classification, in either case of positive rates or zero rates. In addition, the paper includes three new results, i.e., the converse theorems for all problems of multiterminal hypothesis testing, multiterminal parameter estimation, and multiterminal pattern classification at the zero rate.

[1]  Te Han,et al.  Hypothesis testing with multiterminal data compression , 1987, IEEE Trans. Inf. Theory.

[2]  John N. Tsitsiklis,et al.  On the complexity of decentralized decision making and detection problems , 1985 .

[3]  Toby Berger,et al.  Estimation via compressed information , 1988, IEEE Trans. Inf. Theory.

[4]  P. Spreij Probability and Measure , 1996 .

[5]  Katalin Marton,et al.  A simple proof of the blowing-up lemma , 1986, IEEE Trans. Inf. Theory.

[6]  Te Sun Han,et al.  A dichotomy of functions F(X, Y) of correlated sources (X, Y) , 1987, IEEE Trans. Inf. Theory.

[7]  Demetrios Kazakos Signal detection under mismatch , 1982, IEEE Trans. Inf. Theory.

[8]  S. Amari,et al.  Error bound of hypothesis testing with data compression , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[9]  Rudolf Ahlswede,et al.  On minimax estimation in the presence of side information about remote data , 1990 .

[10]  M Athans,et al.  On the Complexity of Distributed Decision Problems , 1983 .

[11]  Robert M. Gray,et al.  Encoding of correlated observations , 1987, IEEE Trans. Inf. Theory.

[12]  Nils Sandell,et al.  Detection with Distributed Sensors , 1980, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Pramod K. Varshney,et al.  Distributed Bayesian signal detection , 1989, IEEE Trans. Inf. Theory.

[14]  Shun-ichi Amari,et al.  Differential-geometrical methods in statistics , 1985 .

[15]  Firooz Sadjadi Hypotheses Testing in a Distributed Environment , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[16]  P. Gács,et al.  Bounds on conditional probabilities with applications in multi-user communication , 1976 .

[17]  R. Srinivasan Distributed radar detection theory , 1986 .

[18]  Hossam M. H. Shalaby,et al.  Error exponents for distributed detection of Markov sources , 1994, IEEE Trans. Inf. Theory.

[19]  Ramanarayanan Viswanathan,et al.  Optimal Decision Fusion in Multiple Sensor Systems , 1987, IEEE Transactions on Aerospace and Electronic Systems.

[20]  Demosthenis Teneketzis The decentralized quickest detection problem , 1982, 1982 21st IEEE Conference on Decision and Control.

[21]  Rudolf Ahlswede,et al.  Hypothesis testing with communication constraints , 1986, IEEE Trans. Inf. Theory.

[22]  Te Sun Han,et al.  Exponential-type error probabilities for multiterminal hypothesis testing , 1989, IEEE Trans. Inf. Theory.

[23]  Ian B. Rhodes,et al.  Decentralized sequential detection , 1989, IEEE Trans. Inf. Theory.

[24]  Shun-ichi Amari,et al.  Parameter estimation with multiterminal data compression , 1995, IEEE Trans. Inf. Theory.

[25]  János Körner,et al.  How to encode the modulo-two sum of binary sources (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[26]  E. Robinson,et al.  Recursive solution to the multichannel filtering problem , 1965 .

[27]  Harold J. Kushner,et al.  A simulation study of a decentralized detection problem , 1982 .

[28]  P.K. Varshney,et al.  Optimal Data Fusion in Multiple Sensor Detection Systems , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[29]  Hossam M. H. Shalaby,et al.  Multiterminal detection with zero-rate data compression , 1992, IEEE Trans. Inf. Theory.

[30]  L. Ekchian,et al.  Detection networks , 1982, 1982 21st IEEE Conference on Decision and Control.

[31]  Te Sun Han,et al.  The asymptotics of posterior entropy and error probability for Bayesian estimation , 1995, IEEE Trans. Inf. Theory.

[32]  Robert R. Tenney,et al.  Detection with distributed sensors , 1980 .

[33]  Shun-ichi Amari,et al.  Statistical inference under multiterminal rate restrictions: A differential geometric approach , 1989, IEEE Trans. Inf. Theory.

[34]  Pramod K. Varshney,et al.  An information theoretic approach to the distributed detection problem , 1989, IEEE Trans. Inf. Theory.

[35]  Patrick Duvaut,et al.  Optimum quantization for detection , 1988, IEEE Trans. Commun..

[36]  Jorma Rissanen,et al.  Universal coding, information, prediction, and estimation , 1984, IEEE Trans. Inf. Theory.

[37]  Yu-Chi Ho,et al.  The Decentralized Wald Problem , 1987, Inf. Comput..

[38]  S. Amari Fisher information under restriction of Shannon information in multi-terminal situations , 1989 .

[39]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .