Sequential Coding of Gauss-Markov Sources

We consider the problem of sequential transmission of Gauss-Markov sources. We show that in the limit of large spatial block lengths, greedy compression with respect to the squared error distortion is optimal; that is, there is no tension between optimizing the distortion of the source in the current time instant and that of future times. We then extend this result to the case where at time $t$ a random compression rate $R_t$ is allocated independently of the rate at other time instants. This, in turn, allows us to derive the optimal performance of sequential coding over packet-erasure channels with instantaneous feedback. For the case of packet erasures with delayed feedback, we connect the problem to that of compression with side information that is known at the encoder and may be known at the decoder - where the most recent packets serve as side information that may have been erased. We conclude the paper by demonstrating that the loss due to a delay by one time unit is rather small.

[1]  H. S. Witsenhausen.  B.S.T.J. brief: On source networks with minimal breakdown degradation , 1980, The Bell System Technical Journal.

[2]  Ram Zamir,et al.  The cost of uncorrelation and non-cooperation in MIMO channels , 2005, ISIT.

[3]  Amiram H. Kaspi,et al.  Rate-distortion function when side-information may be present at the decoder , 1994, IEEE Trans. Inf. Theory.

[4]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[5]  Tihao Chiang,et al.  Advances in the scalable amendment of H.264/AVC , 2007, IEEE Communications Magazine.

[6]  Ram Zamir,et al.  The Cost of Uncorrelation and Noncooperation in MIMO Channels , 2007, IEEE Transactions on Information Theory.

[7]  Thomas M. Cover,et al.  Elements of Information Theory: Cover/Elements of Information Theory, Second Edition , 2005 .

[8]  Abbas El Gamal,et al.  Achievable rates for multiple descriptions , 1982, IEEE Trans. Inf. Theory.

[9]  Toby Berger,et al.  Rate distortion when side information may be absent , 1985, IEEE Trans. Inf. Theory.

[10]  Farrokh Etezadi,et al.  Zero-Delay Sequential Transmission of Markov Sources Over Burst Erasure Channels , 2014, IEEE Transactions on Information Theory.

[11]  Tie Liu,et al.  Gaussian Robust Sequential and Predictive Coding , 2013, IEEE Trans. Inf. Theory.

[12]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[13]  En-Hui Yang,et al.  Causal coding of multiple jointly Gaussian sources , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  A. Wyner,et al.  Source coding for multiple descriptions , 1980, The Bell System Technical Journal.

[15]  Gregory W. Wornell,et al.  Causal Transmission of Colored Source Frames over a Packet Erasure Channel , 2010, 2010 Data Compression Conference.

[16]  Prakash Ishwar,et al.  Erratum to "On Delayed Sequential Coding of Correlated Sources" , 2012, IEEE Trans. Inf. Theory.

[17]  Toby Berger,et al.  Sequential coding of correlated sources , 2000, IEEE Trans. Inf. Theory.

[18]  L. Ozarow,et al.  On a source-coding problem with two channels and three receivers , 1980, The Bell System Technical Journal.

[19]  Jun Chen,et al.  A Truncated Prediction Framework for Streaming Over Erasure Channels , 2017, IEEE Transactions on Information Theory.

[20]  Mahshad Eslamifar.  On Causal Video Coding with Possible Loss of the First Encoded Frame , 2014 .

[21]  Zhen Zhang,et al.  Rate Distortion Theory for Causal Video Coding: Characterization, Computation Algorithm, and Comparison , 2011, IEEE Transactions on Information Theory.

[22]  Daniel E. Quevedo,et al.  Multiple descriptions for packetized predictive control , 2016, EURASIP J. Adv. Signal Process..

[23]  Suhas N. Diggavi,et al.  On the Role of Encoder Side-Information in Source Coding for Multiple Decoders , 2006, 2006 IEEE International Symposium on Information Theory.

[24]  En-Hui Yang,et al.  On the Information Theoretic Performance Comparison of Causal Video Coding and Predictive Video Coding , 2014, IEEE Transactions on Information Theory.

[25]  U. Erez,et al.  Source coding with composite side information at the decoder , 2012, 2012 IEEE 27th Convention of Electrical and Electronics Engineers in Israel.

[26]  Uri Erez,et al.  A Gaussian input is not too bad , 2004, IEEE Transactions on Information Theory.

[27]  Prakash Ishwar,et al.  On Delayed Sequential Coding of Correlated Sources , 2011, IEEE Transactions on Information Theory.

[28]  Massimo Franceschetti,et al.  Data Rate Theorem for Stabilization Over Time-Varying Feedback Channels , 2009, IEEE Transactions on Automatic Control.

[29]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .