(Almost) practical tree codes

We consider the problem of stabilizing an unstable plant driven by bounded noise over a digital noisy communication link, a scenario at the heart of networked control. To stabilize such a plant, one needs real-time encoding and decoding with an error probability profile that decays exponentially with the decoding delay. The works of Schulman and Sahai over the past two decades have developed the notions of tree codes and anytime capacity, and provided the theoretical framework for studying such problems. Nonetheless, there has been little practical progress in this area due to the absence of explicit constructions of tree codes with efficient encoding and decoding algorithms. Recently, linear time-invariant tree codes were proposed to achieve the desired result under maximum-likelihood decoding. In this work, we take one more step towards practicality, by showing that these codes can be efficiently decoded using sequential decoding algorithms, up to some loss in performance (and with some practical complexity caveats). We supplement our theoretical results with numerical simulations that demonstrate the effectiveness of the decoder in a control system setting.

[1]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[2]  Prakash Narayan,et al.  Reliable Communication Under Channel Uncertainty , 1998, IEEE Trans. Inf. Theory.

[3]  Babak Hassibi,et al.  Multi-rate control over AWGN channels via analog joint source-channel coding , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[4]  Frederick Jelinek Upper bounds on sequential decoding performance parameters , 1974, IEEE Trans. Inf. Theory.

[5]  Anant Sahai,et al.  A Simple Encoding And Decoding Strategy For Stabilization Over Discrete Memoryless Channels , 2005 .

[6]  Anant Sahai,et al.  The Necessity and Sufficiency of Anytime Capacity for Stabilization of a Linear System Over a Noisy Communication Link—Part I: Scalar Systems , 2006, IEEE Transactions on Information Theory.

[7]  Robert M. Gray,et al.  Coding for noisy channels , 2011 .

[8]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[9]  H. Rumsey,et al.  Two Results On Binary-input Discrete Memoryless Channels , 1991, Proceedings. 1991 IEEE International Symposium on Information Theory.

[10]  Thomas M. Cover,et al.  Elements of Information Theory: Cover/Elements of Information Theory, Second Edition , 2005 .

[11]  Meir Feder,et al.  Improved error exponent for time-invariant and periodically time-variant convolutional codes , 2000, IEEE Trans. Inf. Theory.

[12]  John M. Wozencraft,et al.  Sequential decoding for reliable communication , 1957 .

[13]  Babak Hassibi,et al.  Error Correcting Codes for Distributed Control , 2011, ArXiv.

[14]  Rolf Johannesson,et al.  Fundamentals of Convolutional Coding , 1999 .

[15]  Elwyn R. Berlekamp,et al.  A lower bound to the distribution of computation for sequential decoding , 1967, IEEE Trans. Inf. Theory.

[16]  Alexander Barg,et al.  Random codes: Minimum distances and error exponents , 2002, IEEE Trans. Inf. Theory.

[17]  Khoa D. Nguyen,et al.  Anytime Characteristics of Protograph-Based LDPC Convolutional Codes , 2016, IEEE Transactions on Communications.

[18]  Uri Erez,et al.  LDPC code ensembles that universally achieve capacity under BP decoding: A simple derivation , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[19]  D. Blackwell,et al.  The Capacity of a Class of Channels , 1959 .

[20]  Md. Noor-A.-Rahim,et al.  Anytime Reliability of Spatially Coupled Codes , 2015, IEEE Transactions on Communications.

[21]  Doreen Meier,et al.  Introduction To Stochastic Control Theory , 2016 .

[22]  Albert Guillén i Fàbregas,et al.  Extremes of Error Exponents , 2012, IEEE Transactions on Information Theory.

[23]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[24]  J. Wolfowitz Simultaneous channels , 1959 .

[25]  Leonard J. Schulman Coding for interactive communication , 1996, IEEE Trans. Inf. Theory.

[26]  Meir Feder,et al.  The uniform distribution as a universal prior , 2004, IEEE Transactions on Information Theory.

[27]  V.W.S. Chan,et al.  Principles of Digital Communication and Coding , 1979 .

[28]  Erdal Arikan,et al.  An upper bound on the cutoff rate of sequential decoding , 1988, IEEE Trans. Inf. Theory.

[29]  Anant Sahai,et al.  Universal Anytime Coding , 2007, 2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops.

[30]  Mikael Skoglund,et al.  Systematic LDPC Convolutional Codes: Asymptotic and Finite-Length Anytime Properties , 2014, IEEE Transactions on Communications.

[31]  Rüdiger L. Urbanke,et al.  Spatially Coupled Ensembles Universally Achieve Capacity Under Belief Propagation , 2012, IEEE Transactions on Information Theory.

[32]  Erdal Arikan,et al.  Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Memoryless Channels , 2008, IEEE Transactions on Information Theory.

[33]  Babak Hassibi,et al.  Algorithms for optimal control with fixed-rate feedback , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[34]  I. M. Jacobs,et al.  Principles of Communication Engineering , 1965 .

[35]  Sharon Gannot,et al.  - Systems Coding Theorems for Structured Code Families , 1995 .

[36]  Mine Alsan Extremality for Gallager’s Reliability Function $E_{0}$ , 2015, IEEE Transactions on Information Theory.

[37]  Frederick Jelinek,et al.  Probabilistic Information Theory: Discrete and Memoryless Models , 1968 .

[38]  Thomas M. Cover,et al.  Network Information Theory , 2001 .

[39]  John E. Savage,et al.  Sequential decoding — the computation problem , 1966 .

[40]  Serdar Yüksel,et al.  Stochastic Stabilization of Noisy Linear Systems With Fixed-Rate Limited Feedback , 2010, IEEE Transactions on Automatic Control.

[41]  T. Kailath,et al.  Indefinite-quadratic estimation and control: a unified approach to H 2 and H ∞ theories , 1999 .