Control Over Gaussian Channels With and Without Source–Channel Separation

We consider the problem of controlling an unstable linear plant with Gaussian disturbances over an additive white Gaussian noise channel with an average transmit power constraint, where the signaling rate of communication may be different from the sampling rate of the underlying plant. Such a situation is quite common since sampling is done at a rate that captures the dynamics of the plant and that is often lower than the signaling rate of the communication channel. This rate mismatch offers the opportunity of improving the system performance by using coding over multiple channel uses to convey a single control action. In a traditional, separation-based approach to source and channel coding, the analog message is first quantized down to a few bits and then mapped to a channel codeword whose length is commensurate with the number of channel uses per sampled message. Applying the separation-based approach to control meets its challenges: first, the quantizer needs to be capable of zooming in and out to be able to track unbounded system disturbances, and second, the channel code must be capable of improving its estimates of the past transmissions exponentially with time, a characteristic known as anytime reliability. We implement a separated scheme by leveraging recently developed techniques for control over quantized-feedback channels and for efficient decoding of anytime-reliable codes. We further propose an alternative, namely, to perform analog joint source–channel coding, by this avoiding the digital domain altogether. For the case where the communication signaling rate is twice the sampling rate, we employ analog linear repetition as well as Shannon–Kotel’nikov maps to show a significant improvement in stability margins and linear-quadratic costs over separation-based schemes. We conclude that such analog coding performs better than separation, and can stabilize all moments as well as guarantee almost-sure stability.

[1]  Minyue Fu Lack of Separation Principle for Quantized Linear Quadratic Gaussian Control , 2012, IEEE Transactions on Automatic Control.

[2]  Alexander V. Trushkin Sufficient conditions for uniqueness of a locally optimal quantizer for a class of convex error weighting functions , 1982, IEEE Trans. Inf. Theory.

[3]  V.W.S. Chan,et al.  Principles of Digital Communication and Coding , 1979 .

[4]  Erdal Arikan,et al.  An upper bound on the cutoff rate of sequential decoding , 1988, IEEE Trans. Inf. Theory.

[5]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[6]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[7]  Tor A. Ramstad,et al.  Shannon-kotel-nikov mappings in joint source-channel coding , 2009, IEEE Transactions on Communications.

[8]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[9]  Thomas Kailath,et al.  A coding scheme for additive noise channels with feedback-I: No bandwidth constraint , 1966, IEEE Trans. Inf. Theory.

[10]  Babak Hassibi,et al.  Multi-rate control over AWGN channels via analog joint source-channel coding , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[11]  Anant Sahai,et al.  The Necessity and Sufficiency of Anytime Capacity for Stabilization of a Linear System Over a Noisy Communication Link—Part I: Scalar Systems , 2006, IEEE Transactions on Information Theory.

[12]  Massimo Franceschetti,et al.  Data Rate Theorem for Stabilization Over Time-Varying Feedback Channels , 2009, IEEE Transactions on Automatic Control.

[13]  Victor Solo,et al.  Stabilization and Disturbance Attenuation Over a Gaussian Communication Channel , 2010, IEEE Transactions on Automatic Control.

[14]  Sae-Young Chung,et al.  On the construction of some capacity-approaching coding schemes , 2000 .

[15]  Meir Feder,et al.  Distortion Bounds for Broadcasting With Bandwidth Expansion , 2006, IEEE Transactions on Information Theory.

[16]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[17]  Tamer Basar,et al.  Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints , 2013 .

[18]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[19]  J. Nicholas Laneman,et al.  On stability across a Gaussian product channel , 2011, IEEE Conference on Decision and Control and European Control Conference.

[20]  Nicola Elia,et al.  When bode meets shannon: control-oriented feedback communication schemes , 2004, IEEE Transactions on Automatic Control.

[21]  Yichuan Hu,et al.  Analog Joint Source-Channel Coding Using Non-Linear Curves and MMSE Decoding , 2011, IEEE Transactions on Communications.

[22]  Ertem Tuncel,et al.  Zero-Delay Joint Source-Channel Coding Using Hybrid Digital-Analog Schemes in the Wyner-Ziv Setting , 2014, IEEE Transactions on Communications.

[23]  Simo Särkkä,et al.  Bayesian Filtering and Smoothing , 2013, Institute of Mathematical Statistics textbooks.

[24]  Thomas J. Goblick,et al.  Theoretical limitations on the transmission of data from analog sources , 1965, IEEE Trans. Inf. Theory.

[25]  Tamer Basar,et al.  Simultaneous design of measurement and control strategies for stochastic systems with feedback , 1989, Autom..

[26]  Babak Hassibi,et al.  Sequential coding of Gauss-Markov sources with packet erasures and feedback , 2017, 2017 IEEE Information Theory Workshop (ITW).

[27]  Nam C. Phamdo,et al.  Hybrid digital-analog (HDA) joint source-channel codes for broadcasting and robust communications , 2002, IEEE Trans. Inf. Theory.

[28]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[29]  Serdar Yüksel,et al.  Stochastic Stabilization of Noisy Linear Systems With Fixed-Rate Limited Feedback , 2010, IEEE Transactions on Automatic Control.

[30]  George L. Turin,et al.  The theory of optimum noise immunity , 1959 .

[31]  Robert M. Gray,et al.  Coding for noisy channels , 2011 .

[32]  Babak Hassibi,et al.  Error Correcting Codes for Distributed Control , 2011, ArXiv.

[33]  Frederick Jelinek,et al.  Probabilistic Information Theory: Discrete and Memoryless Models , 1968 .

[34]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[35]  Babak Hassibi,et al.  Linear Time-Invariant Anytime Codes for Control Over Noisy Channels , 2016, IEEE Transactions on Automatic Control.

[36]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[37]  Babak Hassibi,et al.  (Almost) practical tree codes , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[38]  Sekhar Tatikonda,et al.  A Counterexample in Distributed Optimal Sensing and Control , 2009, IEEE Transactions on Automatic Control.

[39]  Yuval Kochman,et al.  Rematch-and-Forward: Joint Source–Channel Coding for Parallel Relaying With Spectral Mismatch , 2014, IEEE Transactions on Information Theory.

[40]  Tobias J. Oechtering,et al.  Stabilization and Control over Gaussian Networks , 2014 .

[41]  Meir Feder,et al.  Power Preserving 2:1 Bandwidth Reduction Mappings , 2007, 2007 Data Compression Conference (DCC'07).

[42]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[43]  Leonard J. Schulman Coding for interactive communication , 1996, IEEE Trans. Inf. Theory.

[44]  Igal Kvecher,et al.  An Analog Modulation Using a Spiral Mapping , 2006, 2006 IEEE 24th Convention of Electrical & Electronics Engineers in Israel.

[45]  C. Parman To code, or not to code? , 2003, The Journal of oncology management : the official journal of the American College of Oncology Administrators.

[46]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[47]  Babak Hassibi,et al.  Rate-cost tradeoffs in control , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[48]  Sekhar Tatikonda,et al.  Control over noisy channels , 2004, IEEE Transactions on Automatic Control.

[49]  Rolf Johannesson,et al.  Fundamentals of Convolutional Coding , 1999 .

[50]  Aaron D. Wyner,et al.  On the Schalkwijk-Kailath coding scheme with a peak energy constraint , 1968, IEEE Trans. Inf. Theory.

[51]  Richard M. Murray,et al.  Data Transmission Over Networks for Estimation and Control , 2009, IEEE Transactions on Automatic Control.

[52]  Babak Hassibi,et al.  Algorithms for optimal control with fixed-rate feedback , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[53]  I. M. Jacobs,et al.  Principles of Communication Engineering , 1965 .

[54]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[55]  T. Fischer,et al.  Optimal quantized control , 1982 .

[56]  Assaf Ben-Yishai,et al.  Interactive Schemes for the AWGN Channel with Noisy Feedback , 2015, IEEE Transactions on Information Theory.

[57]  Babak Hassibi,et al.  Tracking and Control of Gauss–Markov Processes over Packet-Drop Channels with Acknowledgments , 2019, IEEE Transactions on Control of Network Systems.

[58]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[59]  JOHN C. KIEFFER,et al.  Uniqueness of locally optimal quantizer for log-concave density and convex error weighting function , 1983, IEEE Trans. Inf. Theory.

[60]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[61]  Karl Henrik Johansson,et al.  Iterative Encoder-Controller Design for Feedback Control Over Noisy Channels , 2011, IEEE Transactions on Automatic Control.

[62]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[63]  Simo Srkk,et al.  Bayesian Filtering and Smoothing , 2013 .

[64]  Yuval Kochman,et al.  Analog Matching of Colored Sources to Colored Channels , 2006, IEEE Transactions on Information Theory.

[65]  Michael Gastpar,et al.  To code, or not to code: lossy source-channel communication revisited , 2003, IEEE Trans. Inf. Theory.

[66]  Yuval Kochman,et al.  Joint Wyner–Ziv/Dirty-Paper Coding by Modulo-Lattice Modulation , 2008, IEEE Transactions on Information Theory.

[67]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[68]  Meir Feder,et al.  The Posterior Matching Feedback Scheme for Joint Source-Channel Coding with Bandwidth Expansion , 2009, 2009 Data Compression Conference.