Rate-cost tradeoffs in control. Part I: lower bounds

Consider a distributed control problem with a communication channel connecting the observer of a linear stochastic system to the controller. The goal of the controller is to minimize a quadratic cost function in the state variables and control signal, known as the linear quadratic regulator (LQR). We study the fundamental tradeoff between the communication rate r bits/sec and the limsup of the expected cost b. We obtain a lower bound on a certain cost function, which quantifies the minimum mutual information between the channel input and output, given the past, that is compatible with a target LQR cost. The rate-cost function has operational significance in multiple scenarios of interest: among other, it allows us to lower bound the minimum communication rate for fixed and variable length quantization, and for control over a noisy channel. Our results extend and generalize an earlier explicit expression, due to Tatikonda el al., for the scalar Gaussian case to the vector, non-Gaussian, and partially observed one. The bound applies as long as the system noise has a probability density function. Apart from standard dynamic programming arguments, our proof technique leverages the Shannon lower bound on the rate-distortion function and proposes new estimates for information measures of linear combinations of random vectors.

[1]  Milan S. Derpich,et al.  A Framework for Control System Design Subject to Average Data-Rate Constraints , 2011, IEEE Transactions on Automatic Control.

[2]  Babak Hassibi,et al.  Rate-cost tradeoffs in control , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[3]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[4]  Tamás Linder,et al.  Causal coding of stationary sources and individual sequences with high resolution , 2006, IEEE Transactions on Information Theory.

[5]  Serdar Yüksel,et al.  Stochastic Stabilization of Noisy Linear Systems With Fixed-Rate Limited Feedback , 2010, IEEE Transactions on Automatic Control.

[6]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[7]  SahaiA.,et al.  The Necessity and Sufficiency of Anytime Capacity for Stabilization of a Linear System Over a Noisy Communication Link—Part I , 2006 .

[8]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[9]  T. Fischer,et al.  Optimal quantized control , 1982 .

[10]  Tamás Linder,et al.  Optimality of Walrand-Varaiya type policies and approximation results for zero delay coding of Markov sources , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[11]  Peter M. Schultheiss,et al.  Information rates of non-Gaussian processes , 1964, IEEE Trans. Inf. Theory.

[12]  A. J. Stam Some Inequalities Satisfied by the Quantities of Information of Fisher and Shannon , 1959, Inf. Control..

[13]  H. Witsenhausen On the structure of real-time source coders , 1979, The Bell System Technical Journal.

[14]  Yuval Kochman,et al.  The dispersion of joint source-channel coding , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[15]  Babak Hassibi,et al.  Multi-rate control over AWGN channels via analog joint source-channel coding , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[16]  Milan S. Derpich,et al.  On the Minimal Average Data-Rate that Guarantees a Given Closed Loop Performance Level , 2010 .

[17]  Sergio Verdu,et al.  Lossy Joint Source-Channel Coding in the Finite Blocklength Regime , 2013, IEEE Trans. Inf. Theory.

[18]  Sekhar Tatikonda,et al.  Control over noisy channels , 2004, IEEE Transactions on Automatic Control.

[19]  K. Åström Introduction to Stochastic Control Theory , 1970 .

[20]  Sergio Verdú,et al.  Lossy Joint Source-Channel Coding in the Finite Blocklength Regime , 2012, IEEE Transactions on Information Theory.

[21]  Jack K. Wolf,et al.  Transmission of noisy information to a noisy receiver with minimum distortion , 1970, IEEE Trans. Inf. Theory.

[22]  Babak Hassibi,et al.  Rate-cost tradeoffs in control. Part II: achievable scheme , 2016, ArXiv.

[23]  Milan S. Derpich,et al.  A Characterization of the Minimal Average Data Rate That Guarantees a Given Closed-Loop Performance Level , 2014, IEEE Transactions on Automatic Control.

[24]  John Baillieul Feedback Designs for Controlling Device Arrays with Communication Channel Bandwidth Constraints , 1999 .

[25]  Minyue Fu Lack of Separation Principle for Quantized Linear Quadratic Gaussian Control , 2012, IEEE Transactions on Automatic Control.

[26]  Serdar Yüksel,et al.  Jointly Optimal LQG Quantization and Control Policies for Multi-Dimensional Systems , 2014, IEEE Transactions on Automatic Control.

[27]  T. Basar,et al.  Optimal causal quantization of Markov Sources with distortion constraints , 2008, 2008 Information Theory and Applications Workshop.

[28]  Sean P. Meyn,et al.  Rationally Inattentive Control of Markov Processes , 2015, SIAM J. Control. Optim..

[29]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[30]  Anant Sahai,et al.  The Necessity and Sufficiency of Anytime Capacity for Stabilization of a Linear System Over a Noisy Communication Link—Part I: Scalar Systems , 2006, IEEE Transactions on Information Theory.

[31]  N. THOMAS GAARDER,et al.  On optimal finite-state digital transmission systems , 1982, IEEE Trans. Inf. Theory.

[32]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[33]  George Gabor,et al.  Recursive source coding - a theory for the practice of waveform coding , 1986 .

[34]  Wing Shing Wong,et al.  Systems with finite communication bandwidth constraints. II. Stabilization with limited information feedback , 1999, IEEE Trans. Autom. Control..

[35]  Tamer Basar,et al.  Minimum Rate Coding for LTI Systems Over Noiseless Channels , 2006, IEEE Transactions on Automatic Control.

[36]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[37]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.

[38]  Charalambos D. Charalambous,et al.  LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels , 2008, Autom..

[39]  V. Borkar,et al.  LQG Control with Communication Constraints , 1997 .

[40]  Pablo A. Parrilo,et al.  Semidefinite Programming Approach to Gaussian Sequential Rate-Distortion Trade-Offs , 2014, IEEE Transactions on Automatic Control.

[41]  Fuzhen Zhang Matrix Theory: Basic Results and Techniques , 1999 .

[42]  Robin J. Evans,et al.  Stabilizability of Stochastic Linear Systems with Finite Feedback Data Rates , 2004, SIAM J. Control. Optim..

[43]  Imre Csiszár On the error exponent of source-channel transmission with a distortion threshold , 1982, IEEE Trans. Inf. Theory.

[44]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[45]  Tamás Linder,et al.  On Optimal Zero-Delay Coding of Vector Markov Sources , 2013, IEEE Transactions on Information Theory.

[46]  Demosthenis Teneketzis,et al.  On the Structure of Optimal Real-Time Encoders and Decoders in Noisy Communication , 2006, IEEE Transactions on Information Theory.

[47]  Victor Solo,et al.  Stabilization and Disturbance Attenuation Over a Gaussian Communication Channel , 2010, IEEE Transactions on Automatic Control.