The Minimal Directed Information Needed to Improve the LQG Cost

We study a linear quadratic Gaussian (LQG) control problem, in which a noisy observation of the system state is available to the controller. To lower the achievable LQG cost, we introduce an extra communication link from the system to the controller. We investigate the trade-off between the improved LQG cost and the consumed communication (information) resources that are measured with the conditional directed information. The objective is to minimize the directed information over all encoding-decoding policies subject to a constraint on the LQG cost. The main result is a semidefinite programming formulation for the optimization problem in the finite-horizion scenario where the dynamical system may have time-varying parameters. This result extends the seminal work by Tanaka et al., where the direct noisy measurement of the system state at the controller is assumed to be absent. As part of our derivation to show the optimality of an encoder that transmits a Gaussian measurement of the state, we show that the presence of the noisy measurements at the encoder can not reduce the minimal directed information, extending a prior result of Kostina and Hassibi to the vector case. Finally, we show that the results in the finite-horizon case can be extended to the infinite-horizon scenario when assuming a time-invariant system, but possibly a time-varying policy. We show that the solution for this optimization problem can be realized by a time-invariant policy whose parameters can be computed explicitly from a finite-dimensional semidefinite program.

[1]  Serdar Yüksel,et al.  Stochastic Stabilization of Noisy Linear Systems With Fixed-Rate Limited Feedback , 2010, IEEE Transactions on Automatic Control.

[2]  Sekhar Tatikonda,et al.  The Capacity of Channels With Feedback , 2006, IEEE Transactions on Information Theory.

[3]  Alexey S. Matveev,et al.  State estimation via limited capacity noisy communication channels , 2008, Math. Control. Signals Syst..

[4]  Yuval Peres,et al.  Exact minimum number of bits to stabilize a linear system , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[5]  Babak Hassibi,et al.  Rate-cost tradeoffs in scalar LQG control and tracking with side information , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[6]  Andrey V. Savkin,et al.  An Analogue of Shannon Information Theory for Detection and Stabilization via Noisy Discrete Communication Channels , 2007, SIAM J. Control. Optim..

[7]  Pablo A. Parrilo,et al.  Semidefinite Programming Approach to Gaussian Sequential Rate-Distortion Trade-Offs , 2014, IEEE Transactions on Automatic Control.

[8]  Nicola Elia,et al.  Stabilization of linear systems with limited information , 2001, IEEE Trans. Autom. Control..

[9]  Takashi Tanaka,et al.  LQG Control With Minimum Directed Information: Semidefinite Programming Approach , 2015, IEEE Transactions on Automatic Control.

[10]  Milan S. Derpich,et al.  Improved Upper Bounds to the Causal Quadratic Rate-Distortion Function for Gaussian Stationary Sources , 2012, IEEE Transactions on Information Theory.

[11]  Thomas M. Cover,et al.  Network Information Theory , 2001 .

[12]  Stephen P. Boyd,et al.  Determinant Maximization with Linear Matrix Inequality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[13]  Gerhard Kramer,et al.  Directed information for channels with feedback , 1998 .

[14]  Roy Fox,et al.  Minimum-information LQG control part I: Memoryless controllers , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[15]  Karl Henrik Johansson,et al.  Rate of prefix-free codes in LQG control systems , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[16]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[17]  Babak Hassibi,et al.  Algorithms for optimal control with fixed-rate feedback , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[18]  Nasir Uddin Ahmed,et al.  Nonanticipative Rate Distortion Function and Relations to Filtering Theory , 2012, IEEE Transactions on Automatic Control.

[19]  J. Massey CAUSALITY, FEEDBACK AND DIRECTED INFORMATION , 1990 .

[20]  Babak Hassibi,et al.  Rate-cost tradeoffs in control , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).