On LQG control across a stochastic packet-dropping link

In this paper, we consider the problem of optimal linear quadratic Gaussian control of a system in which communication between the sensor and the controller occurs across a packet-dropping link. We first prove a separation principle that allows us to solve this problem using a standard LQR state-feedback design, along with an optimal algorithm for propagating and using the information across the unreliable link. Then we present one such optimal algorithm, which consists of a Kalman filter at the sensor side of the link, and a switched linear filter at the controller side. Our design does not assume any statistical model of the packet drop events, and is thus optimal for any arbitrary packet drop pattern. Further, the solution is appealing from a practical point of view because it can be implemented as a small modification of an existing LQG control design.

[1]  Qiang Ling,et al.  Soft real-time scheduling of networked control systems with dropouts governed by a Markov chain , 2003, Proceedings of the 2003 American Control Conference, 2003..

[2]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[3]  K. Poolla,et al.  Time varying optimal control with packet losses , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[4]  Kannan Ramchandran,et al.  On rate-constrained distributed estimation in unreliable sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[5]  T. Kailath,et al.  Indefinite-quadratic estimation and control: a unified approach to H 2 and H ∞ theories , 1999 .

[6]  D. Sworder,et al.  Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria , 1975 .

[7]  H. Witsenhausen.  Separation of estimation and control for discrete time systems , 1971 .

[8]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[9]  J. Hespanha,et al.  Towards the Control of Linear Systems with Minimum Bit-Rate , 2002 .

[10]  Richard M. Murray,et al.  Optimal LQG control across packet-dropping links , 2007, Syst. Control. Lett..

[11]  N. Tsai,et al.  Stochastic optimal control under randomly varying distributed delays , 1997 .

[12]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[13]  Nicola Elia,et al.  Stabilization of linear systems with limited information , 2001, IEEE Trans. Autom. Control..

[14]  Johan Nilsson,et al.  Real-Time Control Systems with Delays , 1998 .

[15]  D. Delchamps.  Stabilizing a linear system with quantized state feedback , 1990 .

[16]  Qiang Ling,et al.  Power spectral analysis of networked control systems with data dropouts , 2004, IEEE Transactions on Automatic Control.

[17]  Tamer Basar,et al.  Optimal control of dynamical systems over unreliable communication links , 2004 .

[18]  B. Azimi-Sadjadi,et al.  Stability of networked control systems in the presence of packet losses , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[19]  Michael D. Lemmon,et al.  Robust performance of soft real-time networked control systems with data dropouts , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[20]  Stephen P. Boyd,et al.  Control of asynchronous dynamical systems with rate constraints on events , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[21]  Christoforos N. Hadjicostis,et al.  Feedback control utilizing packet dropping network links , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[22]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.

[23]  A. Goldsmith,et al.  Kalman filtering with partial observation losses , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[24]  Daniel Liberzon,et al.  Quantized feedback stabilization of linear systems , 2000, IEEE Trans. Autom. Control..

[25]  R. Murray,et al.  Optimal LQG Control Across a Packet-Dropping Link , 2004 .

[26]  Robin J. Evans,et al.  Stabilizability of Stochastic Linear Systems with Finite Feedback Data Rates , 2004, SIAM J. Control. Optim..

[27]  Babak Hassibi,et al.  Indefinite-Quadratic Estimation And Control , 1987 .

[28]  Wei Zhang,et al.  Stability of networked control systems , 2001 .

[29]  Qiang Ling,et al.  Optimal dropout compensation in networked control systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[30]  Peter J Seiler,et al.  Coordinated Control of Unmanned Aerial Vehicles , 2001 .

[31]  Asok Ray,et al.  An observer-based compensator for distributed delays , 1990, Autom..