On the Volatility of Optimal Control Policies and the Capacity of a Class of Linear Quadratic Regulators.

It is well known that highly volatile control laws, while theoretically optimal for certain systems, are undesirable from an engineering perspective, being generally deleterious to the controlled system. In this article we are concerned with the temporal volatility of the control process of the regulator in discrete time Linear Quadratic Regulators (LQRs). Our investigation in this paper unearths a surprising connection between the cost functional which an LQR is tasked with minimizing and the temporal variations of its control laws. We first show that optimally controlling the system always implies high levels of control volatility, i.e., it is impossible to reduce volatility in the optimal control process without sacrificing cost. We also show that, akin to communication systems, every LQR has a $Capacity~Region$ associated with it, that dictates and quantifies how much cost is achievable at a given level of control volatility. This additionally establishes the fact that no admissible control policy can simultaneously achieve low volatility and low cost. We then employ this analysis to explain the phenomenon of temporal price volatility frequently observed in deregulated electricity markets.

[1]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[2]  Ali Kakhbod,et al.  Competition in Electricity Markets with Renewable Energy Sources , 2017 .

[3]  Chaim Fershtman Fixed rules and decision rules: Time consistency and subgame perfection , 1989 .

[4]  Onésimo Hernández Lerma,et al.  The Lagrange approach to constrained Markov control processes: a survey and extension of results , 2003 .

[5]  Shie Mannor,et al.  Regulation and efficiency in markets with friction , 2010, 49th IEEE Conference on Decision and Control (CDC).

[6]  F. Schweppe,et al.  Optimal Pricing in Electrical Networks over Space and Time , 1984 .

[7]  Arman C. Kizilkale,et al.  Volatility and efficiency in markets with friction , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[8]  Asuman E. Ozdaglar,et al.  Competitive equilibrium in electricity markets with heterogeneous users and price fluctuation penalty , 2014, 53rd IEEE Conference on Decision and Control.

[9]  David K. Smith,et al.  Dynamic Programming and Optimal Control. Volume 1 , 1996 .

[10]  Robert B. Jackson,et al.  Opportunities and barriers to pumped-hydro energy storage in the United States , 2011 .

[11]  Z. Gao,et al.  On properties and applications of a new form of discrete time optimal control law , 2004, Conference Record of the 2004 IEEE Industry Applications Conference, 2004. 39th IAS Annual Meeting..

[12]  Rahul Singh,et al.  Decentralized Control via Dynamic Stochastic Prices: The Independent System Operator Problem , 2016, IEEE Transactions on Automatic Control.

[13]  Paul D. McNelis,et al.  Macroeconomic policy games and asset-price volatility in the EMS: a linear quadratic control analysis of France, Germany, Italy and Spain , 2002 .

[14]  Loren Fox,et al.  Enron: The Rise and Fall , 2002 .

[15]  Raia Hadsell,et al.  Value constrained model-free continuous control , 2019, ArXiv.

[16]  Leandros Tassiulas,et al.  Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks , 1990, 29th IEEE Conference on Decision and Control.

[17]  Chi-Keung Woo,et al.  The impact of wind generation on the electricity spot-market price level and variance: The Texas experience , 2011 .

[18]  M. Caramanis,et al.  Optimal Spot Pricing: Practice and Theory , 1982, IEEE Transactions on Power Apparatus and Systems.

[19]  Joseph Z. Ben-Asher,et al.  Optimal control theory with aerospace applications , 2010 .

[20]  G. Chow Analysis and control of dynamic economic systems , 1975 .

[21]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[22]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control 3rd Edition, Volume II , 2010 .

[23]  Rekha Reddy,et al.  Lowering Electricity Prices Through Deregulation , 2000 .

[24]  Carlo Carraro,et al.  Developments of Control Theory for Economic Analysis , 2011 .

[25]  P. Joskow,et al.  Challenges for wholesale electricity markets with intermittent renewable generation at scale: the US experience , 2019, Oxford Review of Economic Policy.

[26]  F. Schweppe,et al.  Real Time Pricing to Assist in Load Frequency Control , 1989, IEEE Power Engineering Review.

[27]  W. Hogan Contract networks for electric power transmission , 1992 .

[28]  J. Nutaro,et al.  The Impact of Market Clearing Time and Price Signal Delay on the Stability of Electric Power Markets , 2009, IEEE Transactions on Power Systems.

[29]  Asuman E. Ozdaglar,et al.  Reducing electricity price volatility via stochastic storage control , 2016, 2016 American Control Conference (ACC).

[30]  Munther A. Dahleh,et al.  Volatility of Power Grids Under Real-Time Pricing , 2011, IEEE Transactions on Power Systems.

[31]  Zhiqiang Gao,et al.  On discrete time optimal control: a closed-form solution , 2004, Proceedings of the 2004 American Control Conference.

[32]  Paul Denholm,et al.  Overgeneration from Solar Energy in California - A Field Guide to the Duck Chart , 2015 .

[33]  E. Altman Constrained Markov Decision Processes , 1999 .

[34]  Eric Maskin,et al.  Markov Perfect Equilibrium: I. Observable Actions , 2001, J. Econ. Theory.

[35]  Kenji Hirata,et al.  A dynamic mechanism for LQG power networks with random type parameters and pricing delay , 2013, 52nd IEEE Conference on Decision and Control.

[36]  Steve Pye,et al.  Improving deep decarbonization modelling capacity for developed and developing country contexts , 2016 .

[37]  Lorenzo Kristov,et al.  A Tale of Two Visions: Designing a Decentralized Transactive Electric System , 2016, IEEE Power and Energy Magazine.

[38]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[39]  Shie Mannor,et al.  Regulation and double price mechanisms in markets with friction , 2011, IEEE Conference on Decision and Control and European Control Conference.

[40]  Fernando L. Alvarado,et al.  The influence of futures markets on real time price stabilization in electricity markets , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[41]  Sean P. Meyn,et al.  Efficiency and marginal cost pricing in dynamic competitive markets with friction , 2010 .

[42]  A. Venturini,et al.  Day-ahead market price volatility analysis in deregulated electricity markets , 2002, IEEE Power Engineering Society Summer Meeting,.

[43]  William W. Hogan Demand response compensation, net Benefits and cost allocation: comments , 2010 .

[44]  F. Alvarado The stability of power system markets , 1999 .