Accelerated gradient methods and dual decomposition in distributed model predictive control

We propose a distributed optimization algorithm for mixed L"1/L"2-norm optimization based on accelerated gradient methods using dual decomposition. The algorithm achieves convergence rate O(1k^2), where k is the iteration number, which significantly improves the convergence rates of existing duality-based distributed optimization algorithms that achieve O(1k). The performance of the developed algorithm is evaluated on randomly generated optimization problems arising in distributed model predictive control (DMPC). The evaluation shows that, when the problem data is sparse and large-scale, our algorithm can outperform current state-of-the-art optimization software CPLEX and MOSEK.

[1]  Jacques Gauvin,et al.  A necessary and sufficient regularity condition to have bounded multipliers in nonconvex programming , 1977, Math. Program..

[2]  Pierre Carpentier,et al.  Applied mathematics in water supply network management , 1993, Autom..

[3]  G. Dantzig,et al.  THE DECOMPOSITION ALGORITHM FOR LINEAR PROGRAMS , 1961 .

[4]  Bart De Schutter,et al.  A distributed version of Han's method for DMPC using local communications only , 2009 .

[5]  Anders Rantzer,et al.  Distributed Model Predictive Control with suboptimality and stability guarantees , 2010, 49th IEEE Conference on Decision and Control (CDC).

[6]  Madan G. Singh,et al.  Systems: Decomposition, optimisation, and control , 1978 .

[7]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[8]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[9]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[10]  M. Mesarovic,et al.  Theory of Hierarchical, Multilevel, Systems , 1970 .

[11]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[12]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[13]  Johan A. K. Suykens,et al.  Application of a Smoothing Technique to Decomposition in Convex Optimization , 2008, IEEE Transactions on Automatic Control.

[14]  Rolf Findeisen,et al.  A fast gradient method for embedded linear predictive control , 2011 .

[15]  Bart De Schutter,et al.  Multi-agent model predictive control for transportation networks: Serial versus parallel schemes , 2008, Eng. Appl. Artif. Intell..

[16]  G. Dantzig,et al.  The decomposition algorithm for linear programming: notes on linear programming and extensions-part 57. , 1961 .

[17]  M. D. Doan,et al.  An iterative scheme for distributed model predictive control using Fenchel's duality , 2011 .

[18]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[19]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[20]  Manfred Morari,et al.  Real-time input-constrained MPC using fast gradient methods , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Moritz Diehl,et al.  Multiple shooting for distributed systems with applications in hydro electricity production , 2011 .

[23]  John R. Beaumont,et al.  Control and Coordination in Hierarchical Systems , 1981 .