Ensemble prediction-based dynamic robust multi-objective optimization methods

Abstract Many real-world multi-objective optimization problems are subject to environmental changes over time, resulting in changing Pareto-optima. Wide studies on solving dynamic multi-objective optimization problems have so far concentrated on tracking moving Pareto-optima as soon as possible. In practice, however, a new solution every time the environmental change may be different from the previous optima, causing the expensive switching-cost. To this end, dynamic robust multi-objective optimization method is developed to find robust Pareto-optima over time whose performance is acceptable for the current and subsequently changed environments. With the purpose of measuring the robustness of a candidate, its fitness values in the subsequent environments are estimated by ensemble prediction methods constructed by moving average(MA), autoregressive(AR), and single exponential smoothing(SES). MA-, SES- and AR-based sub-prediction models are synthesized by the weight sum. The weights can be the pre-set constant or the binary/real number adjusted in terms of the prediction error. To examine the performance of the developed algorithm, the proposed prediction strategies are compared with three single prediction methods for 11 dynamic benchmark functions. The experimental results indicate that ensemble prediction methods have the better robustness than the single prediction models and can effectively tackle dynamic robust multi-objective optimization problems.

[1]  Changhe Li,et al.  A survey of swarm intelligence for dynamic optimization: Algorithms and applications , 2017, Swarm Evol. Comput..

[2]  Xin Yao,et al.  Robust optimization over time — A new perspective on dynamic optimization problems , 2010, IEEE Congress on Evolutionary Computation.

[3]  Jian Cheng,et al.  Firework-based software project scheduling method considering the learning and forgetting effect , 2019, Soft Comput..

[4]  Yongsheng Ding,et al.  A multi-objective approach to robust optimization over time considering switching cost , 2017, Inf. Sci..

[5]  Meirong Chen,et al.  The Evolutionary Algorithm to Find Robust Pareto-Optimal Solutions over Time , 2015 .

[6]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[7]  Kay Chen Tan,et al.  Solving Multiobjective Optimization Problems in Unknown Dynamic Environments: An Inverse Modeling Approach , 2017, IEEE Trans. Cybern..

[8]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[9]  Shengxiang Yang,et al.  Evolutionary computation for dynamic optimization problems , 2013, GECCO.

[10]  David Wallace,et al.  Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach , 2006, GECCO '06.

[11]  Shengxiang Yang,et al.  A prediction strategy based on center points and knee points for evolutionary dynamic multi-objective optimization , 2017, Appl. Soft Comput..

[12]  Ponnuthurai N. Suganthan,et al.  Crowding-based local differential evolution with speciation-based memory archive for dynamic multimodal optimization , 2013, GECCO '13.

[13]  Kay Chen Tan,et al.  Dynamic Multiobjective Optimization Using Evolutionary Algorithm with Kalman Filter , 2013 .

[14]  Dunwei Gong,et al.  Environment Sensitivity-Based Cooperative Co-Evolutionary Algorithms for Dynamic Multi-Objective Optimization , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[15]  Xin Yao,et al.  A framework for finding robust optimal solutions over time , 2013, Memetic Comput..

[16]  Andries Petrus Engelbrecht,et al.  Population-based metaheuristics for continuous boundary-constrained dynamic multi-objective optimisation problems , 2014, Swarm Evol. Comput..

[17]  Ponnuthurai N. Suganthan,et al.  Evolutionary multiobjective optimization in dynamic environments: A set of novel benchmark functions , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[18]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[19]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[20]  Yaochu Jin,et al.  A directed search strategy for evolutionary dynamic multiobjective optimization , 2015, Soft Comput..

[21]  Xin Yao,et al.  Continuous Dynamic Constrained Optimization—The Challenges , 2012, IEEE Transactions on Evolutionary Computation.

[22]  Peter J. Fleming,et al.  Active Robust Optimization: Enhancing Robustness to Uncertain Environments , 2014, IEEE Transactions on Cybernetics.

[23]  Licheng Jiao,et al.  A coevolutionary technique based on multi-swarm particle swarm optimization for dynamic multi-objective optimization , 2017, Eur. J. Oper. Res..

[24]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[25]  Andries Petrus Engelbrecht,et al.  Dynamic Multi-objective Optimisation Using PSO , 2010, Multi-Objective Swarm Intelligent System.

[26]  Xin Yao,et al.  Dynamic Multiobjectives Optimization With a Changing Number of Objectives , 2016, IEEE Transactions on Evolutionary Computation.

[27]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[28]  Jian Cheng,et al.  Robust Dynamic Multi-Objective Vehicle Routing Optimization Method , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[29]  Ying Tan,et al.  Improving Metaheuristic Algorithms With Information Feedback Models , 2019, IEEE Transactions on Cybernetics.

[30]  Yong Zhang,et al.  A PSO-based multi-objective multi-label feature selection method in classification , 2017, Scientific Reports.

[31]  Shengxiang Yang,et al.  A dynamic multiobjective evolutionary algorithm based on a dynamic evolutionary environment model , 2019, Swarm Evol. Comput..

[32]  Qingfu Zhang,et al.  A Population Prediction Strategy for Evolutionary Dynamic Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[33]  Amir Hossein Gandomi,et al.  Chaotic Krill Herd algorithm , 2014, Inf. Sci..

[34]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[35]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[36]  Jian Cheng,et al.  Interval multi-objective quantum-inspired cultural algorithms , 2016, Neural Computing and Applications.

[37]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[38]  Kay Chen Tan,et al.  A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment , 2010, Memetic Comput..

[39]  Xin Yao,et al.  Dynamic Multi-objective Optimization: A Survey of the State-of-the-Art , 2013 .

[40]  Ponnuthurai N. Suganthan,et al.  Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article] , 2016, IEEE Computational Intelligence Magazine.

[41]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[42]  Kay Chen Tan,et al.  Evolutionary Multi-objective Optimization in Uncertain Environments - Issues and Algorithms , 2009, Studies in Computational Intelligence.

[43]  Yun Liu,et al.  Find robust solutions over time by two-layer multi-objective optimization method , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[44]  Shengxiang Yang,et al.  The effect of diversity maintenance on prediction in dynamic multi-objective optimization , 2017, Appl. Soft Comput..

[45]  Zhuhong Zhang,et al.  Multiobjective optimization immune algorithm in dynamic environments and its application to greenhouse control , 2008, Appl. Soft Comput..

[46]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[47]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[48]  Xin Yao,et al.  Finding Robust Solutions to Dynamic Optimization Problems , 2013, EvoApplications.

[49]  Liu Min,et al.  Memory Enhanced Dynamic Multi-Objective Evolutionary Algorithm Based on Decomposition , 2013 .