An Innovization-based Evolutionary Algorithm Framework for Large-Scale Practical Multi-Objective Optimization Problems

—Large-scale multi-objective optimization problems (LSMOPs) are challenging to solve for most optimization algorithms including standard and generic multi-objective evolution- ary algorithms (MOEAs) due to the ”curse of dimensionality.” Although there exist a few case studies involving customized evolutionary algorithms to solve large-scale problems, specific problem knowledge obtained through extensive experience of users or domain experts can facilitate a more efficient application. Innovization is the process of uncovering patterns that exist among good solutions. Any common pattern extracted from good solutions discovered during an optimization run can be used to modify candidate solutions in the form of a repair operator, but the key aspect is to strike a balance between the relevance of the pattern identified and the extent of their use in the repair operator, lest the learned patterns are properties of artificially-stuck solutions. Thus, the use of problem knowledge for the initial guidance and innovization-based repair of solutions during optimization in an online fashion can help find better solutions, faster. This paper proposes a customized MOEA frame- work which combines problem-specific knowledge and online innovization methods to solve two real-world LSMOPs – 879 and 1,479-variable truss structure design and 544-variable solid fuel rocket design. Four different repair operators are proposed that are suitable for uncovering monotonic relations involving multiple decision variables. The performance variations resulting from different combinations of initial user knowledge and repair operators have also been studied. The proposed approach is generic and provides a viable direction for handling large-scale multi-objective practical problems.

[1]  Jing Liu,et al.  An Evolutionary Multiobjective Framework for Complex Network Reconstruction Using Community Structure , 2021, IEEE Transactions on Evolutionary Computation.

[2]  Afonso C. C. Lemonge,et al.  Multi-objective truss structural optimization considering natural frequencies of vibration and global stability , 2021, Expert Syst. Appl..

[3]  Kalyanmoy Deb,et al.  Combining User Knowledge and Online Innovization for Faster Solution to Multi-objective Design Optimization Problems , 2021, International Conference on Evolutionary Multi-Criterion Optimization.

[4]  Kalyanmoy Deb,et al.  A Large-scale Bi-objective Optimization of Solid Rocket Motors Using Innovization , 2020, 2020 IEEE Congress on Evolutionary Computation (CEC).

[5]  Ruochen Liu,et al.  A random dynamic grouping based weight optimization framework for large-scale multi-objective optimization problems , 2020, Swarm Evol. Comput..

[6]  Ye Tian,et al.  Evolutionary Large-Scale Multiobjective Optimization for Ratio Error Estimation of Voltage Transformers , 2020, IEEE Transactions on Evolutionary Computation.

[7]  Mohamed A. Eid,et al.  Structural optimization of concrete arch bridges using Genetic Algorithms , 2019, Ain Shams Engineering Journal.

[8]  Xin Yao,et al.  A Scalable Indicator-Based Evolutionary Algorithm for Large-Scale Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[9]  Shahryar Rahnamayan,et al.  Using semi-independent variables to enhance optimization search , 2019, Expert Syst. Appl..

[10]  Liu Yongjian,et al.  A review on application of composite truss bridges composed of hollow structural section members , 2019 .

[11]  Feng Zhao,et al.  A Cooperative Co-Evolutionary Approach to Large-Scale Multisource Water Distribution Network Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[12]  D. Duong-Gia,et al.  An efficient combination of multi-objective evolutionary optimization and reliability analysis for reliability-based design optimization of truss structures , 2018, Expert Syst. Appl..

[13]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[14]  Kalyanmoy Deb,et al.  A population-based fast algorithm for a billion-dimensional resource allocation problem with integer variables , 2017, Eur. J. Oper. Res..

[15]  L. Darrell Whitley,et al.  Optimizing one million variable NK landscapes by hybridizing deterministic recombination and local search , 2017, GECCO.

[16]  Xin Liu,et al.  A Distributed Parallel Cooperative Coevolutionary Multiobjective Evolutionary Algorithm for Large-Scale Optimization , 2017, IEEE Transactions on Industrial Informatics.

[17]  Shuai Wang,et al.  Reconstructing Networks from Profit Sequences in Evolutionary Games via a Multiobjective Optimization Approach with Lasso Initialization , 2016, Scientific Reports.

[18]  Carlos A. Coello Coello,et al.  Decomposition-Based Approach for Solving Large Scale Multi-objective Problems , 2016, PPSN.

[19]  Kalyanmoy Deb,et al.  Adaptive Use of Innovization Principles for a Faster Convergence of Evolutionary Multi-Objective Optimization Algorithms , 2016, GECCO.

[20]  Fang Liu,et al.  A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables , 2016, IEEE Transactions on Evolutionary Computation.

[21]  Kalyanmoy Deb,et al.  An improved fully stressed design evolution strategy for layout optimization of truss structures , 2016 .

[22]  Sanghamitra Bandyopadhyay,et al.  An Algorithm for Many-Objective Optimization With Reduced Objective Computations: A Study in Differential Evolution , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Kalyanmoy Deb,et al.  Generalized higher-level automated innovization with application to inventory management , 2015, Eur. J. Oper. Res..

[24]  Kalyanmoy Deb,et al.  Towards an automated innovization method for handling discrete search spaces , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[25]  Razvan Cazacu,et al.  Steel Truss Optimization Using Genetic Algorithms and FEA , 2014 .

[26]  Kalyanmoy Deb,et al.  Higher and lower-level knowledge discovery from Pareto-optimal sets , 2013, J. Glob. Optim..

[27]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  Kalyanmoy Deb,et al.  Interleaving Innovization with Evolutionary Multi-Objective Optimization in Production System Simulation for Faster Convergence , 2013, LION.

[29]  Kalyanmoy Deb,et al.  Hybrid evolutionary multi-objective optimization and analysis of machining operations , 2012 .

[30]  K. Deb,et al.  Automated Innovization for Simultaneous Discovery of Multiple Rules in Bi-objective Problems , 2011, International Conference on Evolutionary Multi-Criterion Optimization.

[31]  J. Gibbons,et al.  Nonparametric Statistical Inference , 2020, International Encyclopedia of Statistical Science.

[32]  Carlos A. Coello Coello,et al.  A Study of Multiobjective Metaheuristics When Solving Parameter Scalable Problems , 2010, IEEE Transactions on Evolutionary Computation.

[33]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[34]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[35]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[36]  Enrique Alba,et al.  A comparative study of the effect of parameter scalability in multi-objective metaheuristics , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[37]  Aravind Srinivasan,et al.  Innovization: innovating design principles through optimization , 2006, GECCO.

[38]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[39]  R. Lyndon While,et al.  A Scalable Multi-objective Test Problem Toolkit , 2005, EMO.

[40]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[41]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[42]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[43]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[44]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[45]  Martin P. Bendsøe,et al.  Topology design of truss structures , 1995 .

[46]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[47]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.