A hybridization of MOEA/D with the nonlinear simplex search algorithm

In the last few years, the development of hybrid algorithms that combine multi-objective evolutionary algorithms (MOEAs) with mathematical programming techniques has significantly increased. Such hybrid algorithms attempt to combine the global search properties of MOEAs with the exploitative power of mathematical programming techniques. Most of these approaches normally rely on the use of gradients and, therefore, their use is limited to certain types of problems. The use of nonlinear direct search techniques-i.e., methods that do not require gradient information-has been less popular in these type of approaches. This paper focuses on the design of a hybrid algorithm between the well-known MOEAID and one of most popular direct search methods, the Nelder and Mead method. The mathematical programming technique adopted here, acts as a local search engine, whose goal is to exploit promising regions of the search space that have been generated by MOEAID. Our preliminary results indicate that this sort of hybridization is promising for dealing with multi-objective optimization problems having a moderately high number of decision variables.

[1]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[2]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[3]  Sanjoy Das,et al.  Multi-objective hybrid PSO using µ-fuzzy dominance , 2007, GECCO '07.

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[6]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[7]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[8]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[9]  Wenhui Fan,et al.  Hybrid Non-dominated Sorting Differential Evolutionary Algorithm with Nelder-Mead , 2010, 2010 Second WRI Global Congress on Intelligent Systems.

[10]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[11]  Saúl Zapotecas Martínez,et al.  A multi-objective particle swarm optimizer based on decomposition , 2011, GECCO '11.

[12]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[13]  Indraneel Das,et al.  Nonlinear Multicriteria Optimization and Robust Optimality , 1997 .

[14]  Saúl Zapotecas Martínez,et al.  A Proposal to Hybridize Multi-Objective Evolutionary Algorithms with Non-gradient Mathematical Programming Techniques , 2008, PPSN.

[15]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[16]  Hong Li,et al.  MOEA/D + uniform design: A new version of MOEA/D for optimization problems with many objectives , 2013, Comput. Oper. Res..

[17]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[18]  Ieee Staff 2014 IEEE Symposium on Computational Intelligence in Multi Criteria Decision Making (MCDM) , 2014 .

[19]  Saúl Zapotecas Martínez,et al.  A direct local search mechanism for decomposition-based multi-objective evolutionary algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[20]  J. Dennis,et al.  NORMAL-BOUNDARY INTERSECTION: AN ALTERNATE METHOD FOR GENERATING PARETO OPTIMAL POINTS IN MULTICRITERIA OPTIMIZATION PROBLEMS , 1996 .

[21]  Philippe Vincke,et al.  Multicriteria Decision-aid , 1993 .

[22]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[23]  J. Hammersley MONTE CARLO METHODS FOR SOLVING MULTIVARIABLE PROBLEMS , 1960 .

[24]  Qingfu Zhang,et al.  A decomposition-based multi-objective Particle Swarm Optimization algorithm for continuous optimization problems , 2008, 2008 IEEE International Conference on Granular Computing.

[25]  G. R. Hext,et al.  Sequential Application of Simplex Designs in Optimisation and Evolutionary Operation , 1962 .

[26]  Oliver Kramer,et al.  On the hybridization of SMS-EMOA and local search for continuous multiobjective optimization , 2009, GECCO '09.

[27]  Sanjoy Das,et al.  Fuzzy Dominance Based Multi-objective GA-Simplex Hybrid Algorithms Applied to Gene Network Models , 2004, GECCO.

[28]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[29]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[30]  Pradyumn Kumar Shukla,et al.  On Gradient Based Local Search Methods in Unconstrained Evolutionary Multi-objective Optimization , 2007, EMO.