A direct local search mechanism for decomposition-based multi-objective evolutionary algorithms

In recent years, the development of multi-objective evolutionary algorithms (MOEAs) hybridized with mathematical programming techniques has significantly increased. However, most of these hybrid approaches are gradient-based, and tend to require a high number of extra objective function evaluations to estimate the gradient information required. The use of direct search methods-i.e., methods that do not require gradient information-has been, however, less popular in the specialized literature (although such approaches have been used with single-objective evolutionary algorithms). This paper precisely focuses on the design of a hybrid between the wellknownMOEA/ D and Nelder and Mead's algorithm. Clearly, the mathematical programming technique adopted here, acts as a local search mechanism, whose goal is to improve the search performed by MOEA/D. Because of its nature, the proposed local search mechanism can be easily coupled to any other decomposition-based MOEA. Our preliminary results indicate that this sort of hybridization is quite promising for dealing with multi-objective optimization problems (MOPs) having high dimensionality (in decision variable space).

[1]  Xiaolin Hu,et al.  Hybridization of the multi-objective evolutionary algorithms and the gradient-based algorithms , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[2]  J. Hammersley MONTE CARLO METHODS FOR SOLVING MULTIVARIABLE PROBLEMS , 1960 .

[3]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[4]  Carlos A. Coello Coello,et al.  HCS: A New Local Search Strategy for Memetic Multiobjective Evolutionary Algorithms , 2010, IEEE Transactions on Evolutionary Computation.

[5]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[6]  G. R. Hext,et al.  Sequential Application of Simplex Designs in Optimisation and Evolutionary Operation , 1962 .

[7]  M. Rahman,et al.  An intelligent moving object optimization algorithm for design problems with mixed variables, mixed constraints and multiple objectives , 2006 .

[8]  Qingfu Zhang,et al.  A decomposition-based multi-objective Particle Swarm Optimization algorithm for continuous optimization problems , 2008, 2008 IEEE International Conference on Granular Computing.

[9]  Mohamed B. Trabia,et al.  A Fuzzy Adaptive Simplex Search Optimization Algorithm , 1999, DAC 1999.

[10]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Saúl Zapotecas Martínez,et al.  A Proposal to Hybridize Multi-Objective Evolutionary Algorithms with Non-gradient Mathematical Programming Techniques , 2008, PPSN.

[12]  Wenhui Fan,et al.  Hybrid Non-dominated Sorting Differential Evolutionary Algorithm with Nelder-Mead , 2010, 2010 Second WRI Global Congress on Intelligent Systems.

[13]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[14]  Saúl Zapotecas Martínez,et al.  A multi-objective meta-model assisted memetic algorithm with non gradient-based local search , 2010, GECCO '10.

[15]  Sanjoy Das,et al.  Multi-objective hybrid PSO using µ-fuzzy dominance , 2007, GECCO '07.

[16]  V. J. Torczoit,et al.  Multidirectional search: a direct search algorithm for parallel machines , 1989 .

[17]  Ian Griffin,et al.  Hybrid multiobjective genetic algorithm with a new adaptive local search process , 2005, GECCO '05.

[18]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[19]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[20]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[21]  J. Dennis,et al.  NORMAL-BOUNDARY INTERSECTION: AN ALTERNATE METHOD FOR GENERATING PARETO OPTIMAL POINTS IN MULTICRITERIA OPTIMIZATION PROBLEMS , 1996 .

[22]  Saúl Zapotecas Martínez,et al.  A multi-objective particle swarm optimizer based on decomposition , 2011, GECCO '11.

[23]  A. Ravindran,et al.  Engineering Optimization: Methods and Applications , 2006 .

[24]  John A. W. McCall,et al.  A Novel Smart Multi-Objective Particle Swarm Optimisation Using Decomposition , 2010, PPSN.

[25]  Pradyumn Kumar Shukla,et al.  On Gradient Based Local Search Methods in Unconstrained Evolutionary Multi-objective Optimization , 2007, EMO.

[26]  Peter A. N. Bosman,et al.  Combining gradient techniques for numerical multi-objective evolutionary optimization , 2006, GECCO '06.

[27]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[28]  Saúl Zapotecas Martínez,et al.  A Memetic Algorithm with Non Gradient-Based Local Search Assisted by a Meta-model , 2010, PPSN.

[29]  L. Darrell Whitley,et al.  Lamarckian Evolution, The Baldwin Effect and Function Optimization , 1994, PPSN.

[30]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[31]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[32]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.