Seeding the initial population of a multi-objective evolutionary algorithm using gradient-based information

In the field of single-objective optimization, hybrid variants of gradient-based methods and evolutionary algorithms have been shown to perform better than an evolutionary method by itself. This same idea has been recently used in Evolutionary Multiobjective Optimization (EMO), obtaining also very promising results. In most cases, gradient information is used along the whole process, which involves a high computational cost, mainly related to the computation of the step lengths required. In contrast, in this paper we propose the use of gradient information only at the beginning of the search process. We will show that this sort of scheme maintains results of good quality while considerably decreasing the computational cost. In our work, we adopt a steepest descent method to generate some nondominated points which are then used to seed the initial population of a multi-objective evolutionary algorithm (MOEA), which will spread them along the Pareto front. The MOEA adopted in our case is the NSGA-II, which is representative of the state-of-the-art in the area. To validate our proposal, we adopt box-constrained continuous problems (the ZDT test suite). The gradients required are approximated using quadratic regressions. Our proposed approach performs a total of 2000 objective function evaluations, which is much lower than the number of evaluations normally adopted with the ZDT test suite in the specialized literature. Our results are compared with respect to the ldquopurerdquo NSGA-II (i.e., without using gradient-based information) so that the potential benefit of these initial solutions fed into the population can be properly assessed.

[1]  Marc Despontin,et al.  Multiple Criteria Optimization: Theory, Computation, and Application, Ralph E. Steuer (Ed.). Wiley, Palo Alto, CA (1986) , 1987 .

[2]  S. Schäffler,et al.  Stochastic Method for the Solution of Unconstrained Vector Optimization Problems , 2002 .

[3]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[4]  Xiaolin Hu,et al.  Hybridization of the multi-objective evolutionary algorithms and the gradient-based algorithms , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[5]  M. Dellnitz,et al.  Covering Pareto Sets by Multilevel Subdivision Techniques , 2005 .

[6]  Pradyumn Kumar Shukla,et al.  On Gradient Based Local Search Methods in Unconstrained Evolutionary Multi-objective Optimization , 2007, EMO.

[7]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[8]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[9]  Peter A. N. Bosman,et al.  Combining gradient techniques for numerical multi-objective evolutionary optimization , 2006, GECCO '06.

[10]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[11]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[12]  Martin Brown,et al.  Effective Use of Directional Information in Multi-objective Evolutionary Computation , 2003, GECCO.

[13]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[14]  Peter A. N. Bosman,et al.  Exploiting gradient information in numerical multi--objective evolutionary optimization , 2005, GECCO '05.

[15]  Rafael Caballero,et al.  SSPMO: A Scatter Tabu Search Procedure for Non-Linear Multiobjective Optimization , 2007, INFORMS J. Comput..

[16]  Jörg Fliege,et al.  Steepest descent methods for multicriteria optimization , 2000, Math. Methods Oper. Res..

[17]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .