Multiobjective Estimation of Distribution Algorithm Based on Joint Modeling of Objectives and Variables

This paper proposes a new multiobjective estimation of distribution algorithm (EDA) based on joint probabilistic modeling of objectives and variables. This EDA uses the multidimensional Bayesian network as its probabilistic model. In this way, it can capture the dependencies between objectives, variables and objectives, as well as the dependencies learned between variables in other Bayesian network-based EDAs. This model leads to a problem decomposition that helps the proposed algorithm find better tradeoff solutions to the multiobjective problem. In addition to Pareto set approximation, the algorithm is also able to estimate the structure of the multiobjective problem. To apply the algorithm to many-objective problems, the algorithm includes four different ranking methods proposed in the literature for this purpose. The algorithm is first applied to the set of walking fish group problems, and its optimization performance is compared with a standard multiobjective evolutionary algorithm and another competitive multiobjective EDA. The experimental results show that on several of these problems, and for different objective space dimensions, the proposed algorithm performs significantly better and on some others achieves comparable results when compared with the other two algorithms. The algorithm is then tested on the set of CEC09 problems, where the results show that multiobjective optimization based on joint model estimation is able to obtain considerably better fronts for some of the problems compared with the search based on conventional genetic operators in the state-of-the-art multiobjective evolutionary algorithms.

[1]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[2]  David Heckerman,et al.  Learning Gaussian Networks , 1994, UAI.

[3]  Ivo F. Sbalzariniy,et al.  Multiobjective optimization using evolutionary algorithms , 2000 .

[4]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[5]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[6]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[7]  Pedro Larrañaga,et al.  Evolutionary Bayesian Classifier-Based Optimization in Continuous Domains , 2006, SEAL.

[8]  Soon-Thiam Khu,et al.  An Investigation on Preference Order Ranking Scheme for Multiobjective Evolutionary Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[9]  Takao Terano,et al.  Bayesian optimization algorithm for multi-objective solutions: application to electric equipment configuration problems in a power plant , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[10]  Martin Pelikan,et al.  Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications (Studies in Computational Intelligence) , 2006 .

[11]  Concha Bielza,et al.  Multi-objective Optimization with Joint Probabilistic Modeling of Objectives and Variables , 2011, EMO.

[12]  Pedro Larrañaga,et al.  Evolutionary computation based on Bayesian classifiers , 2004 .

[13]  K. Strimmer,et al.  Statistical Applications in Genetics and Molecular Biology A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics , 2011 .

[14]  Carlos A. Coello Coello,et al.  Alternative Fitness Assignment Methods for Many-Objective Optimization Problems , 2009, Artificial Evolution.

[15]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[16]  Sai Ho Chung,et al.  Multi-criteria genetic optimization for distribution network problems , 2004 .

[17]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[18]  Jesús García,et al.  Multi-objective optimization with an adaptive resonance theory-based estimation of distribution algorithm , 2013, Annals of Mathematics and Artificial Intelligence.

[19]  Marco Laumanns,et al.  Bayesian Optimization Algorithms for Multi-objective Optimization , 2002, PPSN.

[20]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[21]  RåHW Fkryd.  Multiobjective Bayesian Optimization Algorithm for Combinatorial Problems : Theory and practice , 2002 .

[22]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[23]  Eckart Zitzler,et al.  Objective Reduction in Evolutionary Multiobjective Optimization: Theory and Applications , 2009, Evolutionary Computation.

[24]  Mícheál Ó Foghlú,et al.  Frequent Closed Informative Itemset Mining , 2007 .

[25]  Max Henrion,et al.  Propagating uncertainty in bayesian networks by probabilistic logic sampling , 1986, UAI.

[26]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[27]  K. Deb,et al.  On Finding Pareto-Optimal Solutions Through Dimensionality Reduction for Certain Large-Dimensional Multi-Objective Optimization Problems , 2022 .

[28]  Evan J. Hughes,et al.  Evolutionary many-objective optimisation: many once or one many? , 2005, 2005 IEEE Congress on Evolutionary Computation.

[29]  Concha Bielza,et al.  A review on probabilistic graphical models in evolutionary computation , 2012, J. Heuristics.

[30]  Kalyanmoy Deb,et al.  A combined genetic adaptive search (GeneAS) for engineering design , 1996 .

[31]  Jonathan Lawry,et al.  Symbolic and Quantitative Approaches to Reasoning with Uncertainty , 2009 .

[32]  Xiaoping Zhong,et al.  A Decision-Tree-Based Multi-objective Estimation of Distribution Algorithm , 2007, 2007 International Conference on Computational Intelligence and Security (CIS 2007).

[33]  Siddhartha Shakya,et al.  Optimization by estimation of distribution with DEUM framework based on Markov random fields , 2007, Int. J. Autom. Comput..

[34]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[35]  L. Jain,et al.  Evolutionary multiobjective optimization : theoretical advances and applications , 2005 .

[36]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[37]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[38]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[39]  Jan Unkelbach.  How many plans are needed in an IMRT multi-objective plan database? , 2008 .

[40]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[41]  Kay Chen Tan,et al.  Restricted Boltzmann machine based algorithm for multi-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[42]  Eckart Zitzler,et al.  Pattern identification in pareto-set approximations , 2008, GECCO '08.

[43]  Concha Bielza,et al.  Approximating nondominated sets in continuous multiobjective optimization problems , 2005 .

[44]  Lothar Thiele,et al.  Quality Assessment of Pareto Set Approximations , 2008, Multiobjective Optimization.

[45]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[46]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[47]  Jesús García,et al.  MB-GNG: Addressing drawbacks in multi-objective optimization estimation of distribution algorithms , 2011, Oper. Res. Lett..

[48]  Mark W. Schmidt,et al.  Learning Graphical Model Structure Using L1-Regularization Paths , 2007, AAAI.

[49]  David E. Goldberg,et al.  Limits of scalability of multiobjective estimation of distribution algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[50]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[51]  S. Lauritzen.  Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models , 1992 .

[52]  Hartmut Schmeck,et al.  Variable Preference Modeling Using Multi-Objective Evolutionary Algorithms , 2011, EMO.

[53]  Kay Chen Tan,et al.  A Hybrid Estimation of Distribution Algorithm with Decomposition for Solving the Multiobjective Multiple Traveling Salesman Problem , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[54]  Concha Bielza,et al.  Mining probabilistic models learned by EDAs in the optimization of multi-objective problems , 2009, GECCO.

[55]  Edmondo A. Minisci,et al.  MOPED: A Multi-objective Parzen-Based Estimation of Distribution Algorithm for Continuous Problems , 2003, EMO.

[56]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[57]  Carlos A. Coello Coello,et al.  Ranking Methods for Many-Objective Optimization , 2009, MICAI.

[58]  Chang Wook Ahn,et al.  A diversity preserving selection in multiobjective evolutionary algorithms , 2010, Applied Intelligence.

[59]  Marco Laumanns,et al.  A Tutorial on Evolutionary Multiobjective Optimization , 2004, Metaheuristics for Multiobjective Optimisation.

[60]  Daniel E. Goldberg.  The design of innovation: Lessons from genetic algorithms , 1998 .

[61]  Linda C. van der Gaag,et al.  Inference and Learning in Multi-dimensional Bayesian Network Classifiers , 2007, ECSQARU.

[62]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[63]  Abdullah Al Mamun,et al.  Multi-Objective Optimization with Estimation of Distribution Algorithm in a Noisy Environment , 2013, Evolutionary Computation.

[64]  Concha Bielza,et al.  Multi-dimensional classification with Bayesian networks , 2011, Int. J. Approx. Reason..

[65]  Xiao Hu,et al.  Multiobjective Estimation of Distribution Algorithm Combined with PSO for RFID Network Optimization , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[66]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[67]  Concha Bielza,et al.  Regularized continuous estimation of distribution algorithms , 2013, Appl. Soft Comput..

[68]  J. Franklin,et al.  The elements of statistical learning: data mining, inference and prediction , 2005 .

[69]  Wray L. Buntine.  Theory Refinement on Bayesian Networks , 1991, UAI.

[70]  Wray L. Buntine.  A Guide to the Literature on Learning Probabilistic Networks from Data , 1996, IEEE Trans. Knowl. Data Eng..

[71]  Dirk Thierens,et al.  Adaptive variance scaling in continuous multi-objective estimation-of-distribution algorithms , 2007, GECCO '07.

[72]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[73]  Dirk Thierens,et al.  Multi-objective mixture-based iterated density estimation evolutionary algorithms , 2001 .

[74]  Carlos A. Coello Coello,et al.  GIAA TECHNINAL REPORT GIAA2010E001 On Current Model-Building Methods for Multi-Objective Estimation of Distribution Algorithms: Shortcommings and Directions for Improvement , 2010 .

[75]  Lakhmi C. Jain,et al.  Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[76]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[77]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[78]  Kok Kiong Tan,et al.  A hybrid adaptive evolutionary algorithm in the domination-based and decomposition-based frameworks of multi-objective optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[79]  Hisao Ishibuchi,et al.  Effectiveness of scalability improvement attempts on the performance of NSGA-II for many-objective problems , 2008, GECCO '08.

[80]  Chang Wook Ahn,et al.  Multiobjective real-coded bayesian optimization algorithmrevisited: diversity preservation , 2007, GECCO '07.

[81]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[82]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[83]  Sébastien Vérel,et al.  Analyzing the Effect of Objective Correlation on the Efficient Set of MNK-Landscapes , 2011, LION.

[84]  D. Dentcheva,et al.  On several concepts for ɛ-efficiency , 1994 .

[85]  Bernhard Sendhoff,et al.  Voronoi-based estimation of distribution algorithm for multi-objective optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[86]  David E. Goldberg,et al.  Multi-objective bayesian optimization algorithm , 2002 .

[87]  Carlos A. Coello Coello,et al.  Two novel approaches for many-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[88]  Nir Friedman,et al.  Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning , 2009 .

[89]  Kevin Tucker,et al.  Response surface approximation of pareto optimal front in multi-objective optimization , 2004 .

[90]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[91]  Lakhmi C. Jain,et al.  Evolutionary Multiobjective Optimization: Theoretical Advances and Applications (Advanced Information and Knowledge Processing) , 2005 .

[92]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[93]  Carlos A. Coello Coello,et al.  Objective reduction using a feature selection technique , 2008, GECCO '08.

[94]  Martin Pelikan,et al.  Scalable Optimization via Probabilistic Modeling , 2006, Studies in Computational Intelligence.

[95]  G Guilln-Goslbez.  A novel MILP-based objective reduction method for multi-objective optimization: Application to environmental problems , 2011 .

[96]  David E. Goldberg,et al.  Multiobjective Estimation of Distribution Algorithms , 2006, Scalable Optimization via Probabilistic Modeling.

[97]  Concha Bielza,et al.  Mateda-2.0: Estimation of Distribution Algorithms in MATLAB , 2010 .

[98]  Pedro Larrañaga,et al.  Towards a New Evolutionary Computation - Advances in the Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[99]  Dirk Thierens,et al.  Multi-objective optimization with diversity preserving mixture-based iterated density estimation evolutionary algorithms , 2002, Int. J. Approx. Reason..

[100]  Martin Pelikan,et al.  Bayesian Optimization Algorithm , 2005 .

[101]  Kiyoshi Tanaka,et al.  A study on the effects of rankings sensitive to density on many-objective MNK Landscapes , 2010, IEEE Congress on Evolutionary Computation.

[102]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[103]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[104]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[105]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[106]  Concha Bielza,et al.  Mateda-2.0: A MATLAB package for the implementation and analysis of estimation of distribution algorithms , 2010 .

[107]  Harold Soh,et al.  moPGA: Towards a New Generation of Multi-objective Genetic Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[108]  David E. Goldberg,et al.  Multiobjective hBOA, clustering, and scalability , 2005, GECCO '05.

[109]  David E. Goldberg,et al.  Multiple-objective Bayesian Optimization Algorithm , 2002, GECCO.

[110]  Qingfu Zhang,et al.  Hybrid Estimation of Distribution Algorithm for Multiobjective Knapsack Problem , 2004, EvoCOP.