Real-Coded Extended Compact Genetic Algorithm Based on Mixtures of Models

This paper presents a real-coded estimation distribution algorithm (EDA) inspired to the extended compact genetic algorithm (ECGA) and the real-coded Bayesian Optimization Algorithm (rBOA). Like ECGA, the proposed algorithm partitions the problem variables into a set of clusters that are manipulated as independent variables and estimates the population distribution using marginal product models (MPMs); like rBOA, it employs finite mixtures of models and it does not use any sort of discretization. Accordingly, the proposed real-coded EDA can be either viewed as the extension of the ECGA to real-valued domains by means of finite mixture models or as a simplification of the real-coded BOA to the marginal product models (MPMs). The results reported here show that the number of evaluations required by the proposed algorithm scales sub-quadratically with the problem size in additively separable problems.

[1]  Erick Cantú-Paz,et al.  Feature Subset Selection by Estimation of Distribution Algorithms , 2002, GECCO.

[2]  G. Harik.  Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[3]  David E. Goldberg,et al.  Real-coded ECGA for solving decomposable real-valued optimization problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[4]  Vincent Kanade,et al.  Clustering Algorithms , 2021, Wireless RF Energy Transfer in the Massive IoT Era.

[5]  Pedro Larrañaga,et al.  Towards a New Evolutionary Computation - Advances in the Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[6]  Martin Pelikan,et al.  Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications (Studies in Computational Intelligence) , 2006 .

[7]  David E. Goldberg,et al.  A Simple Real-Coded Extended Compact Genetic Algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[8]  Franz Rothlauf,et al.  Evaluation-Relaxation Schemes for Genetic and Evolutionary Algorithms , 2004 .

[9]  David E. Goldberg,et al.  Getting the best of both worlds: Discrete and continuous genetic and evolutionary algorithms in concert , 2003, Inf. Sci..

[10]  Martin Pelikan,et al.  Scalable Optimization via Probabilistic Modeling , 2006, Studies in Computational Intelligence.

[11]  Riccardo Poli,et al.  Genetic and Evolutionary Computation – GECCO 2004 , 2004, Lecture Notes in Computer Science.

[12]  David E. Goldberg,et al.  Linkage Problem, Distribution Estimation, and Bayesian Networks , 2000, Evolutionary Computation.

[13]  Terence Soule,et al.  Genetic Programming: Theory and Practice , 2003 .

[14]  Chao-Hong Chen,et al.  Adaptive discretization for probabilistic model building genetic algorithms , 2006, GECCO '06.

[15]  Thomas Bäck,et al.  Parallel Problem Solving from Nature — PPSN V , 1998, Lecture Notes in Computer Science.

[16]  Chao-Hong Chen,et al.  Real-coded ECGA for economic dispatch , 2007, GECCO '07.

[17]  David E. Goldberg,et al.  Simplex crossover and linkage identification: single-stage evolution vs. multi-stage evolution , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[18]  David E. Goldberg,et al.  Real-Coded Bayesian Optimization Algorithm: Bringing the Strength of BOA into the Continuous World , 2004, GECCO.

[19]  María Cristina Riff,et al.  Towards an immune system that solves CSP , 2007, 2007 IEEE Congress on Evolutionary Computation.

[20]  Petr Posík.  Estimation of Distribution Algorithms , 2006 .

[21]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[22]  David E. Goldberg,et al.  Combining The Strengths Of Bayesian Optimization Algorithm And Adaptive Evolution Strategies , 2002, GECCO.

[23]  Chang Wook Ahn,et al.  Advances in Evolutionary Algorithms: Theory, Design and Practice , 2006, Studies in Computational Intelligence.

[24]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[25]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[26]  Masayuki Yamamura,et al.  Theoretical Analysis of Simplex Crossover for Real-Coded Genetic Algorithms , 2000, PPSN.

[27]  Peter A. N. Bosman,et al.  Design and Application of iterated Density-Estimation Evolutionary Algorithms , 2003 .

[28]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[29]  Chang Wook Ahn,et al.  On the Scalability of Real-Coded Bayesian Optimization Algorithm , 2008, IEEE Transactions on Evolutionary Computation.

[30]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[31]  Michèle Sebag,et al.  Extending Population-Based Incremental Learning to Continuous Search Spaces , 1998, PPSN.

[32]  Fernando G. Lobo,et al.  Extended Compact Genetic Algorithm in C , 1999 .

[33]  Peter A. N. Bosman,et al.  Convergence phases, variance trajectories, and runtime analysis of continuous EDAs , 2007, GECCO '07.

[34]  D. Goldberg,et al.  Probabilistic Model Building and Competent Genetic Programming , 2003 .

[35]  Kumara Sastry,et al.  Linkage Learning via Probabilistic Modeling in the Extended Compact Genetic Algorithm (ECGA) , 2006, Scalable Optimization via Probabilistic Modeling.

[36]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .