Bivariate empirical and n-variate Archimedean copulas in estimation of distribution algorithms

This paper investigates the use of empirical and Archimedean copulas as probabilistic models of continuous estimation of distribution algorithms (EDAs). A method for learning and sampling empirical bivariate copulas to be used in the context of n-dimensional EDAs is first introduced. Then, by using Archimedean copulas instead of empirical makes possible to construct n-dimensional copulas with the same purpose. Both copula-based EDAs are compared to other known continuous EDAs on a set of 24 functions and different number of variables. Experimental results show that the proposed copula-based EDAs achieve a better behaviour than previous approaches in a 20% of the benchmark functions.

[1]  Nozer D. Singpurwalla,et al.  Specifying interdependence in networked systems , 2004, IEEE Transactions on Reliability.

[2]  Concha Bielza,et al.  Mateda-2.0: A MATLAB package for the implementation and analysis of estimation of distribution algorithms , 2010 .

[3]  Jianchao Zeng,et al.  Estimation of Distribution Algorithm based on copula theory , 2009, 2009 IEEE Congress on Evolutionary Computation.

[4]  Christian Genest,et al.  Estimating copula densities through wavelets , 2009 .

[5]  M. Sklar.  Fonctions de repartition a n dimensions et leurs marges , 1959 .

[6]  N. Allinson,et al.  Population optimization algorithm based on ICA , 2000, 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks. Proceedings of the First IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks (Cat. No.00.

[7]  Concha Bielza,et al.  A review of estimation of distribution algorithms in bioinformatics , 2008, BioData Mining.

[8]  P. Embrechts,et al.  Chapter 8 – Modelling Dependence with Copulas and Applications to Risk Management , 2003 .

[9]  Arturo Hernández Aguirre,et al.  Using Copulas in Estimation of Distribution Algorithms , 2009, MICAI.

[10]  Petros Koumoutsakos,et al.  Learning Probability Distributions in Continuous Evolutionary Algorithms - a Comparative Review , 2004, Nat. Comput..

[11]  R. Nelsen.  An Introduction to Copulas , 1998 .

[12]  Anne Auger,et al.  EEDA : A New Robust Estimation of Distribution Algorithms , 2004 .

[13]  Petr Poÿ ´ õk.  On the Use of Probabilistic Models and Coordinate Transforms in Real-Valued Evolutionary Algorithms , 2007 .

[14]  Pedro Larrañaga,et al.  Towards a New Evolutionary Computation - Advances in the Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[15]  Andrew J. Patton.  Copula-Based Models for Financial Time Series , 2009 .

[16]  Raymond Ros,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup , 2009 .

[17]  Nicolas Brunel,et al.  Unsupervised signal restoration using hidden Markov chains with copulas , 2005, Signal Process..

[18]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[19]  Jianchao Zeng,et al.  Estimation of distribution algorithm based on archimedean copulas , 2009, GEC '09.

[20]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[21]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[22]  Emiliano A. Valdez,et al.  Understanding Relationships Using Copulas , 1998 .

[23]  Byoung-Tak Zhang,et al.  Evolutionary Continuous Optimization by Distribution Estimation with Variational Bayesian Independent Component Analyzers Mixture Model , 2004, PPSN.

[24]  C. Genest,et al.  Statistical Inference Procedures for Bivariate Archimedean Copulas , 1993 .

[25]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[26]  A. McNeil.  Sampling nested Archimedean copulas , 2008 .

[27]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[28]  Petr Posík,et al.  BBOB-benchmarking a simple estimation of distribution algorithm with cauchy distribution , 2009, GECCO '09.

[29]  D. Goldberg,et al.  Evolutionary Algorithm Using Marginal Histogram Models in Continuous Domain , 2007 .