Recent Advances in Evolutionary Computation

Evolutionary computation has experienced a tremendous growth in the last decade in both theoretical analyses and industrial applications. Its scope has evolved beyond its original meaning of “biological evolution” toward a wide variety of nature inspired computational algorithms and techniques, including evolutionary, neural, ecological, social and economical computation, etc., in a unified framework. Many research topics in evolutionary computation nowadays are not necessarily “evolutionary”. This paper provides an overview of some recent advances in evolutionary computation that have been made in CERCIA at the University of Birmingham, UK. It covers a wide range of topics in optimization, learning and design using evolutionary approaches and techniques, and theoretical results in the computational time complexity of evolutionary algorithms. Some issues related to future development of evolutionary computation are also discussed.

[1]  Alex Fraser,et al.  Simulation of Genetic Systems by Automatic Digital Computers I. Introduction , 1957 .

[2]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  Marius Iosifescu,et al.  Finite Markov Processes and Their Applications , 1981 .

[5]  Hans-Paul Schwefel,et al.  Numerical optimization of computer models , 1981 .

[6]  A. Colman Game theory and experimental games , 1982 .

[7]  B. Hajek Hitting-time and occupation-time bounds implied by drift analysis with applications , 1982, Advances in Applied Probability.

[8]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[9]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[10]  Kenneth A. De Jong,et al.  Genetic algorithms: A 10 Year Perspective , 1985, ICGA.

[11]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[12]  H. Szu Fast simulated annealing , 1987 .

[13]  Bruce E. Hajek,et al.  The time complexity of maximum matching by simulated annealing , 1988, JACM.

[14]  L. Ingber Very fast simulated re-annealing , 1989 .

[15]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  D. Fogel System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling , 1991 .

[17]  Michael I. Jordan,et al.  Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks , 1990, Cogn. Sci..

[18]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[19]  P. Albin Approximations of cooperative equilibria in multi-person Prisoners' dilemma played by cellular automata , 1992 .

[20]  Thomas Bäck,et al.  The Interaction of Mutation Rate, Selection, and Self-Adaptation Within a Genetic Algorithm , 1992, PPSN.

[21]  R. Syski Passage Times for Markov Chains , 1992 .

[22]  D. Fogel Applying evolutionary programming to selected traveling salesman problems , 1993 .

[23]  Thomas Bäck,et al.  An Overview of Evolutionary Computation , 1993, ECML.

[24]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[25]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[26]  C. H. Edwards,et al.  Calculus with analytic geometry , 1994 .

[27]  Harris Drucker,et al.  Boosting and Other Ensemble Methods , 1994, Neural Computation.

[28]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[29]  Xin Yao,et al.  An Experimental Study of N-Person Iterated Prisoner's Dilemma Games , 1993, Informatica.

[30]  B. Huberman,et al.  THE DYNAMICS OF SOCIAL DILEMMAS , 1994 .

[31]  Roger L. Wainwright,et al.  Terminal assignment in a communications network using genetic algorithms , 1994, CSC '94.

[32]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[33]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[34]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[35]  Xin Yao,et al.  A new simulated annealing algorithm , 1995, Int. J. Comput. Math..

[36]  X. Yao Evolutionary stability in the n-person iterated prisoner's dilemma. , 1996, Bio Systems.

[37]  Günter Rudolph,et al.  How Mutation and Selection Solve Long-Path Problems in Polynomial Expected Time , 1996, Evolutionary Computation.

[38]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[39]  D. Fogel,et al.  Evolving continuous behaviors in the Iterated Prisoner's Dilemma. , 1996, Bio Systems.

[40]  Marcus Frean The evolution of degrees of cooperation. , 1996, Journal of theoretical biology.

[41]  Sami Khuri,et al.  Heuristic algorithms for the terminal assignment problem , 1997, SAC '97.

[42]  Xin Yao,et al.  Fast Evolution Strategies , 1997, Evolutionary Programming.

[43]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[44]  Xin Yao,et al.  PEPNet: Parallel Evolutionary Programming for Constructing Artificial Neural Networks , 1997, Evolutionary Programming.

[45]  David B. Fogel,et al.  The Advantages of Evolutionary Computation , 1997, BCEC.

[46]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[47]  Xin Yao,et al.  Towards Designing Neural Network Ensembles by Evolution , 1998, PPSN.

[48]  I. Wegener,et al.  A rigorous complexity analysis of the (1+1) evolutionary algorithm for linear functions with Boolean inputs , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[49]  Günter Rudolph,et al.  Finite Markov Chain Results in Evolutionary Computation: A Tour d'Horizon , 1998, Fundam. Informaticae.

[50]  Ingo Wegener,et al.  A Rigorous Complexity Analysis of the (1 + 1) Evolutionary Algorithm for Separable Functions with Boolean Inputs , 1998, Evolutionary Computation.

[51]  Xin Yao,et al.  Making use of population information in evolutionary artificial neural networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[52]  Günter Rudolph,et al.  Theory of Evolutionary Algorithms: A Bird's Eye View , 1999, Theor. Comput. Sci..

[53]  Enrique Alba,et al.  A survey of parallel distributed genetic algorithms , 1999 .

[54]  Sung-Bae Cho,et al.  Emergence of cooperative coalition in NIPD game with localization of interaction and learning , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[55]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[56]  Xin Yao,et al.  Simultaneous training of negatively correlated neural networks in an ensemble , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[57]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[58]  Marc Schoenauer,et al.  Rigorous Hitting Times for Binary Mutations , 1999, Evolutionary Computation.

[59]  Thomas Bäck,et al.  Evolutionary Algorithms: The Role of Mutation and Recombination , 2000 .

[60]  Josselin Garnier,et al.  Statistical distribution of the convergence time of evolutionary algorithms for long-path problems , 2000, IEEE Trans. Evol. Comput..

[61]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..

[62]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[63]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[64]  Erick Cantú-Paz,et al.  A Survey of Parallel Genetic Algorithms , 2000 .

[65]  Sung-Bae Cho,et al.  The Impact of Payoff Function and Local Interaction on the N-Player Iterated Prisoner's Dilemma , 2000, Knowledge and Information Systems.

[66]  Hussein A. Abbass,et al.  A Memetic Pareto Evolutionary Approach to Artificial Neural Networks , 2001, Australian Joint Conference on Artificial Intelligence.

[67]  Marco Laumanns,et al.  Scalable test problems for evolutionary multi-objective optimization , 2001 .

[68]  Xin Yao,et al.  Evolutionary Design Calibration , 2001, ICES.

[69]  Xin Yao,et al.  An evolutionary approach to materialized views selection in a data warehouse environment , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[70]  Xin Yao,et al.  Drift analysis and average time complexity of evolutionary algorithms , 2001, Artif. Intell..

[71]  Xin Yao,et al.  Digital filter design using multiple pareto fronts , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[72]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[73]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[74]  Xin Yao,et al.  Co-Evolution in Iterated Prisoner's Dilemma with Intermediate Levels of Cooperation: Application to Missile Defense , 2002, Int. J. Comput. Intell. Appl..

[75]  Xin Yao,et al.  From an individual to a population: an analysis of the first hitting time of population-based evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[76]  B. Li,et al.  A novel evolutionary algorithmfor determ ining uni"ed creep damage constitutive equations , 2002 .

[77]  Jianguo Lin,et al.  Universal multi-objective function for optimising superplastic-damage constitutive equations , 2002 .

[78]  Xin Yao,et al.  Evolving SQL Queries for Data Mining , 2002, IDEAL.

[79]  Xin Yao,et al.  Learning and Evolution by Minimization of Mutual Information , 2002, PPSN.

[80]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[81]  Yong Xu,et al.  Traffic grooming in unidirectional WDM ring networks using genetic algorithms , 2002, Comput. Commun..

[82]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[83]  Hans-Paul Schwefel,et al.  How to analyse evolutionary algorithms , 2002, Theor. Comput. Sci..

[84]  Xin Yao,et al.  A constructive algorithm for training cooperative neural network ensembles , 2003, IEEE Trans. Neural Networks.

[85]  Xin Yao,et al.  Materialized view selection as constrained evolutionary optimization , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[86]  X. Yao,et al.  An analysis of evolutionary algorithms for finding approximation solutions to hard optimisation problems , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[87]  Xin Yao,et al.  A novel evolutionary data mining algorithm with applications to churn prediction , 2003, IEEE Trans. Evol. Comput..

[88]  Huaglory Tianfield,et al.  On the Architectures of Complex Multi-Agent Systems , 2003 .

[89]  Yong Xu,et al.  Strictly nonblocking grooming of dynamic traffic in unidirectional SONET/WDM rings using genetic algorithms , 2003, Comput. Networks.

[90]  Xin Yao,et al.  Dual population-based incremental learning for problem optimization in dynamic environments , 2003 .

[91]  X. Yao,et al.  Evolutionary search and constraint violations , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[92]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[93]  Xin Yao,et al.  Using Negative Correlation to Evolve Fault-Tolerant Circuits , 2003, ICES.

[94]  Xin Yao,et al.  Towards an analytic framework for analysing the computation time of evolutionary algorithms , 2003, Artif. Intell..

[95]  Xin Yao,et al.  Lower bound on number of ADMs in WDM rings with nonuniform traffic demands , 2004 .

[96]  Xin Yao,et al.  The impact of noise on iterated prisoner's dilemma with multiple levels of cooperation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[97]  Xin Yao,et al.  Nonlinear Feature Extraction Using Evolutionary Algorithm , 2004, ICONIP.

[98]  Lee Chapman,et al.  Real-Time Sky-View Factor Calculation and Approximation , 2004 .

[99]  Yoshiyuki Matsumura,et al.  Near-Optimal Dynamic Grid Task Scheduling of Evolution Strategies(Strategic Soft Computing 2,Session: MP1-C) , 2004 .

[100]  Xin Yao,et al.  Generalized LDA using relevance weighting and evolution strategy , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[101]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[102]  Yong Xu,et al.  A new approach to improving the grooming performance with dynamic traffic in SONET rings , 2004, Comput. Networks.

[103]  Xin Yao,et al.  Parallel evolutionary programming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[104]  Xin Yao,et al.  DIVACE: Diverse and Accurate Ensemble Learning Algorithm , 2004, IDEAL.

[105]  Zhi Zhou,et al.  A novel memetic algorithm with random multi-local-search: a case study of TSP , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[106]  Xin Yao,et al.  An Improved Constructive Neural Network Ensemble Approach to Medical Diagnoses , 2004, IDEAL.

[107]  Xin Yao,et al.  A study of drift analysis for estimating computation time of evolutionary algorithms , 2004, Natural Computing.

[108]  Xin Yao,et al.  Non-standard cost terminal assignment problems using tabu search approach , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[109]  Xin Yao,et al.  A hybrid Hopfield network-genetic algorithm approach for the terminal assignment problem , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[110]  Xin Yao,et al.  An Evolutionary Approach to Modeling Radial Brightness Distributions in Elliptical Galaxies , 2004, PPSN.

[111]  Xin Yao,et al.  Evolving Neural Network Ensembles by Minimization of Mutual Information , 2004, Int. J. Hybrid Intell. Syst..

[112]  Ali Akbar Jamali,et al.  Inverse modelling of multi-objective thermodynamically optimized turbojet engines using GMDH-type neural networks and evolutionary algorithms , 2005 .

[113]  Xin Yao,et al.  Evolutionary framework for the construction of diverse hybrid ensembles , 2005, ESANN.

[114]  Xin Yao,et al.  Meta-Heuristic Algorithms for FPGA Segmented Channel Routing Problems with Non-standard Cost Functions , 2005, Genetic Programming and Evolvable Machines.

[115]  Jin Li,et al.  The application of evolutionary computation to the analysis of the profiles of elliptical galaxies: a maximum likelihood approach , 2005, 2005 IEEE Congress on Evolutionary Computation.

[116]  Yong Xu,et al.  Combining GA with Splitting Methods for Rearrangeably Nonblocking Grooming of Dynamic Traffic in SONET Ring Networks , 2005, Photonic Network Communications.

[117]  Xin Yao,et al.  A Game-Theoretic Approach for Designing Mixed Mutation Strategies , 2005, ICNC.

[118]  Xin Yao,et al.  Search biases in constrained evolutionary optimization , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[119]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[120]  Xin Yao,et al.  Dynamic salting route optimisation using evolutionary computation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[121]  Xin Yao,et al.  Linear dimensionality reduction using relevance weighted LDA , 2005, Pattern Recognit..

[122]  Xin Yao,et al.  Clustering and learning Gaussian distribution for continuous optimization , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[123]  Xin Yao,et al.  Thermodynamic Pareto optimization of turbojet engines using multi-objective genetic algorithms , 2005 .

[124]  Xin Yao,et al.  Experimental study on population-based incremental learning algorithms for dynamic optimization problems , 2005, Soft Comput..

[125]  Xin Yao,et al.  Metaheuristic Approaches to Traffic Grooming in Wdm Optical Networks , 2005, Int. J. Comput. Intell. Appl..

[126]  Xin Yao,et al.  An evolutionary clustering algorithm for gene expression microarray data analysis , 2006, IEEE Transactions on Evolutionary Computation.

[127]  David B. Fogel,et al.  Evolutionary Computation: Toward a New Philosophy of Machine Intelligence (IEEE Press Series on Computational Intelligence) , 2006 .

[128]  Xin Yao,et al.  Evolving hybrid ensembles of learning machines for better generalisation , 2006, Neurocomputing.

[129]  Xin Yao,et al.  Ensemble Learning Using Multi-Objective Evolutionary Algorithms , 2006, J. Math. Model. Algorithms.