A Review of Applications of Evolutionary Algorithms in Pattern Recognition

This chapter presents a review of some of the most representative work regarding techniques and applications of evolutionary algorithms in pattern recognition. Evolutionary algorithms are a set of metaheuristics inspired on Darwins “survival of the fittest” principle which are stochastic in nature. Evolutionary algorithms present several advantages over traditional search and classification techniques, since they require less domain-specific information, are easy to use and operate on a set of solutions (the so-called population). Such advantages have made them very popular within pattern recognition (as well as in other domains) as will be seen in the review of applications presented in this chapter.

[1]  Anne Brindle,et al.  Genetic algorithms for function optimization , 1980 .

[2]  Franz Rothlauf,et al.  Representations for genetic and evolutionary algorithms , 2002, Studies in Fuzziness and Soft Computing.

[3]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[4]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[5]  Robert Sabourin,et al.  Solution over-Fit Control in Evolutionary Multiobjective Optimization of Pattern Classification Systems , 2009, Int. J. Pattern Recognit. Artif. Intell..

[6]  John R. Koza,et al.  Genetic Programming III: Darwinian Invention & Problem Solving , 1999 .

[7]  Ujjwal Maulik,et al.  Genetic algorithm-based clustering technique , 2000, Pattern Recognit..

[8]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[9]  Pablo Moscato,et al.  Memetic algorithms: a short introduction , 1999 .

[10]  Victor J. Rayward-Smith,et al.  The application and effectiveness of a multi-objective metaheuristic algorithm for partial classification , 2006, Eur. J. Oper. Res..

[11]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[12]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[13]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[14]  Sushmita Mitra,et al.  Evolutionary Biclustering with Correlation for Gene Interaction Networks , 2007, PReMI.

[15]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[16]  Wei Wang,et al.  Improved pattern recognition with complex artificial immune system , 2009, Soft Comput..

[17]  Pierre Hansen,et al.  NP-hardness of Euclidean sum-of-squares clustering , 2008, Machine Learning.

[18]  John R. Koza,et al.  Genetic Programming III - Darwinian Invention and Problem Solving , 1999, Evolutionary Computation.

[19]  Mengjie Zhang,et al.  Overview of Object Detection and Image Analysis by Means of Genetic Programming Techniques , 2007, 2007 Frontiers in the Convergence of Bioscience and Information Technologies.

[20]  Toshihide Ibaraki,et al.  Metaheuristics : progress as real problem solvers , 2005 .

[21]  Luis Gerardo de la Fraga,et al.  Robust fitting of ellipses with heuristics , 2010, IEEE Congress on Evolutionary Computation.

[22]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[23]  Michael Creutz,et al.  Microcanonical Monte Carlo Simulation , 1983 .

[24]  Tianzi Jiang,et al.  An evolutionary tabu search for cell image segmentation , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[26]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[27]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[28]  Lashon B. Booker,et al.  Intelligent Behavior as an Adaptation to the Task Environment , 1982 .

[29]  Meena Mahajan,et al.  The planar k-means problem is NP-hard , 2009, Theor. Comput. Sci..

[30]  Carlos García-Martínez,et al.  Global and local real-coded genetic algorithms based on parent-centric crossover operators , 2008, Eur. J. Oper. Res..

[31]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[32]  Stefan Janaqi,et al.  Generalization of the strategies in differential evolution , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[33]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[34]  C. Reeves.  Modern heuristic techniques for combinatorial problems , 1993 .

[35]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  John H. Holland,et al.  Outline for a Logical Theory of Adaptive Systems , 1962, JACM.

[37]  J Griffith,et al.  A fast random cost algorithm for physical mapping. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Hans-Jürgen Warnecke,et al.  Least-squares orthogonal distances fitting of circle, sphere, ellipse, hyperbola, and parabola , 2001, Pattern Recognit..

[39]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[40]  Sanghamitra Bandyopadhyay,et al.  Multiobjective GAs, quantitative indices, and pattern classification , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  Donald O. Walter,et al.  Self-Organizing Systems , 1987, Life Science Monographs.

[42]  Hui Zhang,et al.  Image segmentation using evolutionary computation , 1999, IEEE Trans. Evol. Comput..

[43]  Hans-Paul Schwefel,et al.  Numerical optimization of computer models , 1981 .

[44]  K. Zielinski,et al.  Stopping Criteria for Differential Evolution in Constrained Single-Objective Optimization , 2008 .

[45]  G. Cowles.  Studies of Mascarene Island birds: The fossil record , 1987 .

[46]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[47]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[48]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[49]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[50]  Noboru Ohnishi,et al.  Transformation of redundant representations of linear genetic programming into canonical forms for efficient extraction of image features , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[51]  Victor J. Rayward-Smith,et al.  Developments on a Multi-objective Metaheuristic (MOMH) Algorithm for Finding Interesting Sets of Classification Rules , 2005, EMO.

[52]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[53]  S. N. Sivanandam,et al.  Introduction to genetic algorithms , 2007 .

[54]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[55]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[56]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Louis A. Tamburino,et al.  Evolving pattern recognition systems , 2002, IEEE Trans. Evol. Comput..

[58]  Israel Vite Silva,et al.  Euclidean Distance Fit of Conics Using Differential Evolution , 2009 .

[59]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[60]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[61]  Nawwaf N. Kharma,et al.  Evolving novel image features using Genetic Programming-based image transforms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[62]  Ujjwal Maulik,et al.  Genetic clustering for automatic evolution of clusters and application to image classification , 2002, Pattern Recognit..

[63]  James E. Baker,et al.  Adaptive Selection Methods for Genetic Algorithms , 1985, International Conference on Genetic Algorithms.

[64]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[65]  Julian Francis Miller,et al.  Cartesian genetic programming , 2000, GECCO '10.

[66]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[67]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[68]  Uday K. Chakraborty,et al.  Advances in Differential Evolution , 2010 .

[69]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[70]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[71]  John J. Grefenstette,et al.  How Genetic Algorithms Work: A Critical Look at Implicit Parallelism , 1989, ICGA.

[72]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[74]  Günter Rudolph,et al.  Convergence analysis of canonical genetic algorithms , 1994, IEEE Trans. Neural Networks.

[75]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[76]  D. Dasgupta.  Artificial Immune Systems and Their Applications , 1998, Springer Berlin Heidelberg.

[77]  Lawrence J. Fogel,et al.  Intelligence Through Simulated Evolution: Forty Years of Evolutionary Programming , 1999 .

[78]  Pedro Larrañaga,et al.  An empirical comparison of four initialization methods for the K-Means algorithm , 1999, Pattern Recognit. Lett..

[79]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[80]  Mukesh M. Raghuwanshi,et al.  Genetic Algorithm Based Clustering: A Survey , 2008, 2008 First International Conference on Emerging Trends in Engineering and Technology.

[81]  John R. Koza,et al.  Hierarchical Genetic Algorithms Operating on Populations of Computer Programs , 1989, IJCAI.

[82]  Leonardo Bocchi,et al.  A New Evolutionary Algorithm for Image Segmentation , 2005, EvoWorkshops.

[83]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[84]  Yves Lecourtier,et al.  A multi-model selection framework for unknown and/or evolutive misclassification cost problems , 2010, Pattern Recognit..

[85]  H. P. Schwefel,et al.  Numerische Optimierung von Computermodellen mittels der Evo-lutionsstrategie , 1977 .

[86]  Markus Brameier,et al.  On linear genetic programming , 2005 .

[87]  Nikhil R. Pal,et al.  Genetic programming for simultaneous feature selection and classifier design , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[88]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[89]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[90]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[91]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[92]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[93]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[94]  John J. Grefenstette,et al.  Genetic algorithms and their applications , 1987 .

[95]  Jianhong Wu,et al.  Data clustering - theory, algorithms, and applications , 2007 .

[96]  Nawwaf N. Kharma,et al.  An efficient image pattern recognition system using an evolutionary search strategy , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[97]  M. Narasimha Murty,et al.  Genetic K-means algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.