Particle Swarm Optimization for Pattern Recognition and Image Processing

Summary. Pattern recognition has as its objective to classify objects into different categories and classes. It is a fundamental component of artificial intelligence and computer vision. This chapter investigates the application of an efficient optimization method, known as Particle Swarm Optimization (PSO), to the field of pattern recognition and image processing. First a clustering method that is based on PSO is discussed. The application of the proposed clustering algorithm to the problem of unsupervised classification and segmentation of images is investigated. Then PSObased approaches that tackle the color image quantization and spectral unmixing problems are discussed.

[1]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[2]  Zhigang Xiang,et al.  Color image quantization by minimizing the maximum intercluster distance , 1997, TOGS.

[3]  Nicolas Monmarché,et al.  A new clustering algorithm based on the chemical recognition system of ants , 2002 .

[4]  Andries P. Engelbrecht,et al.  Image Classification using Particle Swarm Optimization , 2002, SEAL.

[5]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[6]  Claudio Carpineto,et al.  A Lattice Conceptual Clustering System and Its Application to Browsing Retrieval , 1996, Machine Learning.

[7]  Luc Brun,et al.  Comparison and optimization of methods of color image quantization , 1997, IEEE Trans. Image Process..

[8]  Yee Leung,et al.  Clustering by Scale-Space Filtering , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  G H Ball,et al.  A clustering technique for summarizing multivariate data. , 1967, Behavioral science.

[10]  Paul Scheunders,et al.  A genetic c-Means clustering algorithm applied to color image quantization , 1997, Pattern Recognit..

[11]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization method for image clustering , 2005, Int. J. Pattern Recognit. Artif. Intell..

[12]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[13]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[14]  Erik K. Antonsson,et al.  Dynamic partitional clustering using evolution strategies , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[15]  Fabio Maselli,et al.  Multiclass spectral decomposition of remotely sensed scenes by selective pixel unmixing , 1998, IEEE Trans. Geosci. Remote. Sens..

[16]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[17]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[19]  Gregory Joy,et al.  Color image quantization by agglomerative clustering , 1994, IEEE Computer Graphics and Applications.

[20]  Brian Everitt,et al.  Cluster analysis , 1974 .

[21]  Baldo Faieta,et al.  Diversity and adaptation in populations of clustering ants , 1994 .

[22]  Steven A. Shafer,et al.  Color vision , 1992 .

[23]  James M. Keller,et al.  The possibilistic C-means algorithm: insights and recommendations , 1996, IEEE Trans. Fuzzy Syst..

[24]  Sandra Paterlini,et al.  Differential evolution and particle swarm optimisation in partitional clustering , 2006, Comput. Stat. Data Anal..

[25]  Bernd Freisleben,et al.  An evolutionary approach to color image quantization , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[26]  James C. Bezdek,et al.  A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Anil K. Jain,et al.  Large-Scale Parallel Data Clustering , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Olli Nevalainen,et al.  A new iterative algorithm for VQ codebook generation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[29]  Alan D. Christiansen,et al.  An empirical study of evolutionary techniques for multiobjective optimization in engineering design , 1996 .

[30]  F. Klawonn,et al.  Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition , 1999 .

[31]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[32]  Andrew G. Tescher,et al.  Class-prioritized compression of multispectral imagery data , 2002, J. Electronic Imaging.

[33]  Greg Hamerly,et al.  Alternatives to the k-means algorithm that find better clusterings , 2002, CIKM '02.

[34]  Russell C. Eberhart,et al.  Gene clustering using self-organizing maps and particle swarm optimization , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[36]  Hazem M. Abbas,et al.  Neural networks for maximum likelihood clustering , 1994, Signal Process..

[37]  Koeng-Mo Sung,et al.  Fast clustering algorithm for vector quantisation , 1998 .

[38]  Andries Petrus Engelbrecht,et al.  Data clustering using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[39]  Shi Zhongzhi,et al.  A clustering algorithm based on swarm intelligence , 2001, 2001 International Conferences on Info-Tech and Info-Net. Proceedings (Cat. No.01EX479).

[40]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[41]  Andrew G. Tescher,et al.  Viable end-member selection scheme for spectral unmixing of multispectral satellite imagery data , 1999, Optics & Photonics.

[42]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[43]  Alan Wee-Chung Liew,et al.  Fuzzy image clustering incorporating spatial continuity , 2000 .

[44]  Luiz Velho,et al.  Color image quantization by pairwise clustering , 1997, Proceedings X Brazilian Symposium on Computer Graphics and Image Processing.

[45]  Jonathan E. Fieldsend,et al.  A Multi-Objective Algorithm based upon Particle Swarm Optimisation, an Efficient Data Structure and , 2002 .

[46]  Hichem Frigui,et al.  A Robust Competitive Clustering Algorithm With Applications in Computer Vision , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Anthony H. Dekker,et al.  Kohonen neural networks for optimal colour quantization , 1994 .

[48]  E. Forgy Cluster analysis of multivariate data : efficiency versus interpretability of classifications , 1965 .

[49]  G.B. Coleman,et al.  Image segmentation by clustering , 1979, Proceedings of the IEEE.

[50]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[51]  Thambipillai Srikanthan,et al.  On the initialization and training methods for Kohonen self-organizing feature maps in color image quantization , 2002, Proceedings First IEEE International Workshop on Electronic Design, Test and Applications '2002.

[52]  Bin Zhang,et al.  Genera lized K- Harmonic Means - - Boosting in Unsupervised Learnin g , 2000 .

[53]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[54]  Cor J. Veenman,et al.  A cellular coevolutionary algorithm for image segmentation , 2003, IEEE Trans. Image Process..

[55]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[56]  Mehmet Celenk,et al.  A color clustering technique for image segmentation , 1990, Comput. Vis. Graph. Image Process..

[57]  Abhijit S. Pandya,et al.  Pattern Recognition with Neural Networks in C++ , 1995 .

[58]  Kaizhong Zhang,et al.  A better tree-structured vector quantizer , 1991, [1991] Proceedings. Data Compression Conference.

[59]  Russell C. Eberhart,et al.  Adaptive particle swarm optimization: detection and response to dynamic systems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).