Comparing Particle Swarm Optimisation and Genetic Algorithms for Nonlinear Mapping

Reducing the dimensionality of high-dimensional data simplifies how data is presented, allowing easier visualisation of high-dimensional data and facilitating more efficient extraction of knowledge. Nonlinear mapping methods transform data existing in high-dimensional space into a lower-dimensional space such that the topological characteristics of the high-dimensional data are preserved. Recent work proposed a particle swarm optimisation algorithm to perform nonlinear mapping. This paper compares a number of optimisation algorithms in performing nonlinear mapping. Experimental results distinguish between each of the optimisation algorithms. Nonlinear mapping methods were designed to map small datasets and are unable to project new data points. A proposed method to perform nonlinear mapping on large datasets is discussed.

[1]  D. Agrafiotis,et al.  Nonlinear mapping of massive data sets by fuzzy clustering and neural networks , 2001 .

[2]  Andries Petrus Engelbrecht,et al.  Using neighbourhoods with the guaranteed convergence PSO , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[3]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[4]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Amaury Lendasse,et al.  A robust nonlinear projection method , 2000 .

[6]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[7]  N. Franken,et al.  Nonlinear mapping using particle swarm optimisation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[9]  Cheng-Yan Kao,et al.  A Genetic Algorithm with Adaptive Mutations and Family Competition for Training Neural Networks , 2000, Int. J. Neural Syst..

[10]  Anil K. Jain,et al.  A nonlinear projection method based on Kohonen's topology preserving maps , 1995, IEEE Trans. Neural Networks.

[11]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[12]  George Karypis,et al.  A Comparison of Document Clustering Techniques , 2000 .

[13]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[14]  J. Kruskal.  Nonmetric multidimensional scaling: A numerical method , 1964 .

[15]  Michael E. Tipping.  Topographic mappings and feed-forward neural networks , 1996 .

[16]  Its'hak Dinstein,et al.  Feature extraction by neural network nonlinear mapping for pattern classification , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[17]  Ravi Kothari,et al.  Face recognition using curvilinear component analysis , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[18]  Multivariate classification based on metal contents in human senile cataract lenses , 1991 .

[19]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[20]  Yang Li,et al.  Nonlinear mapping using real-valued genetic algorithm , 1999 .

[21]  Jeanny Hérault,et al.  Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets , 1997, IEEE Trans. Neural Networks.

[22]  Carlos A. Coello Coello,et al.  On the use of particle swarm optimization with multimodal functions , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[23]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[24]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[25]  Xin Yao,et al.  Fast Evolutionary Programming , 1996, Evolutionary Programming.