Swarm Intelligence Based Optimization

This paper proposes a dynamic data clustering algorithm, called PSOFC, in which Particle Swarm Optimization (PSO) is combined with the fuzzy c-means (FCM) clustering method to find the number of clusters and cluster centers concurrently. Fuzzy c-means can be applied to data clustering problems but the number of clusters must be given in advance. This paper tries to overcome this shortcoming. In the evolutionary process of PSOFC, a discrete PSO is used to search for the best number of clusters. With a specified number of cluster, each particle employs FCM to refine cluster centers for data clustering. Thus PSOFC can automatically determine the best number of clusters during the data clustering process. Six datasets were used to evaluate the proposed algorithm. Experimental results demonstrated that PSOFC is an effective algorithm for solving dynamic fuzzy clustering problems.

[1]  Chee-Kit Looi,et al.  Neural network methods in combinatorial optimization , 1992, Comput. Oper. Res..

[2]  Carsten Peterson,et al.  Airline Crew Scheduling with Potts Neurons , 1997, Neural Computation.

[3]  Alex A. Freitas,et al.  Data Parallelism, Control Parallelism, and Related Issues , 2000 .

[4]  Martín Pedemonte,et al.  A survey on parallel ant colony optimization , 2011, Appl. Soft Comput..

[5]  Tomoyuki Hiroyasu,et al.  Visualization of Pareto Solutions by Spherical Self-Organizing Map and It's Acceleration on a GPU , 2012 .

[6]  Bernard Manderick,et al.  Fine-Grained Parallel Genetic Algorithms , 1989, ICGA.

[7]  Andrew Lewis,et al.  A Parallel Implementation of Ant Colony Optimization , 2002, J. Parallel Distributed Comput..

[8]  Teodor Gabriel Crainic,et al.  Parallel Meta-Heuristics , 2010 .

[9]  Giandomenico Spezzano,et al.  A scalable cellular implementation of parallel genetic programming , 2003, IEEE Trans. Evol. Comput..

[10]  Thomas Stützle,et al.  Parallelization Strategies for Ant Colony Optimization , 1998, PPSN.

[11]  Ximing Li,et al.  MAX-MIN Ant System on GPU with CUDA , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[12]  Bruce W. Weide,et al.  Optimal Expected-Time Algorithms for Closest Point Problems , 1980, TOMS.

[13]  Dana S. Richards,et al.  Punctuated Equilibria: A Parallel Genetic Algorithm , 1987, ICGA.

[14]  Martín Pedemonte,et al.  A cellular ant colony optimisation for the generalised Steiner problem , 2010 .

[15]  Jean-Charles Créput,et al.  A Massive Parallel Cellular GPU Implementation of Neural Network to Large Scale Euclidean TSP , 2013, MICAI.

[16]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[17]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[18]  Teuvo Kohonen,et al.  Self-Organizing Maps, Third Edition , 2001, Springer Series in Information Sciences.

[19]  Abder Koukam,et al.  A memetic neural network for the Euclidean traveling salesman problem , 2009, Neurocomputing.

[20]  Teodor Gabriel Crainic,et al.  Parallel Strategies for Meta-Heuristics , 2003, Handbook of Metaheuristics.

[21]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[22]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[23]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[24]  Richard Hurley,et al.  Scalability of Self-organizing Maps on a GPU cluster using OpenCL and CUDA , 2012 .

[25]  Kotaro Hirasawa,et al.  Solving inequality constrained combinatorial optimization problems by the hopfield neural networks , 1992, Neural Networks.

[26]  El-Ghazali Talbi,et al.  GPU Computing for Parallel Local Search Metaheuristic Algorithms , 2013, IEEE Transactions on Computers.

[27]  Tao Li,et al.  Design of Competition-Based Neural Networks for Combinatorial Optimization , 1990, Int. J. Neural Syst..

[28]  Zdenek Konfrst,et al.  Parallel genetic algorithms: advances, computing trends, applications and perspectives , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[29]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[30]  Nirwan Ansari,et al.  A new method to optimize the satellite broadcasting schedules using the mean field annealing of a Hopfield neural network , 1995, IEEE Trans. Neural Networks.

[31]  John R. Koza,et al.  Parallel genetic programming: a scalable implementation using the transputer network architecture , 1996 .