A Quantum-inspired Genetic Algorithm for Data Clustering

The conventional k-means clustering algorithm must know the number of clusters in advance and the clustering result is sensitive to the selection of the initial cluster centroids. The sensitivity may make the algorithm converge to the local optima. This paper proposes an improved k-means clustering algorithm based on quantum-inspired genetic algorithm (KMQGA). In KMQGA, Q-bit based representation is employed for exploration and exploitation in discrete 0-1 hyperspace by using rotation operation of quantum gate as well as three genetic algorithm operations (selection, crossover and mutation) of Q-bit. Without knowing the exact number of clusters beforehand, the KMQGA can get the optimal number of clusters as well as providing the optimal cluster centroids after several iterations of the four operations (selection, crossover, mutation, and rotation). The simulated datasets and the real datasets are used to validate KMQGA and to compare KMQGA with an improved k-means clustering algorithm based on the famous variable string length genetic algorithm (KMVGA) respectively. The experimental results show that KMQGA is promising and the effectiveness and the search quality of KMQGA is better than those of KMVGA.

[1]  Lov K. Grover A fast quantum mechanical algorithm for database search , 1996, STOC '96.

[2]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  M. Vazirgiannis,et al.  Clustering validity assessment using multi representatives , 2002 .

[4]  Sid Ray,et al.  Clustering-based colour image segmentation using inter-cluster distance , 1997 .

[5]  K. Benatchba,et al.  Image segmentation using quantum genetic algorithms , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[6]  S. Bandyopadhyay,et al.  Nonparametric genetic clustering: comparison of validity indices , 2001, IEEE Trans. Syst. Man Cybern. Syst..

[7]  Yee Leung,et al.  Clustering by Scale-Space Filtering , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  George Karypis,et al.  A Comparison of Document Clustering Techniques , 2000 .

[9]  J. Dunn Well-Separated Clusters and Optimal Fuzzy Partitions , 1974 .

[10]  Peter W. Shor,et al.  Algorithms for quantum computation: discrete logarithms and factoring , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[11]  Tony Hey,et al.  Quantum computing: an introduction , 1999 .

[12]  Pan Ruo-yu,et al.  Optimization Study on k Value of K-means Algorithm , 2006 .

[13]  Ujjwal Maulik,et al.  Performance Evaluation of Some Clustering Algorithms and Validity Indices , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Amit Konar,et al.  Document Clustering Using Differential Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[15]  Ling Wang,et al.  A Hybrid Quantum-Inspired Genetic Algorithm for Multiobjective Flow Shop Scheduling , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Wei Song,et al.  Genetic Algorithm-based Text Clustering Technique: Automatic Evolution of Clusters with High Efficiency , 2006, 2006 Seventh International Conference on Web-Age Information Management Workshops.

[17]  Jong-Hwan Kim,et al.  Face detection using quantum-inspired evolutionary algorithm , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[18]  Ajit Narayanan,et al.  Quantum-inspired genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[19]  Michalis Vazirgiannis,et al.  Clustering validity assessment: finding the optimal partitioning of a data set , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[20]  Xinzhi Liu,et al.  A Dynamic Clustering Algorithm Based on PSO and Its Application in Fuzzy Identification , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[21]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[22]  M. Batouche,et al.  A new quantum-inspired genetic algorithm for solving the travelling salesman problem , 2004, 2004 IEEE International Conference on Industrial Technology, 2004. IEEE ICIT '04..

[23]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithm for a class of combinatorial optimization , 2002, IEEE Trans. Evol. Comput..