Kernel neural gas algorithms with application to cluster analysis

We present a kernel neural gas (KNG) algorithm, to generalize the original neural gas (NG) algorithm into a higher dimensional feature space. The proposed KNG algorithm can successfully tackle nonlinearly structured datasets. Compared with several existing kernel clustering algorithms, the KNG can be insensitive to initializations, due to the employment of the sequential learning strategy and the neighborhood cooperation scheme. Further, a distortion sensitive KNG (DSKNG) algorithm is proposed to tackle the imbalanced clustering problem. Experimental results show that our KNG algorithm can successfully deal with nonlinearly structured datasets and multi-modal datasets, while the imbalanced clusters are detected bv the DSKNG.

[1]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[2]  Wan-Chi Siu,et al.  Distortion sensitive competitive learning for vector quantizer design , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Paul S. Bradley,et al.  Refining Initial Points for K-Means Clustering , 1998, ICML.

[4]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[5]  Colin Fyfe,et al.  The kernel self-organising map , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[6]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[7]  Mark A. Girolami,et al.  Mercer kernel-based clustering in feature space , 2002, IEEE Trans. Neural Networks.

[8]  Narasimha M Murty,et al.  Kernel Enabled K-Means Algorithm , 2002 .

[9]  Zhongdong Wu,et al.  Fuzzy C-means clustering algorithm based on kernel method , 2003, Proceedings Fifth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2003.