Pattern classification using multiple hierarchical overlapped self-organising maps

Abstract In this paper, we describe techniques for designing high-performance pattern classification systems using multiple hierarchical overlapped self-organising maps (HOSOM) (Suganthan, Proceedings of the International Joint Conference on Neural Networks, WCCI’98, Alaska, 1998). The HOSOM model has one first level SOM and several partially overlapping second-level SOMs. With this overlap, every training and test sample is classified by multiple second-level SOMs. Hence, the final classification decision can be made by combining these multiple classification decisions to obtain a better performance. In this paper, we use multiple HOSOMs and each HOSOM is trained on a distinct input feature set extracted from the same data set. Since one HOSOM yields multiple classifications, these multiple HOSOMs generate a large number of classification decisions. To combine the individual classifications, we make use of the global winner as well as a winner for every class. Our experiments yielded a high recognition rate of 99.25% on NIST19 numeral database.

[1]  Ponnuthurai Nagaratnam Suganthan Structure adaptive multilayer overlapped SOMs with supervision for handprinted digit classification , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[2]  Galina L. Rogova,et al.  Combining the results of several neural network classifiers , 1994, Neural Networks.

[3]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[4]  Hong Yan,et al.  Handwritten Digit Recognition Using Two-Layer Self-Organizing Maps , 1994, Int. J. Neural Syst..

[5]  Allen M. Peterson,et al.  Adaptive Vector Quantization Using a Self-Development Neural Network , 1990, IEEE J. Sel. Areas Commun..

[6]  Ching Y. Suen,et al.  A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Thomas Villmann,et al.  Growing a hypercubical output space in a self-organizing feature map , 1997, IEEE Trans. Neural Networks.

[8]  Sung-Bae Cho,et al.  Neural-network classifiers for recognizing totally unconstrained handwritten numerals , 1997, IEEE Trans. Neural Networks.

[9]  Sargur N. Srihari,et al.  Decision Combination in Multiple Classifier Systems , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Horst Bunke,et al.  Off-Line, Handwritten Numeral Recognition by Perturbation Method , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[13]  Ralf Der,et al.  Hierarchical feature maps for non-linear component analysis , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[14]  Sung-Bae Cho,et al.  Pattern recognition with neural networks combined by genetic algorithm , 1999, Fuzzy Sets Syst..