STATISTICAL PATTERN RECOGNITION REVISITED

The name “Pattern Recognition” was initially coined for a discipline, the history of which dates back to the mid-1950s. One of its basic objectives has been to categorize vectorial stochastic data into discrete classes according to simple metric relationships. The first approaches were based on either the adaptive “delta rule”, which is essentially a Robbins-Monro stochastic approximation procedure, or decision-theoretic classification methods using the well-known Bayes probability formulas. Combined with other classical approaches to describe the class density functions such as the Parzen windows, the problem was thought to be solved completely long time ago. In principle it may be so, but in practice, computational aspects such as training and recognition times must be taken into account. The Neural Network hardware would also favor more straightforward operations amenable to analog computing. It has now turned out that certain new self-organizing approaches, here grouped under the title Learning Vector Quantization (LVQ), can combine theoretically near-optimal accuracy with very high speed in learning and recognition; moreover, their implementation by analog VLSI is straightforward. This presentation reports recent experiments, mainly relating to automatic recognition of speech, which demonstrate that there still exist fresh views and effective new solutions to traditional problems.

[1]  T. Kohonen,et al.  Statistical pattern recognition with neural networks: benchmarking studies , 1988, IEEE 1988 International Conference on Neural Networks.

[2]  Teuvo Kohonen,et al.  An introduction to neural computing , 1988, Neural Networks.

[3]  Paul L. Zador,et al.  Asymptotic quantization error of continuous signals and the quantization dimension , 1982, IEEE Trans. Inf. Theory.

[4]  Shigeru Katagiri,et al.  Shift-invariant, multi-category phoneme recognition using Kohonen's LVQ2 , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[5]  Venta,et al.  Variants of self-organizing maps , 1989 .

[6]  E. McDermott,et al.  A hybrid speech recognition system using HMMs with an LVQ-trained codebook , 1990 .

[7]  Allen Gersho,et al.  On the structure of vector quantizers , 1982, IEEE Trans. Inf. Theory.

[8]  Teuvo Kohonen,et al.  The 'neural' phonetic typewriter , 1988, Computer.

[9]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[10]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.