The self-organizing map

The self-organized map, an architecture suggested for artificial neural networks, is explained by presenting simulation experiments and practical applications. The self-organizing map has the property of effectively creating spatially organized internal representations of various features of input signals and their abstractions. One result of this is that the self-organization process can discover semantic relationships in sentences. Brain maps, semantic maps, and early work on competitive learning are reviewed. The self-organizing map algorithm (an algorithm which order responses spatially) is reviewed, focusing on best matching cell selection and adaptation of the weight vectors. Suggestions for applying the self-organizing map algorithm, demonstrations of the ordering process, and an example of hierarchical clustering of data are presented. Fine tuning the map by learning vector quantization is addressed. The use of self-organized maps in practical speech recognition and a simulation experiment on semantic mapping are discussed. >

[1]  Dennis Gabor,et al.  Theory of communication , 1946 .

[2]  A. Tunturi Physiological determination of the arrangement of the afferent connections to the middle ectosylvian auditory area in the dog. , 1950, The American journal of physiology.

[3]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[4]  A. Tunturi Classification of neurons in the ectosylvian auditory cortex of the dog , 1971, The Journal of comparative neurology.

[5]  A. Yamadori,et al.  Word category aphasia. , 1973, Cortex; a journal devoted to the study of the nervous system and behavior.

[6]  A. Damasio,et al.  Nervous function after right hemispherectomy , 1975, Neurology.

[7]  E. Warrington Quarterly Journal of Experimental Psychology the Selective Impairment of Semantic Memory the Selective Impairment of Semantic Memory , 2022 .

[8]  R. Pérez,et al.  Development of Specificity in the Cat Visual Cortex , 1975, Journal of mathematical biology.

[9]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  C. Malsburg,et al.  How to label nerve cells so that they can interconnect in an ordered fashion. , 1977, Proceedings of the National Academy of Sciences of the United States of America.

[11]  E. Warrington,et al.  Category-specific naming preservation: a single case study. , 1978, Journal of neurology, neurosurgery, and psychiatry.

[12]  J. Murphy,et al.  Spatial organization of precentral cortex in awake primates. III. Input-output coupling. , 1978, Journal of neurophysiology.

[13]  Allen Gersho,et al.  Asymptotically optimal block quantization , 1979, IEEE Trans. Inf. Theory.

[14]  D J Willshaw,et al.  A marker induction mechanism for the establishment of ordered neural mappings: its application to the retinotectal problem. , 1979, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  N. Suga,et al.  Neural axis representing target range in the auditory cortex of the mustache bat. , 1979, Science.

[16]  J. Kaas,et al.  Multiple representations of the body within the primary somatosensory cortex of primates. , 1979, Science.

[17]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[18]  Shun-Ichi Amari,et al.  Topographic organization of nerve fields , 1979, Neuroscience Letters.

[19]  S. Zeki The representation of colours in the cerebral cortex , 1980, Nature.

[20]  N. Swindale A model for the formation of ocular dominance stripes , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  R. Reale,et al.  Tonotopic organization in auditory cortex of the cat , 1980, The Journal of comparative neurology.

[22]  Allen Gersho,et al.  On the structure of vector quantizers , 1982, IEEE Trans. Inf. Theory.

[23]  G. V. Van Hoesen,et al.  Prosopagnosia , 1982, Neurology.

[24]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Paul L. Zador,et al.  Asymptotic quantization error of continuous signals and the quantization dimension , 1982, IEEE Trans. Inf. Theory.

[26]  L. R. Rabiner,et al.  An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition , 1983, The Bell System Technical Journal.

[27]  E. Warrington,et al.  CATEGORY SPECIFIC ACCESS DYSPHASIA , 1983 .

[28]  G. Ojemann Ojemann's data: Provocative but mysterious , 1983, Behavioral and Brain Sciences.

[29]  J. Kaas,et al.  The reorganization of somatosensory cortex following peripheral nerve damage in adult and developing mammals. , 1983, Annual review of neuroscience.

[30]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[31]  Rolls Et Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. , 1984 .

[32]  T. Shallice,et al.  Category specific semantic impairments , 1984 .

[33]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[34]  H. Goodglass,et al.  Category Specific Dissociations in Naming and Recognition by Aphasic Patients , 1986, Cortex.

[35]  Olli Ventä,et al.  Microprocessor implementation of a large vocabulary speech recognizer and phonetic typewriter for Finnish and Japanese , 1987, ECST.

[36]  J. Pearson,et al.  Plasticity in the organization of adult cerebral cortical maps: a computer simulation based on neuronal group selection , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  D. Sparks,et al.  Sensory and motor maps in the mammalian superior colliculus , 1987, Trends in Neurosciences.

[38]  Helge Ritter,et al.  Topology conserving mappings for learning motor tasks , 1987 .

[39]  E. Warrington,et al.  Categories of knowledge. Further fractionations and an attempted integration. , 1987, Brain : a journal of neurology.

[40]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[41]  E I Knudsen,et al.  Computational maps in the brain. , 1987, Annual review of neuroscience.

[42]  Bernard Angéniol,et al.  Self-organizing feature maps and the travelling salesman problem , 1988, Neural Networks.

[43]  Teuvo Kohonen,et al.  The 'neural' phonetic typewriter , 1988, Computer.

[44]  K. Schulten,et al.  Kohonen's self-organizing maps: exploring their computational capabilities , 1988, IEEE 1988 International Conference on Neural Networks.

[45]  S. P. Luttrell Self-organising multilayer topographic mappings , 1988, IEEE 1988 International Conference on Neural Networks.

[46]  T. Kohonen,et al.  Statistical pattern recognition with neural networks: benchmarking studies , 1988, IEEE 1988 International Conference on Neural Networks.

[47]  Teuvo Kohonen,et al.  An introduction to neural computing , 1988, Neural Networks.

[48]  D. J. Burr,et al.  An improved elastic net method for the traveling salesman problem , 1988, IEEE 1988 International Conference on Neural Networks.

[49]  A. Caramazza Some aspects of language processing revealed through the analysis of acquired aphasia: the lexical system. , 1988, Annual review of neuroscience.

[50]  Nasser M. Nasrabadi,et al.  Vector quantization of images based upon the Kohonen self-organizing feature maps , 1988, ICNN.

[51]  D. H. Graf,et al.  A neural controller for collision-free movement of general robot manipulators , 1988, IEEE 1988 International Conference on Neural Networks.

[52]  E. Warrington,et al.  Evidence for modality-specific meaning systems in the brain , 1988, Nature.

[53]  R. Miikkulainen,et al.  Forming global representations with extended backpropagation , 1988, IEEE 1988 International Conference on Neural Networks.

[54]  Yehoshua Y. Zeevi,et al.  The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Robert Hecht-Nielsen,et al.  Applications of counterpropagation networks , 1988, Neural Networks.

[56]  P. T. Fox,et al.  Positron emission tomographic studies of the cortical anatomy of single-word processing , 1988, Nature.

[57]  H. Ritter Combining self-organizing maps , 1989, International 1989 Joint Conference on Neural Networks.

[58]  D. S. Bradburn Reducing transmission error effects using a self-organizing network , 1989, International 1989 Joint Conference on Neural Networks.

[59]  P. Morasso,et al.  Neural models of cursive script handwriting , 1989, International 1989 Joint Conference on Neural Networks.

[60]  Shigeru Katagiri,et al.  Shift-invariant, multi-category phoneme recognition using Kohonen's LVQ2 , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[61]  D. H. Graf,et al.  Neuroplanners for hand/eye coordination , 1989, International 1989 Joint Conference on Neural Networks.

[62]  J. Lampinen,et al.  Fast self-organization by the probing algorithm , 1989, International 1989 Joint Conference on Neural Networks.

[63]  Klaus Schulten,et al.  Topology-conserving maps for learning visuo-motor-coordination , 1989, Neural Networks.

[64]  I. Grabec Self-organization based on the second maximum entropy principle , 1989 .

[65]  Jorma Laaksonen,et al.  Variants of self-organizing maps , 1990, International 1989 Joint Conference on Neural Networks.

[66]  R. M. Holdaway Enhancing supervised learning algorithms via self-organization , 1989, International 1989 Joint Conference on Neural Networks.

[67]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[68]  S. P. Luttrell,et al.  Self-organisation: a derivation from first principles of a class of learning algorithms , 1989, International 1989 Joint Conference on Neural Networks.

[69]  Helge J. Ritter,et al.  Three-dimensional neural net for learning visuomotor coordination of a robot arm , 1990, IEEE Trans. Neural Networks.

[70]  Ahmed Hemani,et al.  A neural net based self organising scheduling algorithm , 1990, Proceedings of the European Design Automation Conference, 1990., EDAC..