Engineering applications of the self-organizing map

The self-organizing map (SOM) method is a new, powerful software tool for the visualization of high-dimensional data. It converts complex, nonlinear statistical relationships between high-dimensional data into simple geometric relationships on a low-dimensional display. As it thereby compresses information while preserving the most important topological and metric relationships of the primary data elements on the display, it may also be thought to produce some kind of abstractions. The term self-organizing map signifies a class of mappings defined by error-theoretic considerations. In practice they result in certain unsupervised, competitive learning processes, computed by simple-looking SOM algorithms. Many industries have found the SOM-based software tools useful. The most important property of the SOM, orderliness of the input-output mapping, can be utilized for many tasks: reduction of the amount of training data, speeding up learning nonlinear interpolation and extrapolation, generalization, and effective compression of information for its transmission.

[1]  Allen Gersho,et al.  On the structure of vector quantizers , 1982, IEEE Trans. Inf. Theory.

[2]  Kevin Warwick,et al.  Neural networks for power systems alarm handling , 1992, Neurocomputing.

[3]  Jesús Cid-Sueiro,et al.  Self-Organizing Feature Maps and Their Application to Digital Coding of Information , 1991, IWANN.

[4]  Olli Simula,et al.  Process State Monitoring Using Self-Organizing Maps , 1992 .

[5]  C. von der Malsburg,et al.  Distortion invariant object recognition by matching hierarchically labeled graphs , 1989, International 1989 Joint Conference on Neural Networks.

[6]  T. Fritsch,et al.  Communication network routing using neural nets-numerical aspects and alternative approaches , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[7]  Allen Gersho,et al.  Asymptotically optimal block quantization , 1979, IEEE Trans. Inf. Theory.

[8]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[9]  G. L. Sicuranza,et al.  Application of ordered codebooks to image coding , 1993, Neural Networks for Signal Processing III - Proceedings of the 1993 IEEE-SP Workshop.

[10]  Helge Ritter,et al.  Local PSOMs and Chebyshev PSOMs -Improving the Parametrised Self-Organizing Maps , 1995 .

[11]  Cad La.  APPLICATION OF FUZZY NEURAL COMPUTING IN CIRCUIT PARTITIONING , 1992 .

[12]  A. El-Jaroudi,et al.  A study on the partitioning capabilities of two-layer neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[13]  Phuoc Tran-Gia,et al.  Classification of Parkinson rating-scale-data using a selforganising neural net , 1993, IEEE International Conference on Neural Networks.

[14]  Teuvo Kohonen,et al.  Things you haven't heard about the self-organizing map , 1993, IEEE International Conference on Neural Networks.

[15]  Olli Simula,et al.  Process Monitoring and Visualization Using Self-Organizing Maps , 1995 .

[16]  Gilles Burel,et al.  Image compression using topological maps and MLP , 1993, IEEE International Conference on Neural Networks.

[17]  T. Fritsch,et al.  An integrated approach to cellular mobile communication planning using traffic data prestructured by a self-organizing feature map , 1993, IEEE International Conference on Neural Networks.

[18]  Heikki N. Koivo,et al.  Application of artificial neural networks in process fault diagnosis , 1991, Autom..

[19]  Kazuo Kyuma,et al.  10000 cell placement optimization using a self-organizing map , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[20]  T. Kohonen.  SELF-ORGANIZING MAPS: OPHMIZATION APPROACHES , 1991 .

[21]  Ahmed Hemani.  Self-organisation and its application to binding , 1993, The Sixth International Conference on VLSI Design.

[22]  Knut Möller.  A Multiassociative Memory for Control , 1993 .

[23]  D. A. Mlynski,et al.  Floorplan design using a hierarchical neural learning algorithm , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[24]  Wolfgang Trümper.  Ein neuronales Netz als lernende Steuerung/ A neural network as a self-learning controller , 1992 .

[25]  Stan Davis,et al.  Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Se , 1980 .

[26]  P. Morasso,et al.  The "capture effect": a new self-organizing network for "adaptive resolution" clustering in changing environments , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[27]  Les E. Atlas,et al.  A comparison of the LBG algorithm and Kohonen neural network paradigm for image vector quantization , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[28]  László Monostori,et al.  Convergence Behaviour of Connectionist Models in Large Scale Diagnostic Problems , 1992, IEA/AIE.

[29]  Dagmar Niebur,et al.  Unsupervised Neural Net Classification of Power System Static Security States , 1991 .

[30]  Barry G. Grossman,et al.  Composite damage assessment employing an optical neural network processor and an embedded fiber-optic sensor array , 1991, Other Conferences.

[31]  Ari Visa,et al.  A texture classifier based on neural network principles , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[32]  Ewald von Puttkamer,et al.  SPIN Learning and Forgetting Surface Classifications with Dynamic Neural Networks , 1993 .

[33]  Timo Sorsa,et al.  Neural networks in process fault diagnosis , 1991, IEEE Trans. Syst. Man Cybern..

[34]  Mikko Kurimo,et al.  Hybrid training method for tied mixture density hidden Markov models using learning vector quantization and Viterbi estimation , 1994, Proceedings of IEEE Workshop on Neural Networks for Signal Processing.

[35]  Haluk Toral,et al.  Flow rate measurement in air-water horizontal pipeline by neural networks , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[36]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[37]  Olli Simula,et al.  Start-up behaviour of a neural network assisted decision feedback equaliser in a two-path channel , 1992, [Conference Record] SUPERCOMM/ICC '92 Discovering a New World of Communications.

[38]  Tang Haitao,et al.  The Optimal Utilization of Multi-Service SCP , 1997 .

[39]  Daniele D. Caviglia,et al.  Pre-placement of VLSI blocks through learning neural networks , 1990, Proceedings of the European Design Automation Conference, 1990., EDAC..

[40]  Ray J. Frank,et al.  Dynamic competitive learning applied to the clone detection problem , 1995 .

[41]  Ari Visa,et al.  Identification of stochastic textures with multiresolution features and self-organizing maps , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[42]  N. Kashiwagi,et al.  Heating and cooling load prediction using a neural network system , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[43]  John G. Proakis,et al.  Advances in Equalization for Intersymbol Interference , 1975 .

[44]  J.A. Corral,et al.  Image compression via optimal vector quantization: a comparison between SOM, LBG and k-means algorithms , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[45]  Toru Yamaguchi,et al.  An Adaptive Control with Fuzzy Associative Memory System , 1991 .

[46]  Olli Simula,et al.  Representation and Identification of Fault Conditions of an Anaesthesia System by Means of the Self-Organizing Map , 1994 .

[47]  Olli Simula,et al.  Experiences from operational cloud classifier based on self-organizing map , 1994, Defense, Security, and Sensing.

[48]  M. Ishikawa.  Structural learning and its applications to rule extraction , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[49]  S. Carrato.  Image vector quantization using ordered codebooks: Properties and applications , 1994, Signal Process..

[50]  Ahmed Hemani,et al.  Cell placement by self-organisation , 1990, Neural Networks.

[51]  Pei-Yung Hsiao,et al.  Force directed self-organizing maps for L-shaped cell placement using delta learning rule , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[52]  L. Raffo,et al.  Neural clustering algorithms for classification and pre-placement of VLSI cells , 1992, CompEuro 1992 Proceedings Computer Systems and Software Engineering.

[53]  Cheng-Yuan Liou,et al.  Diagnoses for machine vibrations based on self-organization neural network , 1991, Proceedings IECON '91: 1991 International Conference on Industrial Electronics, Control and Instrumentation.

[54]  Erkki Oja,et al.  Randomized hough transform (rht) : Basic mech-anisms, algorithms, and computational complexities , 1993 .

[55]  Nasser M. Nasrabadi,et al.  Vector quantization of images based upon the Kohonen self-organizing feature maps , 1988, IEEE 1988 International Conference on Neural Networks.

[56]  Erkki Oja,et al.  Self - Organizing Maps and Computer Vision , 1992 .

[57]  Hiroshi Furukawa,et al.  A systematic method for rational definition of plant diagnostic symptoms by self-organizing neural networks , 1996, Neurocomputing.

[58]  W. Trümper.  Ein neuronales Netz als lernende Steuerung , 1992 .

[59]  Ahmed Hemani,et al.  Scheduling by Self-organization , 1990 .

[60]  E. A. Riskin,et al.  Ordered neural maps and their applications to data compression , 1991, Neural Networks for Signal Processing Proceedings of the 1991 IEEE Workshop.

[61]  Olli Simula,et al.  Neural adaptation for optimal traffic shaping in telephone systems , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[62]  D. A. Mlynski,et al.  Neural somatotopical mapping for VLSI placement optimization , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[63]  Heikki N. Koivo,et al.  Application of Neural Networks in the Detection of Breaks in a Paper Machine , 1992 .

[64]  Karl-Heinz Becks,et al.  Analysing Particle Jets with Artificial Neural Networks , 1992, IEA/AIE.

[65]  R. Sadananda,et al.  Topological maps for VLSI placement , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[66]  A. J. Germond,et al.  Impulse Test Fault Diagnosis on Power Transformers Using Kohonen"s Self-Organizing Neural Network , 1991 .

[67]  Katsunari Shibata,et al.  Self-Organization Capability for Eliminating Defective Neurons in Neural Network LSIs , 1992 .

[68]  R. Perfetti,et al.  Shear velocity estimation by the combined use of supervised and unsupervised neural networks , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[69]  Xin Feng,et al.  Nonlinear estimation of torque in switched reluctance motors using grid locking and preferential training techniques on self-organizing neural networks , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[70]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[71]  Chrysostomos L. Nikias,et al.  Adaptive equalization for PAM and QAM signals with neural networks , 1991, [1991] Conference Record of the Twenty-Fifth Asilomar Conference on Signals, Systems & Computers.

[72]  D. Niebur,et al.  Power system static security assessment using the Kohonen neural network classifier , 1991 .

[73]  Heikki Riittinen,et al.  Spectral classification of phonemes by learning subspaces , 1979, ICASSP.

[74]  C.-X. Zhang,et al.  VLSI-placement with a neural network model , 1990, IEEE International Symposium on Circuits and Systems.

[75]  Olli Simula,et al.  PERFORMANCE EVALUATION OF SELF-ORGANIZING MAP BASED NEURAL EQUALIZERS IN DYNAMIC DISCRETE-SIGNAL DETECTION , 1991 .

[76]  Stephen P. Luttrell,et al.  Derivation of a class of training algorithms , 1990, IEEE Trans. Neural Networks.

[77]  J. Lampinen,et al.  Unsupervised Learning for Feature Extraction , 1994 .

[78]  Teuvo Kohonen,et al.  The 'neural' phonetic typewriter , 1988, Computer.

[79]  M. A. Javed,et al.  Process monitoring using auto-associative, feed-forward artificial neural networks , 1993, J. Intell. Manuf..

[80]  Juha Tuominen,et al.  PROCESS ERROR DETECTION USING SELF-ORGANIZING FEATURE MAPS , 1991 .

[81]  Arnaldo D'Amico,et al.  Sensor arrays and Self-Organizing Maps for Odour Analysis in Artificial Olfactory Systems , 1994 .

[82]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[83]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[84]  R. Fischl,et al.  Application of neural networks to power system security: technology and trends , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[85]  Jari Kangas.  Phoneme recognition using time-dependent versions of self-organizing maps , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[86]  Timo Sorsa,et al.  APPLICATION OF ARTIFICIAL NEURAL NETWORKS IN PROCESS FAULT DIAGNOSIS , 1992 .

[87]  Wolfgang Rosenstiel,et al.  Identification of Car Body Steel by an optical on line System and a Kohonen’s self-organizing Map , 1993 .

[88]  Giovanni Poggi,et al.  Codebook ordering techniques for address-predictive VQ , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[89]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[90]  Olli Simula,et al.  Improving design feedback equaliser performance using neural networks , 1991 .

[91]  Hiroyuki Mori,et al.  An artificial neural-net based technique for power system dynamic stability with the Kohonen model , 1991 .

[92]  Chong-Min Kyung,et al.  Global placement of macro cells using self-organization principle , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[93]  Jari Kangas.  Sample weighting when training self-organizing maps for image compression , 1995, Proceedings of 1995 IEEE Workshop on Neural Networks for Signal Processing.

[94]  Nirwan Ansari,et al.  A neural network model to configure maps for a satellite communication network , 1990, [Proceedings] GLOBECOM '90: IEEE Global Telecommunications Conference and Exhibition.

[95]  Olli Simula,et al.  Neural detection of QAM modulation in the presence of interference , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[96]  Jouko Lampinen,et al.  Distortion tolerant pattern recognition based on self-organizing feature extraction , 1995, IEEE Trans. Neural Networks.

[97]  H. Kuwano,et al.  Applying a self-organizing map to sensor-array characterization , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[98]  T. Mita,et al.  Fuzzy adaptive control with an associative memory system , 1991 .

[99]  Heikki Hyötyniemi.  Optimal Control of Dynamic Systems Using Self-Organizing Maps , 1993 .

[100]  Michael Cain,et al.  Criteria for choosing connectionist paradigms for real-time data fusion and adaptive discrimination , 1988, Neural Networks.

[101]  D. S. Bradburn.  Reducing transmission error effects using a self-organizing network , 1989, International 1989 Joint Conference on Neural Networks.

[102]  Yuan-Yih Hsu,et al.  Design of artificial neural networks for short-term load forecasting. I. Self-organising feature maps for day type identification , 1991 .

[103]  D. Niebur,et al.  Power flow classification for static security assessment , 1991, Proceedings of the First International Forum on Applications of Neural Networks to Power Systems.

[104]  Helge Ritter,et al.  Parametrized Self-Organizing Maps , 1993 .

[105]  V. Tryba,et al.  Artificial self-organizing neural network for partial discharge source recognition , 1993 .

[106]  T. Yamaguchi,et al.  FUZZY ASSOCIATIVE MEMORY APPLICATIONS TO CONTROL , 1991 .

[107]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[108]  Nirwan Ansari,et al.  The performance evaluation of a new neural network based traffic management scheme for a satellite communication network , 1991, IEEE Global Telecommunications Conference GLOBECOM '91: Countdown to the New Millennium. Conference Record.

[109]  Karl Goser,et al.  Selbstorganisierende Parameterkarten zur Prozeßüberwachung und -voraussage , 1989, Wissensbasierte Systeme.

[110]  Ahmed Hemani,et al.  A neural net based self organising scheduling algorithm , 1990, Proceedings of the European Design Automation Conference, 1990., EDAC..

[111]  Richard W. Conners,et al.  A Theoretical Comparison of Texture Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[112]  Ossi Taipale,et al.  Optimization and simulation of quality properties in paper machine with neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[113]  Yu Jilai,et al.  A new fast method for supplying measures to avoid the high voltage mode of electromagnetic voltage transformer , 1991, Proceedings of the First International Forum on Applications of Neural Networks to Power Systems.

[114]  J. A. Naylor.  A neural network algorithm for enhancing delta modulation/LPC tandem connections , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[115]  Rajab Challoo,et al.  Multiple sensor target classification using an unsupervised hybrid neural network , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[116]  Kevin Warwick,et al.  Application of augmented-output self organizing feature maps to the adaptive control problem , 1990 .

[117]  Teuvo Kohonen,et al.  Emergence of invariant-feature detectors in the adaptive-subspace self-organizing map , 1996, Biological Cybernetics.

[118]  L. Peh,et al.  Information measure of knowledge extracted from neurons as a tool for analyzing Boolean learning in artificial neural networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[119]  Teuvo Kohonen,et al.  Improved versions of learning vector quantization , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[120]  Ali Habibi.  Neural networks in bandwidth compression , 1991, Optics & Photonics.

[121]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[122]  L. J. Scaglione.  Neural network application to particle impact noise detection , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[123]  L. R. Rabiner,et al.  An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition , 1983, The Bell System Technical Journal.

[124]  Jouko Lampinen,et al.  Self-Organizing Maps for Spatial and Temporal AR Models , 1989 .

[125]  V. Tryba,et al.  Digital circuit partition by self-organizing maps: a comparison to classical methods , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[126]  T. Kohonen,et al.  Statistical pattern recognition with neural networks: benchmarking studies , 1988, IEEE 1988 International Conference on Neural Networks.

[127]  Nasser M. Nasrabadi,et al.  Image coding using vector quantization: a review , 1988, IEEE Trans. Commun..

[128]  Teuvo Kohonen,et al.  Developments and applications of the self-organizing map and related algorithms , 1996 .

[129]  Thomas Fritsch.  Cellular Mobile Communication Design Using Self-Organizing Feature Maps , 1994 .

[130]  Olli Simula,et al.  Self-Organizing Feature Maps in Texture Classification and Segmentation , 1992 .

[131]  A. J. Germond,et al.  Load forecasting on an electrical system with the aid of the Kohonen neural network , 1992 .

[132]  Ray-I Chang,et al.  Force directed self-organizing map and its application to VLSI cell placement , 1993, IEEE International Conference on Neural Networks.

[133]  Helge Ritter.  Parametrized Self-Organizing Maps for Vision Learning Tasks , 1994 .

[134]  Teuvo Kohonen,et al.  Mapping content dependent acoustic information into context independent form by LVQ , 1994, Speech Commun..

[135]  Erkki Oja,et al.  From Situations to Actions: Motion Behavior Learning by Self-Organization , 1993 .

[136]  Alfred Ultsch,et al.  Self Organized Feature Maps for Monitoring and Knowledge Aquisition of a Chemical Process , 1993 .

[137]  Olli Simula,et al.  Combining linear equalization and self-organizing adaptation in dynamic discrete-signal detection , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[138]  Dennis Gabor,et al.  Theory of communication , 1946 .

[139]  M. A. Jabri,et al.  A new self-organisation strategy for floorplan design , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[140]  R. Frank,et al.  Clone detection in telecommunications software systems : a neural net approach , 1994 .

[141]  Azriel Rosenfeld,et al.  A Comparative Study of Texture Measures for Terrain Classification , 1975, IEEE Transactions on Systems, Man, and Cybernetics.