Conventional and Connectionist Parallel Computation

It has been clear for many years that parallelism is the cornerstone of future computing. What has been much less clear is how to achieve high degrees of parallelism in a practical way. In the standard formulation there is an inherent dilemma facing the designers and users of highly parallel systems. It is relatively easy and efficient to build loosely coupled systems where each processor works exclusively on local data. But this is exactly the kind of system that has proven most difficult to program, except in some special problems that naturally separate. Much of the current research effort in computer systems is concerned with ways of efficiently providing the illusion of shared memory in a distributed machine [TSF90].

[1]  Jeff A. Bilmes,et al.  The RAP: a ring array processor for layered network calculations , 1990, [1990] Proceedings of the International Conference on Application Specific Array Processors.

[2]  H Hermansky,et al.  Perceptual linear predictive (PLP) analysis of speech. , 1990, The Journal of the Acoustical Society of America.

[3]  David E. Culler,et al.  Fine-grain parallelism with minimal hardware support: a compiler-controlled threaded abstract machine , 1991, ASPLOS IV.

[4]  Hervé Bourlard,et al.  Continuous speech recognition using multilayer perceptrons with hidden Markov models , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[5]  Matthew A. Wilson,et al.  GENESIS: A System for Simulating Neural Networks , 1988, NIPS.

[6]  S. Tam,et al.  An electrically trainable artificial neural network (ETANN) with 10240 'floating gate' synapses , 1990, International 1989 Joint Conference on Neural Networks.

[7]  D. Hammerstrom,et al.  A VLSI architecture for high-performance, low-cost, on-chip learning , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[8]  A. Iwata,et al.  An artificial neural network accelerator using general purpose 24 bit floating point digital signal processors , 1989, International 1989 Joint Conference on Neural Networks.

[9]  Mark A. Fanty,et al.  Computing with structured connectionist networks , 1988, CACM.

[10]  Hynek Hermansky,et al.  Continuous speech recognition using PLP analysis with multilayer perceptrons , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[11]  James A. Reggia,et al.  A general-purpose simulation environment for developing connectionist models , 1988, Simul..

[12]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[13]  Stein Gjessing,et al.  Distributed-directory scheme: scalable coherent interface , 1990, Computer.

[14]  Richard F. Lyon,et al.  An analog electronic cochlea , 1988, IEEE Trans. Acoust. Speech Signal Process..

[15]  Jenq-Neng Hwang,et al.  A Unified Systolic Architecture for Artificial Neural Networks , 1989, J. Parallel Distributed Comput..

[16]  W. Raab,et al.  Fine-grain system architectures for systolic emulation of neural algorithms , 1990, [1990] Proceedings of the International Conference on Application Specific Array Processors.