Analog CMOS integration and experimentation with an autoadaptive independent component analyzer

In this paper we explore a combination of above-and-subthreshold CMOS circuit techniques for the implementation of analog neuromorphic network processing. The implemented network embodies a blind signal separation algorithm performing an independent component analysis. It is essentially a continuous time recursive linear adaptive filter that uses a non-linear adaptation rule. Analog I/O interface, weight coefficients and adaptation blocks are all integrated on the chip. A test 2-neuron-2-synapse network as well as a small 5-neuron-20-synapse network were fabricated in a 2 micron n-well double-polysilicon, double-metal CMOS process. Circuit designs at the transistor level yield area efficient implementations for synapses and the adaptation blocks. We present experimental results from testing the systems with sinusoidal signals and noise and report on its performance as a blind separator of mixed speech signals. >

[1]  M.M. Sondhi,et al.  Silencing echoes on the telephone network , 1980, Proceedings of the IEEE.

[2]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[3]  C. Jutten Calcul neuromimétique et traitement du signal : analyse en composantes indépendantes , 1987 .

[4]  Christian Jutten,et al.  Space or time adaptive signal processing by neural network models , 1987 .

[5]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[6]  Eric A. Vittoz,et al.  CMOS Integration of Herault-Jutten Cells for Separation of Sources , 1989, Analog VLSI Implementation of Neural Systems.

[7]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[8]  A. Andreou,et al.  Characterization of CMOS Process Variations by Measuring Subthreshold Current , 1991 .

[9]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[10]  John Lazzaro,et al.  A silicon model of an auditory neural representation of spectral shape , 1991 .

[11]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[12]  John C. Platt,et al.  Networks for the Separation of Sources that Are Superimposed and Delayed , 1991, NIPS.

[13]  Pierre Comon,et al.  Blind separation of sources, part II: Problems statement , 1991, Signal Process..

[14]  Andreas G. Andreou,et al.  A Contrast Sensitive Silicon Retina with Reciprocal Synapses , 1991, NIPS.

[15]  T. Delbruck 'Bump' circuits for computing similarity and dissimilarity of analog voltages , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[16]  Andreas G. Andreou,et al.  An auto-adaptive synthetic neural network for real-time separation of independent signal sources , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[17]  Andreas G. Andreou,et al.  Silicon implementation of an auto-adaptive network for real-time separation of independent signals , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[18]  A. Andreou,et al.  MOS circuit for nonlinear Hebbian learning , 1992 .

[19]  T. Kailath,et al.  Adaptive recursive-least-squares and lattice transversal filters for continuous-time signal processing , 1992 .

[20]  P. Comon Independent Component Analysis , 1992 .

[21]  Andreas G. Andreou,et al.  Current-mode subthreshold MOS implementation of the Herault-Jutten autoadaptive network , 1992 .

[22]  Weimin Liu,et al.  Voiced-speech representation by an analog silicon model of the auditory periphery , 1992, IEEE Trans. Neural Networks.

[23]  Padhraic Smyth,et al.  Rule-Based Neural Networks for Classification and Probability Estimation , 1992, Neural Computation.

[24]  R Meddis,et al.  Modeling the identification of concurrent vowels with different fundamental frequencies. , 1992, The Journal of the Acoustical Society of America.

[25]  Jie Zhu,et al.  Anti-Hebbian learning in topologically constrained linear networks: a tutorial , 1993, IEEE Trans. Neural Networks.

[26]  Aleksandra Pavasović,et al.  Characterization of subthreshold MOS mismatch in transistors for VLSI systems , 1994 .

[27]  A.L. Gorin,et al.  An experiment in spoken language acquisition , 1992, IEEE Trans. Speech Audio Process..

[28]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..