Switched-capacitor neural networks for differential optimization

The primary goal of this paper is to solve some types of optimization problems whose objective functions and constraints are smooth and continuously differentiable and which are not suited for digital signal processing. the optimization problems are mapped into systems of first- and second-order non-linear ordinary differential equations and/or systems of difference equations. These systems of equations are simulated by appropriate switched-capacitor (SC) circuits employing some neural network (neurobiological) principles. New switched-capacitor architectures for on-line solving of non-linear optimization problems are proposed and their properties are investigated. Various circuit structures are investigated to find which are best suited for SC CMOS implementation. the structures developed exhibit a high degree of modularity, and a relatively small number of basic building blocks (computing cells) are required to implement effective and powerful optimization algorithms. Basic mathematical operations, e.g. multiplication, addition and non-linear scaling transformation, are accomplished employing advanced SC techniques. the validity and performance of the circuit structures developed are illustrated by intensive computer simulations employing TUTSIM and NAP programmes.

[1]  Chung-Yu Wu,et al.  Programmable SC neural networks for solving nonlinear programming problems , 1990, IEEE International Symposium on Circuits and Systems.

[2]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[3]  Michael A. Saunders,et al.  A projected Lagrangian algorithm and its implementation for sparse nonlinear constraints , 1982 .

[4]  Ángel Rodríguez-Vázquez,et al.  Switched-capacitor neural networks for linear programming , 1988 .

[5]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[6]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[7]  Neil E. Cotter,et al.  A pulse-width modulation design approach and path-programmable logic for artificial neural networks , 1988 .

[8]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Andrzej Cichocki,et al.  Monolithic MOS switched-capacitor microsystems for nonlinear analog signal processing , 1988 .

[10]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[11]  Edgar Sanchez-Sinencio,et al.  Nonlinear switched capacitor 'neural' networks for optimization problems , 1990 .

[12]  Carver A. Mead,et al.  Implementing neural architectures using analog VLSI circuits , 1989 .

[13]  V. Parisi,et al.  A New Method for Solving Nonlinear Simultaneous Equations , 1979 .

[14]  Leon O. Chua,et al.  Nonlinear programming without computation , 1984 .

[15]  Dimitris Anastassiou,et al.  Switched-capacitor neural networks , 1987 .