Some Topics in Neural Networks and Control

This report constitutes an expanded version of a presentation given by the author at the 1993 European Control Conference (short course on "Neural Nets for Control"). The first part places neurocontrol techniques in a general learning control framework. The second part of the report, which is essentially independent of the first,briefly surveys several basic theoretical results regarding neural networks.

[1]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[2]  David Haussler,et al.  Classifying learnable geometric concepts with the Vapnik-Chervonenkis dimension , 1986, STOC '86.

[3]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[4]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[5]  Eduardo D. Sontag,et al.  Finiteness results for sigmoidal “neural” networks , 1993, STOC.

[6]  Judy A. Franklin,et al.  Historical perspective and state of the art in connectionist learning control , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[7]  Eduardo D. Sontag,et al.  UNIQUENESS OF WEIGHTS FOR NEURAL NETWORKS , 1993 .

[8]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[9]  Hava T. Siegelmann,et al.  Some structural complexity aspects of neural computation , 1993, [1993] Proceedings of the Eigth Annual Structure in Complexity Theory Conference.

[10]  Donald A. Sofge,et al.  Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches , 1992 .

[11]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Ronald L. Rivest,et al.  Training a 3-node neural network is NP-complete , 1988, COLT '88.

[13]  S. M. Carroll,et al.  Construction of neural nets using the radon transform , 1989, International 1989 Joint Conference on Neural Networks.

[14]  Mahesan Niranjan,et al.  Neural networks and radial basis functions in classifying static speech patterns , 1990 .

[15]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[16]  Jay A. Farrell,et al.  A Computationally Efficient Algorithm for Training Recurrent Connectionist Networks , 1992, 1992 American Control Conference.

[17]  Héctor J. Sussmann,et al.  Uniqueness of the weights for minimal feedforward nets with a given input-output map , 1992, Neural Networks.

[18]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[19]  Halbert White,et al.  Approximating and learning unknown mappings using multilayer feedforward networks with bounded weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[20]  Eduardo D. Sontag,et al.  For neural networks, function determines form , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[21]  R. M. Sanner,et al.  Neural Networks for Adaptive Control and Recursive Identification: A Theoretical Framework , 1993 .

[22]  Hava T. Siegelmann,et al.  On the power of sigmoid neural networks , 1993, COLT '93.

[23]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[24]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry, Expanded Edition , 1987 .

[25]  J. Stephen Judd,et al.  Neural network design and the complexity of learning , 1990, Neural network modeling and connectionism.

[26]  C. Fefferman.  Reconstructing a neural net from its output , 1994 .

[27]  Stephen P. Boyd,et al.  Uniqueness of a basic nonlinear structure , 1983 .

[28]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[29]  G. Pisier.  Remarques sur un résultat non publié de B. Maurey , 1981 .

[30]  David Haussler,et al.  What Size Net Gives Valid Generalization? , 1989, Neural Computation.

[31]  L. Steels,et al.  Accelerated Learning in Back-propagation Nets , 1989 .

[32]  David Haussler,et al.  Decision Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications , 1992, Inf. Comput..

[33]  Eduardo D. Sontag,et al.  Neural Networks for Control , 1993 .

[34]  Sanjeev R. Kulkarni,et al.  Problems of computational and informational complexity in machine vision and learning , 1991 .

[35]  Eduardo D. Sontag,et al.  Feedforward Nets for Interpolation and Classification , 1992, J. Comput. Syst. Sci..

[36]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[37]  Alon Itai,et al.  Learnability by fixed distributions , 1988, COLT '88.

[38]  Roger K. Moore.  Computer Speech and Language , 1986 .

[39]  L. Mcbride,et al.  Optimization of time-varying systems , 1965 .

[40]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[41]  Richard G. Priest,et al.  Pattern classification using projection pursuit , 1990, Pattern Recognit..

[42]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[43]  Eduardo D. Sontag,et al.  Feedback Stabilization Using Two-Hidden-Layer Nets , 1991, 1991 American Control Conference.

[44]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[45]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[46]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[47]  Hava T. Siegelmann,et al.  Some results on computing with `neural nets , 1992 .

[48]  S Grossberg,et al.  Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Allan Pinkus,et al.  Multilayer Feedforward Networks with a Non-Polynomial Activation Function Can Approximate Any Function , 1991, Neural Networks.

[50]  Martin Anthony,et al.  Computational learning theory: an introduction , 1992 .

[51]  Eduardo D. Sontag,et al.  Rate of approximation results motivated by robust neural network learning , 1993, COLT '93.

[52]  Wolfram Schiffmann,et al.  Optimization of the Backpropagation Algorithm for Training Multilayer Perceptrons , 1994 .

[53]  D. Sprecher.  On the structure of continuous functions of several variables , 1965 .

[54]  Eduardo D. Sontag,et al.  Backpropagation separates when perceptrons do , 1989, International 1989 Joint Conference on Neural Networks.

[55]  R. Sutton,et al.  Connectionist Learning for Control: An Overview , 1989 .

[56]  W. Rugh,et al.  On the structure of a class of nonlinear systems , 1973, CDC 1973.

[57]  Nazif Tepedelenlioglu,et al.  A fast new algorithm for training feedforward neural networks , 1992, IEEE Trans. Signal Process..