Analog computation via neural networks

The authors pursue a particular approach to analog computation, based on dynamical systems of the type used in neural networks research. The systems have a fixed structure, invariant in time, corresponding to an unchanging number of 'neurons'. If allowed exponential time for computation, they turn out to have unbounded power. However, under polynomial-time constraints there are limits on their capabilities, though being more powerful than Turing machines. These networks are not likely to solve polynomially-NP-hard problems, as the equality 'P=NP' implies the almost complete collapse of the standard polynomial hierarchy. In contrast to classical computational models, the models studied exhibit at least some robustness with respect to noise and implementation errors.<<ETX>>

[1]  Kendall E. Atkinson An introduction to numerical analysis , 1978 .

[2]  Timothy X. Brown,et al.  Competitive neural architecture for hardware solution to the assignment problem , 1991, Neural Networks.

[3]  Hava T. Siegelmann,et al.  On the power of sigmoid neural networks , 1993, COLT '93.

[4]  S. Smale,et al.  On a theory of computation and complexity over the real numbers; np-completeness , 1989 .

[5]  C. Lee Giles,et al.  Learning and Extracting Finite State Automata with Second-Order Recurrent Neural Networks , 1992, Neural Computation.

[6]  John E. Savage,et al.  The Complexity of Computing , 1976 .

[7]  D. Wolpert,et al.  A Computationally Universal Field Computer That is Purely Linear , 1993 .

[8]  José L. Balcázar,et al.  Structural Complexity I , 1995, Texts in Theoretical Computer Science An EATCS Series.

[9]  Uzi Vishkin,et al.  Constant Depth Reducibility , 1984, SIAM J. Comput..

[10]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[11]  Michael Sipser,et al.  Parity, circuits, and the polynomial-time hierarchy , 1981, 22nd Annual Symposium on Foundations of Computer Science (sfcs 1981).

[12]  Jia-Wei Hong On connectionist models , 1988 .

[13]  David E. Muller,et al.  Complexity in Electronic Switching Circuits , 1956, IRE Trans. Electron. Comput..

[14]  B. MacLennan Continuous Symbol Systems: The Logic of Connectionism , 1991 .

[15]  H. Stowell The emperor's new mind R. Penrose, Oxford University Press, New York (1989) 466 pp. $24.95 , 1990, Neuroscience.

[16]  Stephen Smale,et al.  On a theory of computation over the real numbers; NP completeness, recursive functions and universal machines , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[17]  C. L. Giles,et al.  Second-order recurrent neural networks for grammatical inference , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[18]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[19]  B. Dickinson,et al.  The complexity of analog computation , 1986 .

[20]  Georg Schnitger,et al.  On the computational power of sigmoid versus Boolean threshold circuits , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[21]  Saburo Muroga,et al.  Threshold logic and its applications , 1971 .

[22]  Ann Yasuhara,et al.  Recursive function theory and logic , 1971, Computer science and applied mathematics.