Using Fourier-neural recurrent networks to fit sequential input/output data

Abstract This paper suggests the use of Fourier-type activation functions in fully recurrent neural networks. The main theoretical advantage is that, in principle, the problem of recovering internal coefficients from input/output data is solvable in closed form.

[1]  Eduardo D. Sontag,et al.  For neural networks, function determines form , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[2]  Aj Bahr,et al.  Biographies of authors , 1970 .

[3]  Michael Ben-Or,et al.  A deterministic algorithm for sparse multivariate polynomial interpolation , 1988, STOC '88.

[4]  H. White,et al.  There exists a neural network that does not make avoidable mistakes , 1988, IEEE 1988 International Conference on Neural Networks.

[5]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[6]  Eduardo D. Sontag,et al.  Techniques for parameter reconstruction in Fourier-neural recurrent networks , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[7]  Eduardo D. Sontag,et al.  Neural Networks for Control , 1993 .

[8]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[9]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[10]  Eduardo D. Sontag,et al.  NEURAL NETS AS SYSTEMS MODELS AND CONTROLLERS , 1992 .

[11]  Eduardo D. Sontag,et al.  State observability in recurrent neural networks , 1994 .

[12]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[13]  Eduardo D. Sontag,et al.  Identi ability of discrete-time neural networks , 1993 .

[14]  Hava T. Siegelmann,et al.  Some results on computing with `neural nets , 1992 .

[15]  Norman P. Herzberg,et al.  Some variations on training of recurrent networks , 1992 .

[16]  Harry L. Trentelman,et al.  Essays on control : perspectives in the theory and its applications , 1993 .