论文信息 - Robustness in Multilayer Perceptrons

Robustness in Multilayer Perceptrons

In this paper, we study the robustness of multilayer networks versus the destruction of neurons. We show that the classical backpropagation algorithm does not lead to optimal robustness and we propose a modified algorithm that improves this capability.

F. Vallet | P. Kerlirzin | F. Vallet | P. Kerlirzin

[1] J J Hopfield,et al. Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[2] Sompolinsky,et al. Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[3] James L. McClelland,et al. Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[4] Y. L. Cun,et al. Modèles connexionnistes de l'apprentissage , 1987 .

[5] Garrison W. Cottrell,et al. Image compression by back-propagation: An example of extensional programming , 1988 .

[6] D. Sherrington,et al. Theory of associative memory in randomly connected Boolean neural networks , 1989 .

[7] Geoffrey E. Hinton,et al. Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[8] Vallet,et al. Recognition rates of the Hebb rule for learning Boolean functions. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[9] Ali A. Minai,et al. Perturbation response in feedforward networks , 1994, Neural Networks.