论文信息 - Noise injection into inputs in back-propagation learning

Noise injection into inputs in back-propagation learning

Back-propagation can be considered a nonlinear regression technique, allowing a nonlinear neural network to acquire an input/output (I/O) association using a limited number of samples chosen from a population of input and output patterns. A crucial problem on back-propagation is its generalization capability. A network successfully trained for given samples is not guaranteed to provide desired associations for untrained inputs as well. Concerning this problem some authors showed experimentally that the generalization capability could remarkably be enhanced by training the network with noise injected inputs. The author mathematically explains why and how the noise injection to inputs has such an effect. >

Kiyotoshi Matsuoka | K. Matsuoka

[1] Geoffrey E. Hinton,et al. Learning internal representations by error propagation , 1986 .

[2] Geoffrey E. Hinton,et al. Experiments on Learning by Back Propagation. , 1986 .

[3] Teuvo Kohonen,et al. Self-Organization and Associative Memory , 1988 .

[4] R.J.F. Dow,et al. Neural net pruning-why and how , 1988, IEEE 1988 International Conference on Neural Networks.

[5] Enis Ersü,et al. Learning Control Structures with Neuron-Like Associative Memory Systems , 1988 .

[6] S. Y. Kung,et al. An algebraic projection analysis for optimal hidden units size and learning rates in back-propagation learning , 1988, IEEE 1988 International Conference on Neural Networks.

[7] Lorien Y. Pratt,et al. Comparing Biases for Minimal Network Construction with Back-Propagation , 1988, NIPS.

[8] M. Ishikawa,et al. A structural learning algorithm with forgetting of link weights , 1989, International 1989 Joint Conference on Neural Networks.