论文信息 - Supervised Learning of Probability Distributions by Neural Networks

Supervised Learning of Probability Distributions by Neural Networks

We propose that the back propagation algorithm for supervised learning can be generalized, put on a satisfactory conceptual footing, and very likely made more efficient by defining the values of the output and input neurons as probabilities and varying the synaptic weights in the gradient direction of the log likelihood, rather than the 'error'.

Eric B. Baum | Frank Wilczek | E. Baum | F. Wilczek

[1] Frank Rosenblatt,et al. PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[2] Richard O. Duda,et al. Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3] P. Werbos,et al. Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[4] Silviu Guiaşu,et al. Information theory with applications , 1977 .

[5] Geoffrey E. Hinton,et al. Learning internal representations by error propagation , 1986 .

[6] Terrence J. Sejnowski,et al. Learned classification of sonar targets using a massively parallel network , 1988, IEEE Trans. Acoust. Speech Signal Process..