The techniques of Bayesian inference have been applied with great success to many problems in neural computing including evaluation of regression functions, determination of error bars on predictions, and the treatment of hyper-parameters. However, the problem of model comparison is a much more challenging one for which current techniques have significant limitations. In this paper we show how an extended form of Markov chain Monte Carlo, called chaining, is able to provide effective estimates of the relative probabilities of different models. We present results from the robot arm problem and compare them with the corresponding results obtained using the standard Gaussian approximation framework.
[1]
S. Duane,et al.
Hybrid Monte Carlo
,
1987
.
[2]
Christopher K. I. Williams.
Computing with Infinite Networks
,
1996,
NIPS.
[3]
Peter Green,et al.
Markov chain Monte Carlo in Practice
,
1996
.
[4]
Heekuck Oh,et al.
Neural Networks for Pattern Recognition
,
1993,
Adv. Comput..
[5]
Geoffrey E. Hinton,et al.
Bayesian Learning for Neural Networks
,
1995
.
[6]
David J. C. MacKay,et al.
A Practical Bayesian Framework for Backpropagation Networks
,
1992,
Neural Computation.