We show how large improvements in the accuracy of MCMC estimates for posterior expectations can sometimes be obtained by coupling a Markov chain that samples from the posterior distribution with a chain that samples from a Gaussian approximation to the posterior. Use of this method requires a coupling scheme that produces high correlation between the two chains. An eecient estimator can then be constructed that exploits this correlation, provided an accurate value for the expectation under the Gaussian approximation can be found, which for simple functions can be done analytically. Good coupling schemes are available for many Markov chain samplers, including Gibbs sampling with standard conditional distributions. For many moderate-dimensional problems, the improvement in accuracy using this method will be much greater than the overhead from simulating a second chain.
[1]
Jørund Gåsemyr,et al.
Antithetic coupling of two Gibbs sampler chains
,
2000
.
[2]
Ronald A. Thisted,et al.
Elements of statistical computing
,
1986
.
[3]
J. Propp,et al.
Exact sampling with coupled Markov chains and applications to statistical mechanics
,
1996
.
[4]
Russell C. H. Cheng,et al.
Analysis of Simulation Experiments Under Normality Assumptions
,
1978
.
[5]
Mario Peruggia,et al.
On the variability of case-deletion importance sampling weights in the Bayesian linear model
,
1997
.
[6]
Adrian F. M. Smith,et al.
Sampling-Based Approaches to Calculating Marginal Densities
,
1990
.