Improved cross-entropy method for estimation

The cross-entropy (CE) method is an adaptive importance sampling procedure that has been successfully applied to a diverse range of complicated simulation problems. However, recent research has shown that in some high-dimensional settings, the likelihood ratio degeneracy problem becomes severe and the importance sampling estimator obtained from the CE algorithm becomes unreliable. We consider a variation of the CE method whose performance does not deteriorate as the dimension of the problem increases. We then illustrate the algorithm via a high-dimensional estimation problem in risk management.

[1]  Dirk P. Kroese,et al.  A Fast Cross-Entropy Method for Estimating Buffer Overflows in Queueing Networks , 2004, Manag. Sci..

[2]  Sandeep Juneja,et al.  Simulating heavy tailed processes using delayed hazard rate twisting (extended abstract) , 1999, SIGMETRICS Perform. Evaluation Rev..

[3]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[4]  Sandeep Juneja,et al.  Simulating heavy tailed processes using delayed hazard rate twisting , 1999, WSC '99.

[5]  Mansoor Shafi,et al.  Quick Simulation: A Review of Importance Sampling Techniques in Communications Systems , 1997, IEEE J. Sel. Areas Commun..

[6]  Dirk P. Kroese,et al.  The Cross Entropy Method: A Unified Approach To Combinatorial Optimization, Monte-carlo Simulation (Information Science and Statistics) , 2004 .

[7]  S. Chib,et al.  Marginal Likelihood From the Metropolis–Hastings Output , 2001 .

[8]  Geoffrey C. Orsak.  A note on estimating false alarm rates via importance sampling , 1993, IEEE Trans. Commun..

[9]  Dirk P. Kroese,et al.  The Transform Likelihood Ratio Method for Rare Event Simulation with Heavy Tails , 2004, Queueing Syst. Theory Appl..

[10]  Dirk P. Kroese,et al.  HEAVY TAILS, IMPORTANCE SAMPLING AND CROSS–ENTROPY , 2005 .

[11]  Peter W. Glynn,et al.  Stochastic Simulation: Algorithms and Analysis , 2007 .

[12]  Ad Ridder,et al.  Importance Sampling Simulations of Markovian Reliability Systems Using Cross-Entropy , 2005, Ann. Oper. Res..

[13]  Joshua C. C. Chan,et al.  Marginal Likelihood Estimation with the Cross-Entropy Method , 2012 .

[14]  A. Gelfand,et al.  Bayesian Model Choice: Asymptotics and Exact Calculations , 1994 .

[15]  Dirk P. Kroese,et al.  Rare-event probability estimation with conditional Monte Carlo , 2011, Ann. Oper. Res..

[16]  R. Rubinstein.  The Cross-Entropy Method for Combinatorial and Continuous Optimization , 1999 .

[17]  Peter W. Glynn,et al.  How to Deal with the Curse of Dimensionality of Likelihood Ratios in Monte Carlo Simulation , 2009 .

[18]  Miro Kraetzl,et al.  The Cross-Entropy Method for Network Reliability Estimation , 2005, Ann. Oper. Res..

[19]  Sandeep Juneja,et al.  Portfolio Credit Risk with Extremal Dependence: Asymptotic Analysis and Efficient Simulation , 2008, Oper. Res..

[20]  Dirk P. Kroese,et al.  The Cross-Entropy Method , 2011, Information Science and Statistics.

[21]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[22]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[23]  Lih-Yuan Deng,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning , 2006, Technometrics.

[24]  Anne Philippe,et al.  Simulation of right and left truncated gamma distributions by mixtures , 1997, Stat. Comput..

[25]  M. Newton.  Approximate Bayesian-inference With the Weighted Likelihood Bootstrap , 1994 .

[26]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[27]  Eric Moulines,et al.  Adaptive methods for sequential importance sampling with application to state space models , 2008, 2008 16th European Signal Processing Conference.

[28]  Peter W. Glynn,et al.  A comparison of cross-entropy and variance minimization strategies , 2011, Journal of Applied Probability.

[29]  Dirk P. Kroese,et al.  Cross‐Entropy Method , 2011 .

[30]  C. Robert.  Simulation of truncated normal variables , 2009, 0907.4010.

[31]  George Y. Sofronov,et al.  Adaptive independence samplers , 2008, Stat. Comput..

[32]  Dirk P. Kroese,et al.  Efficient estimation of large portfolio loss probabilities in t-copula models , 2010, Eur. J. Oper. Res..