The Transform Likelihood Ratio Method for Rare Event Simulation with Heavy Tails

We present a novel method, called the transform likelihood ratio (TLR) method, for estimation of rare event probabilities with heavy-tailed distributions. Via a simple transformation (change of variables) technique the TLR method reduces the original rare event probability estimation with heavy tail distributions to an equivalent one with light tail distributions. Once this transformation has been established we estimate the rare event probability via importance sampling, using the classical exponential change of measure or the standard likelihood ratio change of measure. In the latter case the importance sampling distribution is chosen from the same parametric family as the transformed distribution. We estimate the optimal parameter vector of the importance sampling distribution using the cross-entropy method. We prove the polynomial complexity of the TLR method for certain heavy-tailed models and demonstrate numerically its high efficiency for various heavy-tailed models previously thought to be intractable. We also show that the TLR method can be viewed as a universal tool in the sense that not only it provides a unified view for heavy-tailed simulation but also can be efficiently used in simulation with light-tailed distributions. We present extensive simulation results which support the efficiency of the TLR method.

[1]  D. Siegmund Importance Sampling in the Monte Carlo Study of Sequential Tests , 1976 .

[2]  P. Embrechts,et al.  Estimates for the probability of ruin with special emphasis on the possibility of large claims , 1982 .

[3]  Sلأren Asmussen,et al.  Applied Probability and Queues , 1989 .

[4]  A. W. Kemp,et al.  Applied Probability and Queues , 1989 .

[5]  Donald L. Iglehart,et al.  Importance sampling for stochastic simulations , 1989 .

[6]  S. Asmussen,et al.  Applied Probability and Queues , 1989 .

[7]  John S. Sadowsky,et al.  On the optimality and stability of exponential twisting in Monte Carlo estimation , 1993, IEEE Trans. Inf. Theory.

[8]  J. Sadowsky On the Optimality and Stability of Exponential Twisting in Monte Carlo Estimation , 1993, Proceedings. IEEE International Symposium on Information Theory.

[9]  Perwez Shahabuddin Rare event simulation in stochastic models , 1995, WSC '95.

[10]  Philip Heidelberger,et al.  Fast simulation of rare events in queueing and reliability models , 1993, TOMC.

[11]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[12]  S. Asmussen,et al.  Simulation of Ruin Probabilities for Subexponential Claims , 1997, ASTIN Bulletin.

[13]  Reuven Y. Rubinstein,et al.  Modern simulation and modeling , 1998 .

[14]  R. Rubinstein The Cross-Entropy Method for Combinatorial and Continuous Optimization , 1999 .

[15]  P. Shahabuddin,et al.  Simulating heavy tailed processes using delayed hazard rate twisting , 1999, WSC'99. 1999 Winter Simulation Conference Proceedings. 'Simulation - A Bridge to the Future' (Cat. No.99CH37038).

[16]  S. Asmussen,et al.  Rare events simulation for heavy-tailed distributions , 2000 .

[17]  Pieter-Tjerk de Boer,et al.  Estimating buffer overflows in three stages using cross-entropy , 2002, Proceedings of the Winter Simulation Conference.

[18]  Reuven Y. Rubinstein,et al.  Rare event estimation for static models via cross-entropy and importance sampling , 2003 .

[19]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[20]  Dirk P. Kroese,et al.  The Cross Entropy Method: A Unified Approach To Combinatorial Optimization, Monte-carlo Simulation (Information Science and Statistics) , 2004 .

[21]  Dirk P. Kroese,et al.  A Fast Cross-Entropy Method for Estimating Buffer Overflows in Queueing Networks , 2004, Manag. Sci..

[22]  Dirk P. Kroese,et al.  HEAVY TAILS, IMPORTANCE SAMPLING AND CROSS–ENTROPY , 2005 .

[23]  D. M. Hutton,et al.  The Cross‐Entropy Method: A Unified Approach to Combinatorial Optimisation, Monte‐Carlo Simulation and Machine Learning , 2005 .