IDEAS home Printed from https://ideas.repec.org/a/inm/orijoc/v32y4i2020p986-995.html
   My bibliography  Save this article

Sampling Conditionally on a Rare Event via Generalized Splitting

Author

Listed:
  • Zdravko I. Botev

    (University of New South Wales, Sydney, New South Wales 2052, Australia;)

  • Pierre L’Ecuyer

    (Université de Montréal, Montréal, Québec H3T 1J4, Canada)

Abstract

We propose and analyze a generalized splitting method to sample approximately from a distribution conditional on the occurrence of a rare event. This has important applications in a variety of contexts in operations research, engineering, and computational statistics. The method uses independent trials starting from a single particle. We exploit this independence to obtain asymptotic and nonasymptotic bounds on the total variation error of the sampler. Our main finding is that the approximation error depends crucially on the relative variability of the number of points produced by the splitting algorithm in one run and that this relative variability can be readily estimated via simulation. We illustrate the relevance of the proposed method on an application in which one needs to sample (approximately) from an intractable posterior density in Bayesian inference.

Suggested Citation

  • Zdravko I. Botev & Pierre L’Ecuyer, 2020. "Sampling Conditionally on a Rare Event via Generalized Splitting," INFORMS Journal on Computing, INFORMS, vol. 32(4), pages 986-995, October.
  • Handle: RePEc:inm:orijoc:v:32:y:4:i:2020:p:986-995
    DOI: 10.1287/ijoc.2019.0936
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/ijoc.2019.0936
    Download Restriction: no

    File URL: https://libkey.io/10.1287/ijoc.2019.0936?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Park, Trevor & Casella, George, 2008. "The Bayesian Lasso," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 681-686, June.
    2. Dean, Thomas & Dupuis, Paul, 2009. "Splitting for rare event simulation: A large deviation approach to design and analysis," Stochastic Processes and their Applications, Elsevier, vol. 119(2), pages 562-587, February.
    3. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    4. Paul Glasserman & Philip Heidelberger & Perwez Shahabuddin & Tim Zajic, 1999. "Multilevel Splitting for Estimating Rare Event Probabilities," Operations Research, INFORMS, vol. 47(4), pages 585-600, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gary Koop, 2012. "Using VARs and TVP-VARs with Many Macroeconomic Variables," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 4(3), pages 143-167, September.
    2. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    3. Jue Tao Lim & Yiting Han & Borame Sue Lee Dickens & Lee Ching Ng & Alex R Cook, 2020. "Time varying methods to infer extremes in dengue transmission dynamics," PLOS Computational Biology, Public Library of Science, vol. 16(10), pages 1-19, October.
    4. Cozzini, Alberto & Jasra, Ajay & Montana, Giovanni & Persing, Adam, 2014. "A Bayesian mixture of lasso regressions with t-errors," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 84-97.
    5. Thomas Dean & Paul Dupuis, 2011. "The design and analysis of a generalized RESTART/DPR algorithm for rare event simulation," Annals of Operations Research, Springer, vol. 189(1), pages 63-102, September.
    6. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2013. "Historical Developments in Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 13-191/III, Tinbergen Institute.
    7. Panayotis Michaelides & Mike Tsionas & Panos Xidonas, 2020. "A Bayesian Signals Approach for the Detection of Crises," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 18(3), pages 551-585, September.
    8. Vergé, Christelle & Morio, Jérôme & Moral, Pierre Del, 2016. "An island particle algorithm for rare event analysis," Reliability Engineering and System Safety, Elsevier, vol. 149(C), pages 63-75.
    9. Li, Chunyu & Lou, Chenxin & Luo, Dan & Xing, Kai, 2021. "Chinese corporate distress prediction using LASSO: The role of earnings management," International Review of Financial Analysis, Elsevier, vol. 76(C).
    10. Armagan, Artin & Dunson, David, 2011. "Sparse variational analysis of linear mixed models for large data sets," Statistics & Probability Letters, Elsevier, vol. 81(8), pages 1056-1062, August.
    11. S. Bogan Aruoba & Pablo Cuba-Borda & Kenji Higa-Flores & Frank Schorfheide & Sergio Villalvazo, 2021. "Piecewise-Linear Approximations and Filtering for DSGE Models with Occasionally Binding Constraints," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 41, pages 96-120, July.
    12. Arellano, Manuel & Blundell, Richard & Bonhomme, Stéphane & Light, Jack, 2024. "Heterogeneity of consumption responses to income shocks in the presence of nonlinear persistence," Journal of Econometrics, Elsevier, vol. 240(2).
    13. Joshua Chan & Arnaud Doucet & Roberto León-González & Rodney W. Strachan, 2018. "Multivariate Stochastic Volatility with Co-Heteroscedasticity," Working Paper series 18-38, Rimini Centre for Economic Analysis.
    14. Martin Feldkircher & Florian Huber & Gary Koop & Michael Pfarrhofer, 2022. "APPROXIMATE BAYESIAN INFERENCE AND FORECASTING IN HUGE‐DIMENSIONAL MULTICOUNTRY VARs," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1625-1658, November.
    15. McKinley, Trevelyan J. & Ross, Joshua V. & Deardon, Rob & Cook, Alex R., 2014. "Simulation-based Bayesian inference for epidemic models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 434-447.
    16. Fatma Başoğlu Kabran & Ali Devin Sezer, 2022. "Approximation of the exit probability of a stable Markov modulated constrained random walk," Annals of Operations Research, Springer, vol. 310(2), pages 431-475, March.
    17. Eliaz, Kfir & Spiegler, Ran, 2022. "On incentive-compatible estimators," Games and Economic Behavior, Elsevier, vol. 132(C), pages 204-220.
    18. Giesecke, K. & Schwenkler, G., 2019. "Simulated likelihood estimators for discretely observed jump–diffusions," Journal of Econometrics, Elsevier, vol. 213(2), pages 297-320.
    19. Oguzhan Cepni & I. Ethem Guney & Norman R. Swanson, 2020. "Forecasting and nowcasting emerging market GDP growth rates: The role of latent global economic policy uncertainty and macroeconomic data surprise factors," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(1), pages 18-36, January.
    20. Aruoba, S. Borağan & Bocola, Luigi & Schorfheide, Frank, 2017. "Assessing DSGE model nonlinearities," Journal of Economic Dynamics and Control, Elsevier, vol. 83(C), pages 34-54.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijoc:v:32:y:4:i:2020:p:986-995. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.