IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v47y2020i4p1339-1376.html
   My bibliography  Save this article

Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo

Author

Listed:
  • Matti Vihola
  • Jouni Helske
  • Jordan Franks

Abstract

We consider importance sampling (IS) type weighted estimators based on Markov chain Monte Carlo (MCMC) targeting an approximate marginal of the target distribution. In the context of Bayesian latent variable models, the MCMC typically operates on the hyperparameters, and the subsequent weighting may be based on IS or sequential Monte Carlo (SMC), but allows for multilevel techniques as well. The IS approach provides a natural alternative to delayed acceptance (DA) pseudo‐marginal/particle MCMC, and has many advantages over DA, including a straightforward parallelization and additional flexibility in MCMC implementation. We detail minimal conditions which ensure strong consistency of the suggested estimators, and provide central limit theorems with expressions for asymptotic variances. We demonstrate how our method can make use of SMC in the state space models context, using Laplace approximations and time‐discretized diffusions. Our experimental results are promising and show that the IS‐type approach can provide substantial gains relative to an analogous DA scheme, and is often competitive even without parallelization.

Suggested Citation

  • Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    • Handle: RePEc:bla:scjsta:v:47:y:2020:i:4:p:1339-1376
    DOI: 10.1111/sjos.12492
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/sjos.12492
    Download Restriction: no
    File URL: https://libkey.io/10.1111/sjos.12492?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Pierre E. Jacob & Fredrik Lindsten & Thomas B. Schön, 2020. "Smoothing With Couplings of Conditional Particle Filters," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 721-729, April.
    3. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    4. Alexandros Beskos & Omiros Papaspiliopoulos & Gareth O. Roberts & Paul Fearnhead, 2006. "Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 333-382, June.
    5. Godsill, Simon J. & Doucet, Arnaud & West, Mike, 2004. "Monte Carlo Smoothing for Nonlinear Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 156-168, January.
    6. Søren F. Jarner & Gareth O. Roberts, 2007. "Convergence of Heavy‐tailed Monte Carlo Markov Chain Algorithms," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 781-815, December.
    7. H. E. Ogden, 2017. "On asymptotic validity of naive inference with an approximate likelihood," Biometrika, Biometrika Trust, vol. 104(1), pages 153-164.
    8. Michael B. Giles, 2008. "Multilevel Monte Carlo Path Simulation," Operations Research, INFORMS, vol. 56(3), pages 607-617, June.
    9. McLeish, Don, 2011. "A general method for debiasing a Monte Carlo estimator," Monte Carlo Methods and Applications, De Gruyter, vol. 17(4), pages 301-315, December.
    10. Koopman, Siem Jan & Shephard, Neil & Creal, Drew, 2009. "Testing the assumptions behind importance sampling," Journal of Econometrics, Elsevier, vol. 149(1), pages 2-11, April.
    11. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    12. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    13. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    14. Fredrik Lindsten & Randal Douc & Eric Moulines, 2015. "Uniform Ergodicity of the Particle Gibbs Sampler," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(3), pages 775-797, September.
    15. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    16. Peter W. Glynn & Donald L. Iglehart, 1989. "Importance Sampling for Stochastic Simulations," Management Science, INFORMS, vol. 35(11), pages 1367-1392, November.
    17. Anthony Lee & Krzysztof Łatuszyński, 2014. "Variance bounding and geometric ergodicity of Markov chain Monte Carlo kernels for approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 101(3), pages 655-671.
    18. Jarner, Søren Fiig & Hansen, Ernst, 2000. "Geometric ergodicity of Metropolis algorithms," Stochastic Processes and their Applications, Elsevier, vol. 85(2), pages 341-361, February.
    19. Bhattacharya, Sourabh, 2008. "Consistent estimation of the accuracy of importance sampling using regenerative simulation," Statistics & Probability Letters, Elsevier, vol. 78(15), pages 2522-2527, October.
    20. S S Singh & F Lindsten & E Moulines, 2017. "Blocking strategies and stability of particle Gibbs samplers," Biometrika, Biometrika Trust, vol. 104(4), pages 953-969.
    21. Chris Sherlock & Alexandre H. Thiery & Anthony Lee, 2017. "Pseudo-marginal Metropolis–Hastings sampling using averages of unbiased estimators," Biometrika, Biometrika Trust, vol. 104(3), pages 727-734.
    22. Matti Vihola & Jordan Franks, 2020. "On the use of approximate Bayesian computation Markov chain Monte Carlo with inflated tolerance and post-correction," Biometrika, Biometrika Trust, vol. 107(2), pages 381-395.
    23. Peter W. Glynn & Ward Whitt, 1992. "The Asymptotic Efficiency of Simulation Estimators," Operations Research, INFORMS, vol. 40(3), pages 505-520, June.
    24. Chang-Han Rhee & Peter W. Glynn, 2015. "Unbiased Estimation with Square Root Convergence for SDE Models," Operations Research, INFORMS, vol. 63(5), pages 1026-1043, October.
    25. George Deligiannidis & Arnaud Doucet & Michael K. Pitt, 2018. "The correlated pseudomarginal method," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(5), pages 839-870, November.
    26. Pierre E. Jacob & John O’Leary & Yves F. Atchadé, 2020. "Unbiased Markov chain Monte Carlo methods with couplings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 543-600, July.
    27. A. Doucet & M. K. Pitt & G. Deligiannidis & R. Kohn, 2015. "Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator," Biometrika, Biometrika Trust, vol. 102(2), pages 295-313.
    28. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    29. Pieralberto Guarniero & Adam M. Johansen & Anthony Lee, 2017. "The Iterated Auxiliary Particle Filter," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1636-1647, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    2. Ajay Jasra & Kody Law & Carina Suciu, 2020. "Advanced Multilevel Monte Carlo Methods," International Statistical Review, International Statistical Institute, vol. 88(3), pages 548-579, December.
    3. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    4. Matias Quiroz & Mattias Villani & Robert Kohn & Minh-Ngoc Tran & Khue-Dung Dang, 2018. "Subsampling MCMC - an Introduction for the Survey Statistician," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 33-69, December.
    5. Franks, Jordan & Vihola, Matti, 2020. "Importance sampling correction versus standard averages of reversible MCMCs in terms of the asymptotic variance," Stochastic Processes and their Applications, Elsevier, vol. 130(10), pages 6157-6183.
    6. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.
    7. Gael M. Martin & David T. Frazier & Christian P. Robert, 2022. "Computing Bayes: From Then `Til Now," Monash Econometrics and Business Statistics Working Papers 14/22, Monash University, Department of Econometrics and Business Statistics.
    8. Johan Dahlin & Thomas B. Schon, 2015. "Getting Started with Particle Metropolis-Hastings for Inference in Nonlinear Dynamical Models," Papers 1511.01707, arXiv.org, revised Mar 2019.
    9. Pierre E. Jacob & John O’Leary & Yves F. Atchadé, 2020. "Unbiased Markov chain Monte Carlo methods with couplings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 543-600, July.
    10. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    11. Mesters, G. & Koopman, S.J., 2014. "Generalized dynamic panel data models with random effects for cross-section and time," Journal of Econometrics, Elsevier, vol. 180(2), pages 127-140.
    12. Mengheng Li & Siem Jan Koopman, 2021. "Unobserved components with stochastic volatility: Simulation‐based estimation and signal extraction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 614-627, August.
    13. Andras Fulop & Jeremy Heng & Junye Li, 2022. "Efficient Likelihood-based Estimation via Annealing for Dynamic Structural Macrofinance Models," Papers 2201.01094, arXiv.org.
    14. Golightly, Andrew & Bradley, Emma & Lowe, Tom & Gillespie, Colin S., 2019. "Correlated pseudo-marginal schemes for time-discretised stochastic kinetic models," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 92-107.
    15. Fredrik Lindsten & Randal Douc & Eric Moulines, 2015. "Uniform Ergodicity of the Particle Gibbs Sampler," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(3), pages 775-797, September.
    16. Cui, Zhenyu & Fu, Michael C. & Peng, Yijie & Zhu, Lingjiong, 2020. "Optimal unbiased estimation for expected cumulative discounted cost," European Journal of Operational Research, Elsevier, vol. 286(2), pages 604-618.
    17. Gareth W. Peters & Rodrigo S. Targino & Mario V. Wüthrich, 2017. "Bayesian Modelling, Monte Carlo Sampling and Capital Allocation of Insurance Risks," Risks, MDPI, vol. 5(4), pages 1-51, September.
    18. Zhou, Zhengqing & Wang, Guanyang & Blanchet, Jose H. & Glynn, Peter W., 2023. "Unbiased Optimal Stopping via the MUSE," Stochastic Processes and their Applications, Elsevier, vol. 166(C).
    19. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    20. Dang, Khue-Dung & Quiroz, Matias & Kohn, Robert & Tran, Minh-Ngoc & Villani, Mattias, 2019. "Hamiltonian Monte Carlo with Energy Conserving Subsampling," Working Paper Series 372, Sveriges Riksbank (Central Bank of Sweden).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:47:y:2020:i:4:p:1339-1376. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.