IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v4y2016i1p12-d65253.html
   My bibliography  Save this article

Evolutionary Sequential Monte Carlo Samplers for Change-Point Models

Author

Listed:
  • Arnaud Dufays

    (Department of Economics, Laval University, 2216 Pavillon J.-A.-DeSève, QC G1V 0A6, Canada)

Abstract

Sequential Monte Carlo (SMC) methods are widely used for non-linear filtering purposes. However, the SMC scope encompasses wider applications such as estimating static model parameters so much that it is becoming a serious alternative to Markov-Chain Monte-Carlo (MCMC) methods. Not only do SMC algorithms draw posterior distributions of static or dynamic parameters but additionally they provide an estimate of the marginal likelihood. The tempered and time (TNT) algorithm, developed in this paper, combines (off-line) tempered SMC inference with on-line SMC inference for drawing realizations from many sequential posterior distributions without experiencing a particle degeneracy problem. Furthermore, it introduces a new MCMC rejuvenation step that is generic, automated and well-suited for multi-modal distributions. As this update relies on the wide heuristic optimization literature, numerous extensions are readily available. The algorithm is notably appropriate for estimating change-point models. As an example, we compare several change-point GARCH models through their marginal log-likelihoods over time.

Suggested Citation

  • Arnaud Dufays, 2016. "Evolutionary Sequential Monte Carlo Samplers for Change-Point Models," Econometrics, MDPI, vol. 4(1), pages 1-33, March.
    • Handle: RePEc:gam:jecnmx:v:4:y:2016:i:1:p:12-:d:65253
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/4/1/12/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2225-1146/4/1/12/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bauwens, Luc & Dufays, Arnaud & Rombouts, Jeroen V.K., 2014. "Marginal likelihood for Markov-switching and change-point GARCH models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 508-522.
    2. John Geweke, "undated". "Posterior Simulators in Econometrics," Computing in Economics and Finance 1996 _019, Society for Computational Economics.
    3. Garland Durham & John Geweke, 2014. "Adaptive Sequential Posterior Simulators for Massively Parallel Computing Environments," Advances in Econometrics, in: Bayesian Model Comparison, volume 34, pages 1-44, Emerald Group Publishing Limited.
    4. repec:dau:papers:123456789/7305 is not listed on IDEAS
    5. Chib, Siddhartha, 1998. "Estimation and comparison of multiple change-point models," Journal of Econometrics, Elsevier, vol. 86(2), pages 221-241, June.
    6. Edward Herbst & Frank Schorfheide, 2014. "Sequential Monte Carlo Sampling For Dsge Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1073-1098, November.
    7. Nicolas Chopin, 2002. "A sequential particle filter method for static models," Biometrika, Biometrika Trust, vol. 89(3), pages 539-552, August.
    8. He, Zhongfang & Maheu, John M., 2010. "Real time detection of structural breaks in GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2628-2640, November.
    9. Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2002. "Markov chain Monte Carlo methods for stochastic volatility models," Journal of Econometrics, Elsevier, vol. 108(2), pages 281-316, June.
    10. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    11. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    12. Fulop, Andras & Li, Junye, 2013. "Efficient learning via simulation: A marginalized resample-move approach," Journal of Econometrics, Elsevier, vol. 176(2), pages 146-161.
    13. BAUWENS, Luc & DUFAYS, Arnaud & DE BACKER, Bruno, 2011. "Estimating and forecasting structural breaks in financial time series," LIDAM Discussion Papers CORE 2011055, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    14. N. Chopin & P. E. Jacob & O. Papaspiliopoulos, 2013. "SMC-super-2: an efficient algorithm for sequential analysis of state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 397-426, June.
    15. Ajay Jasra & David A. Stephens & Arnaud Doucet & Theodoros Tsagaris, 2011. "Inference for Lévy‐Driven Stochastic Volatility Models via Adaptive Sequential Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 38(1), pages 1-22, March.
    16. Ko, Stanley I. M. & Chong, Terence T. L. & Ghosh, Pulak, 2014. "Dirichlet Process Hidden Markov Multiple Change-point Model," MPRA Paper 57871, University Library of Munich, Germany.
    17. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dufays, Arnaud & Rombouts, Jeroen V.K., 2020. "Relevant parameter changes in structural break models," Journal of Econometrics, Elsevier, vol. 217(1), pages 46-78.
    2. Arnaud Dufays & Jeroen V. K. Rombouts, 2019. "Sparse Change-point HAR Models for Realized Variance," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 857-880, September.
    3. Speich, Matthias & Dormann, Carsten F. & Hartig, Florian, 2021. "Sequential Monte-Carlo algorithms for Bayesian model calibration – A review and method comparison✰," Ecological Modelling, Elsevier, vol. 455(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arnaud Dufays, 2014. "On the conjugacy of off-line and on-line Sequential Monte Carlo Samplers," Working Paper Research 263, National Bank of Belgium.
    2. Herbst, Edward & Schorfheide, Frank, 2019. "Tempered particle filtering," Journal of Econometrics, Elsevier, vol. 210(1), pages 26-44.
    3. Geweke, John & Durham, Garland, 2019. "Sequentially adaptive Bayesian learning algorithms for inference and optimization," Journal of Econometrics, Elsevier, vol. 210(1), pages 4-25.
    4. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    5. Michael Cai & Marco Del Negro & Edward Herbst & Ethan Matlin & Reca Sarfati & Frank Schorfheide, 2021. "Online estimation of DSGE models," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 33-58.
    6. Huang, Jing-Zhi & Ni, Jun & Xu, Li, 2022. "Leverage effect in cryptocurrency markets," Pacific-Basin Finance Journal, Elsevier, vol. 73(C).
    7. Nonejad, Nima, 2017. "Parameter instability, stochastic volatility and estimation based on simulated likelihood: Evidence from the crude oil market," Economic Modelling, Elsevier, vol. 61(C), pages 388-408.
    8. Markku Lanne & Jani Luoto, 2015. "Estimation of DSGE Models under Diffuse Priors and Data-Driven Identification Constraints," CREATES Research Papers 2015-37, Department of Economics and Business Economics, Aarhus University.
    9. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    10. Gareth W. Peters & Rodrigo S. Targino & Mario V. Wüthrich, 2017. "Bayesian Modelling, Monte Carlo Sampling and Capital Allocation of Insurance Risks," Risks, MDPI, vol. 5(4), pages 1-51, September.
    11. Dufays, A. & Rombouts, V., 2015. "Sparse Change-Point Time Series Models," LIDAM Discussion Papers CORE 2015032, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    12. Ajay Jasra & Kody Law & Carina Suciu, 2020. "Advanced Multilevel Monte Carlo Methods," International Statistical Review, International Statistical Institute, vol. 88(3), pages 548-579, December.
    13. Marko Mlikota & Frank Schorfheide, 2022. "Sequential Monte Carlo With Model Tempering," Papers 2202.07070, arXiv.org.
    14. Naoki Awaya & Yasuhiro Omori, 2021. "Particle Rolling MCMC with Double-Block Sampling ," CIRJE F-Series CIRJE-F-1175, CIRJE, Faculty of Economics, University of Tokyo.
    15. Xiaohong Chen & Timothy M. Christensen & Elie Tamer, 2018. "Monte Carlo Confidence Sets for Identified Sets," Econometrica, Econometric Society, vol. 86(6), pages 1965-2018, November.
    16. Hirokuni Iiboshi & Mototsugu Shintani & Kozo Ueda, 2022. "Estimating a Nonlinear New Keynesian Model with the Zero Lower Bound for Japan," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(6), pages 1637-1671, September.
    17. Dufays, Arnaud & Rombouts, Jeroen V.K., 2020. "Relevant parameter changes in structural break models," Journal of Econometrics, Elsevier, vol. 217(1), pages 46-78.
    18. Markku Lanne & Jani Luoto, 2018. "Data†Driven Identification Constraints for DSGE Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(2), pages 236-258, April.
    19. Lau, F. Din-Houn & Gandy, Axel, 2014. "RMCMC: A system for updating Bayesian models," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 99-110.
    20. Luc Bauwens & Jean-François Carpantier & Arnaud Dufays, 2017. "Autoregressive Moving Average Infinite Hidden Markov-Switching Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 162-182, April.

    More about this item

    Keywords

    bayesian inference; sequential monte carlo; annealed importance sampling; change-point models; differential evolution; GARCH models;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:4:y:2016:i:1:p:12-:d:65253. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.