IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v190y2016i1p133-147.html
   My bibliography  Save this article

Particle efficient importance sampling

Author

Listed:
  • Scharth, Marcel
  • Kohn, Robert

Abstract

The efficient importance sampling (EIS) method is a general principle for the numerical evaluation of high-dimensional integrals that uses the sequential structure of target integrands to build variance minimising importance samplers. Despite a number of successful applications in high dimensions, it is well known that importance sampling strategies are subject to an exponential growth in variance as the dimension of the integration increases. We solve this problem by recognising that the EIS framework has an offline sequential Monte Carlo interpretation. The particle EIS method is based on non-standard resampling weights that take into account the construction of the importance sampler as a sequential approximation to the state smoothing density. We apply the method for a range of univariate and bivariate stochastic volatility specifications. We also develop a new application of the EIS approach to state space models with Student’s t state innovations. Our results show that the particle EIS method strongly outperforms both the standard EIS method and particle filters for likelihood evaluation in high dimensions. We illustrate the efficiency of the method for Bayesian inference using the particle marginal Metropolis–Hastings and importance sampling squared algorithms.

Suggested Citation

  • Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    • Handle: RePEc:eee:econom:v:190:y:2016:i:1:p:133-147
    DOI: 10.1016/j.jeconom.2015.03.047
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407615002201
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jeconom.2015.03.047?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    2. Godsill, Simon J. & Doucet, Arnaud & West, Mike, 2004. "Monte Carlo Smoothing for Nonlinear Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 156-168, January.
    3. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    4. Liesenfeld, Roman & Richard, Jean-François & Vogler, Jan, 2013. "Analysis of discrete dependent variable models with spatial correlation," Economics Working Papers 2013-01, Christian-Albrechts-University of Kiel, Department of Economics.
    5. Koopman, Siem Jan & Shephard, Neil & Creal, Drew, 2009. "Testing the assumptions behind importance sampling," Journal of Econometrics, Elsevier, vol. 149(1), pages 2-11, April.
    6. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    7. Bauwens, L. & Galli, F., 2009. "Efficient importance sampling for ML estimation of SCD models," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 1974-1992, April.
    8. Paul Fearnhead & David Wyncoll & Jonathan Tawn, 2010. "A sequential smoothing algorithm with linear computational cost," Biometrika, Biometrika Trust, vol. 97(2), pages 447-464.
    9. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(2), pages 247-264.
    10. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    11. Liesenfeld, Roman & Richard, Jean-Francois, 2003. "Univariate and multivariate stochastic volatility models: estimation and diagnostics," Journal of Empirical Finance, Elsevier, vol. 10(4), pages 505-531, September.
    12. Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
    13. Liesenfeld, Roman & Richard, Jean-François, 2010. "Efficient estimation of probit models with correlated errors," Journal of Econometrics, Elsevier, vol. 156(2), pages 367-376, June.
    14. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    15. repec:wyi:journl:002173 is not listed on IDEAS
    16. Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2012. "A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation," Journal of Econometrics, Elsevier, vol. 171(2), pages 101-120.
    17. Flury, Thomas & Shephard, Neil, 2011. "Bayesian Inference Based Only On Simulated Likelihood: Particle Filter Analysis Of Dynamic Economic Models," Econometric Theory, Cambridge University Press, vol. 27(5), pages 933-956, October.
    18. Pitt, Michael K., 2002. "Smooth particle filters for likelihood evaluation and maximisation," Economic Research Papers 269464, University of Warwick - Department of Economics.
    19. Pitt, Michael K, 2002. "Smooth Particle Filters for Likelihood Evaluation and Maximisation," The Warwick Economics Research Paper Series (TWERPS) 651, University of Warwick, Department of Economics.
    20. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    21. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    22. Kleppe, Tore Selland & Liesenfeld, Roman, 2014. "Efficient importance sampling in mixture frameworks," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 449-463.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mao, Xiuping & Czellar, Veronika & Ruiz, Esther & Veiga, Helena, 2020. "Asymmetric stochastic volatility models: Properties and particle filter-based simulated maximum likelihood estimation," Econometrics and Statistics, Elsevier, vol. 13(C), pages 84-105.
    2. Sergei Seleznev, 2016. "Solving DSGE models with stochastic trends," Bank of Russia Working Paper Series wps15, Bank of Russia.
    3. Rub'en Loaiza-Maya & Didier Nibbering, 2022. "Efficient variational approximations for state space models," Papers 2210.11010, arXiv.org, revised Jun 2023.
    4. Smith, Michael Stanley & Maneesoonthorn, Worapree, 2018. "Inversion copulas from nonlinear state space models with an application to inflation forecasting," International Journal of Forecasting, Elsevier, vol. 34(3), pages 389-407.
    5. Mengheng Li & Marcel Scharth, 2022. "Leverage, Asymmetry, and Heavy Tails in the High-Dimensional Factor Stochastic Volatility Model," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 285-301, January.
    6. Andras Fulop & Jeremy Heng & Junye Li, 2022. "Efficient Likelihood-based Estimation via Annealing for Dynamic Structural Macrofinance Models," Papers 2201.01094, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    2. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    3. Siem Jan Koopman & Rutger Lit & André Lucas, 2014. "The Dynamic Skellam Model with Applications," Tinbergen Institute Discussion Papers 14-032/IV/DSF73, Tinbergen Institute, revised 06 Jul 2015.
    4. Mesters, G. & Koopman, S.J., 2014. "Generalized dynamic panel data models with random effects for cross-section and time," Journal of Econometrics, Elsevier, vol. 180(2), pages 127-140.
    5. Siem Jan Koopman & Rutger Lit & André Lucas, 2017. "Intraday Stochastic Volatility in Discrete Price Changes: The Dynamic Skellam Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1490-1503, October.
    6. Siem Jan Koopman & Rutger Lit & Thuy Minh Nguyen, 2012. "Fast Efficient Importance Sampling by State Space Methods," Tinbergen Institute Discussion Papers 12-008/4, Tinbergen Institute, revised 16 Oct 2014.
    7. Kleppe, Tore Selland & Liesenfeld, Roman, 2014. "Efficient importance sampling in mixture frameworks," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 449-463.
    8. Mengheng Li & Siem Jan (S.J.) Koopman, 2018. "Unobserved Components with Stochastic Volatility in U.S. Inflation: Estimation and Signal Extraction," Tinbergen Institute Discussion Papers 18-027/III, Tinbergen Institute.
    9. Falk Bräuning & Siem Jan Koopman, 2016. "The dynamic factor network model with an application to global credit risk," Working Papers 16-13, Federal Reserve Bank of Boston.
    10. István Barra & Lennart Hoogerheide & Siem Jan Koopman & André Lucas, 2017. "Joint Bayesian Analysis of Parameters and States in Nonlinear non‐Gaussian State Space Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(5), pages 1003-1026, August.
    11. Baştürk, N. & Borowska, A. & Grassi, S. & Hoogerheide, L. & van Dijk, H.K., 2019. "Forecast density combinations of dynamic models and data driven portfolio strategies," Journal of Econometrics, Elsevier, vol. 210(1), pages 170-186.
    12. Rutger Jan Lange, 2020. "Bellman filtering for state-space models," Tinbergen Institute Discussion Papers 20-052/III, Tinbergen Institute, revised 19 May 2021.
    13. Kleppe, Tore Selland & Yu, Jun & Skaug, Hans J., 2014. "Maximum likelihood estimation of partially observed diffusion models," Journal of Econometrics, Elsevier, vol. 180(1), pages 73-80.
    14. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    15. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    16. Bräuning, Falk & Koopman, Siem Jan, 2020. "The dynamic factor network model with an application to international trade," Journal of Econometrics, Elsevier, vol. 216(2), pages 494-515.
    17. Kleppe, Tore Selland & Liesenfeld, Roman, 2011. "Efficient high-dimensional importance sampling in mixture frameworks," Economics Working Papers 2011-11, Christian-Albrechts-University of Kiel, Department of Economics.
    18. Mao, Xiuping & Czellar, Veronika & Ruiz, Esther & Veiga, Helena, 2020. "Asymmetric stochastic volatility models: Properties and particle filter-based simulated maximum likelihood estimation," Econometrics and Statistics, Elsevier, vol. 13(C), pages 84-105.
    19. Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    20. Tsyplakov, Alexander, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models," MPRA Paper 25511, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:190:y:2016:i:1:p:133-147. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.