IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20120008.html
   My bibliography  Save this paper

Fast Efficient Importance Sampling by State Space Methods

Author

Listed:
  • Siem Jan Koopman

    (VU University Amsterdam, the Netherlands)

  • Rutger Lit

    (VU University Amsterdam, the Netherlands)

  • Thuy Minh Nguyen

    (Deutsche Bank, London, United Kingdom)

Abstract

This version has replaced the version of January 30, 2012. A successful construction of an importance density for nonlinear non-Gaussian state space models is crucial when Monte Carlo simulation methods are used for likelihood evaluation, signal extraction of dynamic latent factors and forecasting. The method of efficient importance sampling is successful in this respect but we show that it can be implemented more conveniently using standard Kalman filter and smoothing methods. We further obtain computational gains by simulating directly from the signal equation rather than simulating from the usually higher dimensional state equation. Our results provide some new insights but they primarily lead to a more simple and fast method for efficient importance sampling. In a simulation study we provide some evidence of the computational gains. Our new methods are illustrated for a stochastic volatility model with a Student's t distribution.

Suggested Citation

  • Siem Jan Koopman & Rutger Lit & Thuy Minh Nguyen, 2012. "Fast Efficient Importance Sampling by State Space Methods," Tinbergen Institute Discussion Papers 12-008/4, Tinbergen Institute, revised 16 Oct 2014.
  • Handle: RePEc:tin:wpaper:20120008
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/12008.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jung, Robert C. & Liesenfeld, Roman & Richard, Jean-François, 2011. "Dynamic Factor Models for Multivariate Count Data: An Application to Stock-Market Trading Activity," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 73-85.
    2. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    3. Robert C. Jung & Roman Liesenfeld & Jean-François Richard, 2011. "Dynamic Factor Models for Multivariate Count Data: An Application to Stock-Market Trading Activity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 73-85, January.
    4. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    5. Liesenfeld, Roman & Richard, Jean-Francois, 2003. "Univariate and multivariate stochastic volatility models: estimation and diagnostics," Journal of Empirical Finance, Elsevier, vol. 10(4), pages 505-531, September.
    6. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 297-316, July.
    7. Siem Jan Koopman & Marcel Scharth, 2012. "The Analysis of Stochastic Volatility in the Presence of Daily Realized Measures," Journal of Financial Econometrics, Oxford University Press, vol. 11(1), pages 76-115, December.
    8. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    9. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
    10. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 335-338, July.
    11. Borus Jungbacker & Siem Jan Koopman, 2007. "Monte Carlo Estimation for Nonlinear Non-Gaussian State Space Models," Biometrika, Biometrika Trust, vol. 94(4), pages 827-839.
    12. Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
    13. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    14. Danielsson, J & Richard, J-F, 1993. "Accelerated Gaussian Importance Sampler with Application to Dynamic Latent Variable Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 153-173, Suppl. De.
    15. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    16. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    17. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    2. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    3. Koopman, Siem Jan & Shephard, Neil & Creal, Drew, 2009. "Testing the assumptions behind importance sampling," Journal of Econometrics, Elsevier, vol. 149(1), pages 2-11, April.
    4. Mengheng Li & Siem Jan (S.J.) Koopman, 2018. "Unobserved Components with Stochastic Volatility in U.S. Inflation: Estimation and Signal Extraction," Tinbergen Institute Discussion Papers 18-027/III, Tinbergen Institute.
    5. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    6. Kleppe, Tore Selland & Liesenfeld, Roman, 2014. "Efficient importance sampling in mixture frameworks," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 449-463.
    7. Falk Bräuning & Siem Jan Koopman, 2016. "The dynamic factor network model with an application to global credit risk," Working Papers 16-13, Federal Reserve Bank of Boston.
    8. Mesters, G. & Koopman, S.J., 2014. "Generalized dynamic panel data models with random effects for cross-section and time," Journal of Econometrics, Elsevier, vol. 180(2), pages 127-140.
    9. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    10. Siem Jan Koopman & Rutger Lit & André Lucas, 2017. "Intraday Stochastic Volatility in Discrete Price Changes: The Dynamic Skellam Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1490-1503, October.
    11. Siem Jan Koopman & Rutger Lit & André Lucas, 2014. "The Dynamic Skellam Model with Applications," Tinbergen Institute Discussion Papers 14-032/IV/DSF73, Tinbergen Institute, revised 06 Jul 2015.
    12. Bräuning, Falk & Koopman, Siem Jan, 2020. "The dynamic factor network model with an application to international trade," Journal of Econometrics, Elsevier, vol. 216(2), pages 494-515.
    13. Tsyplakov, Alexander, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models," MPRA Paper 25511, University Library of Munich, Germany.
    14. Tommaso Proietti & Alessandra Luati, 2013. "Maximum likelihood estimation of time series models: the Kalman filter and beyond," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 15, pages 334-362, Edward Elgar Publishing.
    15. Borus Jungbacker & Siem Jan Koopman, 2005. "On Importance Sampling for State Space Models," Tinbergen Institute Discussion Papers 05-117/4, Tinbergen Institute.
    16. Pastorello, S. & Rossi, E., 2010. "Efficient importance sampling maximum likelihood estimation of stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2753-2762, November.
    17. G. Mesters & S. J. Koopman & M. Ooms, 2016. "Monte Carlo Maximum Likelihood Estimation for Generalized Long-Memory Time Series Models," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 659-687, April.
    18. Siem Jan Koopman & Charles S. Bos, 2002. "Time Series Models with a Common Stochastic Variance for Analysing Economic Time Series," Tinbergen Institute Discussion Papers 02-113/4, Tinbergen Institute.
    19. Kleppe, Tore Selland & Yu, Jun & Skaug, Hans J., 2014. "Maximum likelihood estimation of partially observed diffusion models," Journal of Econometrics, Elsevier, vol. 180(1), pages 73-80.
    20. Kleppe, Tore Selland & Liesenfeld, Roman, 2011. "Efficient high-dimensional importance sampling in mixture frameworks," Economics Working Papers 2011-11, Christian-Albrechts-University of Kiel, Department of Economics.

    More about this item

    Keywords

    Kalman filter; Monte Carlo maximum likelihood; Simulation smoothing;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20120008. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.