IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20220066.html
   My bibliography  Save this paper

Implicit score-driven filters for time-varying parameter models

Author

Listed:
  • Rutger-Jan Lange

    (Erasmus University Rotterdam)

  • Bram van Os

    (Erasmus University Rotterdam)

  • Dick van Dijk

    (Erasmus University Rotterdam)

Abstract

We propose an observation-driven modeling framework that permits time variation in the model’s parameters using an implicit score-driven (ISD) update. The ISD update maximizes the observation log density with respect to the parameter vector, while penalizing the weighted l2 norm relative to the one-step-ahead prediction. This yields an implicit stochastic-gradient update; taking instead the explicit version produces the popular class of explicit score-driven (ESD) models. Specifically, we show that the ESD update arises as a linearization of the ISD update. By preserving the full density, the ISD update globalizes favorable local properties of the ESD update. Namely, for log-concave observation densities (even when misspecified), ISD models are stable for any learning rate and globally contractive to a pseudo-truth. We demonstrate the usefulness of ISD models in simulations and empirical illustrations for finance and macroeconomics.

Suggested Citation

  • Rutger-Jan Lange & Bram van Os & Dick van Dijk, 2022. "Implicit score-driven filters for time-varying parameter models," Tinbergen Institute Discussion Papers 22-066/III, Tinbergen Institute, revised 21 Nov 2024.
  • Handle: RePEc:tin:wpaper:20220066
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/22066.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Drew Creal & Bernd Schwaab & Siem Jan Koopman & Andr� Lucas, 2014. "Observation-Driven Mixed-Measurement Dynamic Factor Models with an Application to Credit Risk," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 898-915, December.
    2. Jagannathan, Ravi & Wang, Zhenyu, 1996. "The Conditional CAPM and the Cross-Section of Expected Returns," Journal of Finance, American Finance Association, vol. 51(1), pages 3-53, March.
    3. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024, January.
    4. Tata Subba Rao & Granville Tunnicliffe Wilson & Andrew Harvey & Rutger-Jan Lange, 2017. "Volatility Modeling with a Generalized t Distribution," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(2), pages 175-190, March.
    5. Blasques, Francisco & van Brummelen, Janneke & Koopman, Siem Jan & Lucas, André, 2022. "Maximum likelihood estimation for score-driven models," Journal of Econometrics, Elsevier, vol. 227(2), pages 325-346.
    6. Andrew Harvey & Alessandra Luati, 2014. "Filtering With Heavy Tails," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1112-1122, September.
    7. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    8. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    9. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    10. F. Blasques & S. J. Koopman & A. Lucas, 2015. "Information-theoretic optimality of observation-driven time series models for continuous responses," Biometrika, Biometrika Trust, vol. 102(2), pages 325-343.
    11. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    12. Panos Toulis & Thibaut Horel & Edoardo M. Airoldi, 2021. "The proximal Robbins–Monro method," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(1), pages 188-212, February.
    13. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    14. Anne Opschoor & Pawel Janus & André Lucas & Dick Van Dijk, 2018. "New HEAVY Models for Fat-Tailed Realized Covariances and Returns," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(4), pages 643-657, October.
    15. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ramon de Punder & Timo Dimitriadis & Rutger-Jan Lange, 2024. "Kullback-Leibler-based characterizations of score-driven updates," Papers 2408.02391, arXiv.org, revised Sep 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Bazzi & Francisco Blasques & Siem Jan Koopman & Andre Lucas, 2017. "Time-Varying Transition Probabilities for Markov Regime Switching Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(3), pages 458-478, May.
    2. Blasques, Francisco & Ji, Jiangyu & Lucas, André, 2016. "Semiparametric score driven volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 58-69.
    3. Mauro Bernardi & Leopoldo Catania, 2015. "Switching-GAS Copula Models With Application to Systemic Risk," Papers 1504.03733, arXiv.org, revised Jan 2016.
    4. Blasques, Francisco & van Brummelen, Janneke & Koopman, Siem Jan & Lucas, André, 2022. "Maximum likelihood estimation for score-driven models," Journal of Econometrics, Elsevier, vol. 227(2), pages 325-346.
    5. Caballero, Diego & Lucas, André & Schwaab, Bernd & Zhang, Xin, 2020. "Risk endogeneity at the lender/investor-of-last-resort," Journal of Monetary Economics, Elsevier, vol. 116(C), pages 283-297.
    6. Lucas, André & Zhang, Xin, 2016. "Score-driven exponentially weighted moving averages and Value-at-Risk forecasting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 293-302.
    7. F Blasques & P Gorgi & S J Koopman & O Wintenberger, 2016. "Feasible Invertibility Conditions for Maximum Likelihood Estimation for Observation-Driven Models ," Working Papers hal-01377971, HAL.
    8. Leopoldo Catania & Nima Nonejad, 2016. "Density Forecasts and the Leverage Effect: Some Evidence from Observation and Parameter-Driven Volatility Models," Papers 1605.00230, arXiv.org, revised Nov 2016.
    9. Michel Ferreira Cardia Haddad & Szabolcs Blazsek & Philip Arestis & Franz Fuerst & Hsia Hua Sheng, 2023. "The two-component Beta-t-QVAR-M-lev: a new forecasting model," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 37(4), pages 379-401, December.
    10. Mohamed Chikhi & Claude Diebolt & Tapas Mishra, 2019. "Memory that Drives! New Insights into Forecasting Performance of Stock Prices from SEMIFARMA-AEGAS Model," Working Papers of BETA 2019-24, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    11. F Blasques & P Gorgi & S Koopman & O Wintenberger, 2016. "Feasible Invertibility Conditions for Maximum Likelihood Estimation for Observation-Driven Models," Papers 1610.02863, arXiv.org.
    12. Gorgi, Paolo & Koopman, Siem Jan & Li, Mengheng, 2019. "Forecasting economic time series using score-driven dynamic models with mixed-data sampling," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1735-1747.
    13. Andre Lucas & Anne Opschoor, 2016. "Fractional Integration and Fat Tails for Realized Covariance Kernels and Returns," Tinbergen Institute Discussion Papers 16-069/IV, Tinbergen Institute, revised 07 Jul 2017.
    14. Mohamed Chikhi & Claude Diebolt & Tapas Mishra, 2019. "Measuring Success: Does Predictive Ability of an Asset Price Rest in 'Memory'? Insights from a New Approach," Working Papers 11-19, Association Française de Cliométrie (AFC).
    15. Blasques, Francisco & Koopman, Siem Jan & Lucas, Andre & Schaumburg, Julia, 2016. "Spillover dynamics for systemic risk measurement using spatial financial time series models," Journal of Econometrics, Elsevier, vol. 195(2), pages 211-223.
    16. Buccheri, Giuseppe & Corsi, Fulvio & Flandoli, Franco & Livieri, Giulia, 2021. "The continuous-time limit of score-driven volatility models," Journal of Econometrics, Elsevier, vol. 221(2), pages 655-675.
    17. Francisco Blasques & Paolo Gorgi & Siem Jan Koopman & Olivier Wintenberger, 2016. "Feasible Invertibility Conditions and Maximum Likelihood Estimation for Observation-Driven Models," Tinbergen Institute Discussion Papers 16-082/III, Tinbergen Institute.
    18. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Information Theoretic Optimality of Observation Driven Time Series Models," Tinbergen Institute Discussion Papers 14-046/III, Tinbergen Institute.
    19. Catania, Leopoldo & Grassi, Stefano, 2022. "Forecasting cryptocurrency volatility," International Journal of Forecasting, Elsevier, vol. 38(3), pages 878-894.
    20. Francisco (F.) Blasques & Andre (A.) Lucas & Andries van Vlodrop, 2017. "Finite Sample Optimality of Score-Driven Volatility Models," Tinbergen Institute Discussion Papers 17-111/III, Tinbergen Institute.

    More about this item

    Keywords

    Implicit gradient; Proximal-point method; Stochastic-gradient descent; Observation-driven models;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20220066. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.