IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20240051.html
   My bibliography  Save this paper

Kullback-Leibler-based characterizations of score-driven updates

Author

Listed:
  • Ramon de Punder

    (University of Amsterdam and Tinbergen Institute)

  • Timo Dimitriadis

    (Heidelberg University and Heidelberg Institute for Theoretical Studies)

  • Rutger-Jan Lange

    (Erasmus University Rotterdam and Tinbergen Institute)

Abstract

Score-driven models have been applied in some 400 published articles over the last decade. Much of this literature cites the optimality result in Blasques et al. (2015), which, roughly, states that sufficiently small score-driven updates are unique in locally reducing the Kullback-Leibler divergence relative to the true density for every observation. This is at odds with other well-known optimality results; the Kalman filter, for example, is optimal in a mean-squared-error sense, but occasionally moves away from the true state. We show that score-driven updates are, similarly, not guaranteed to improve the localized Kullback-Leibler divergence at every observation. The seemingly stronger result in Blasques et al. (2015) is due to their use of an improper (localized) scoring rule. Even as a guaranteed improvement for every observation is unattainable, we prove that sufficiently small score-driven updates are unique in reducing the Kullback-Leibler divergence relative to the true density in expectation. This positive, albeit weaker, result justifies the continued use of score-driven models and places their information-theoretic properties on solid footing. In our numerical study, when there is less uncertainty: the second-best and third-best tolls achieve welfares closer to that of the first-best toll, and the three schemes become identical without uncertainty. As the degree of uncertainty falls, the uniform and single-step tolls attain higher welfare gains. Also, when demand becomes more price-sensitive, the uniform and single-step tolls attain relatively higher welfare gains. Our step toll would lower the generalised price without uncertainty but raises it in our stochastic setting.

Suggested Citation

  • Ramon de Punder & Timo Dimitriadis & Rutger-Jan Lange, 2024. "Kullback-Leibler-based characterizations of score-driven updates," Tinbergen Institute Discussion Papers 24-051/III, Tinbergen Institute, revised 22 Oct 2024.
  • Handle: RePEc:tin:wpaper:20240051
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/24051.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Blasques, F. & Francq, Christian & Laurent, Sébastien, 2023. "Quasi score-driven models," Journal of Econometrics, Elsevier, vol. 234(1), pages 251-275.
    2. Creal, Drew & Koopman, Siem Jan & Lucas, André & Zamojski, Marcin, 2024. "Observation-driven filtering of time-varying parameters using moment conditions," Journal of Econometrics, Elsevier, vol. 238(2).
    3. Vladimír Holý & Petra Tomanová, 2022. "Modeling price clustering in high-frequency prices," Quantitative Finance, Taylor & Francis Journals, vol. 22(9), pages 1649-1663, September.
    4. Luca Vincenzo Ballestra & Enzo D’Innocenzo & Andrea Guizzardi, 2024. "Score-Driven Modeling with Jumps: An Application to S&P500 Returns and Options," Journal of Financial Econometrics, Oxford University Press, vol. 22(2), pages 375-406.
    5. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    6. Yurii Nesterov, 2018. "Lectures on Convex Optimization," Springer Optimization and Its Applications, Springer, edition 2, number 978-3-319-91578-4, June.
    7. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    8. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    9. F. Blasques & S. J. Koopman & A. Lucas, 2015. "Information-theoretic optimality of observation-driven time series models for continuous responses," Biometrika, Biometrika Trust, vol. 102(2), pages 325-343.
    10. Blasques, Francisco & Lucas, André & van Vlodrop, Andries C., 2021. "Finite Sample Optimality of Score-Driven Volatility Models: Some Monte Carlo Evidence," Econometrics and Statistics, Elsevier, vol. 19(C), pages 47-57.
    11. Rutger-Jan Lange & Bram van Os & Dick van Dijk, 2022. "Implicit score-driven filters for time-varying parameter models," Tinbergen Institute Discussion Papers 22-066/III, Tinbergen Institute, revised 01 Jun 2024.
    12. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    13. Blasques, F. & Gorgi, P. & Koopman, S.J., 2019. "Accelerating score-driven time series models," Journal of Econometrics, Elsevier, vol. 212(2), pages 359-376.
    14. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    15. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    16. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Delle Monache, Davide & Petrella, Ivan, 2017. "Adaptive models and heavy tails with an application to inflation forecasting," International Journal of Forecasting, Elsevier, vol. 33(2), pages 482-501.
    2. Kapetanios, G. & Mitchell, J. & Price, S. & Fawcett, N., 2015. "Generalised density forecast combinations," Journal of Econometrics, Elsevier, vol. 188(1), pages 150-165.
    3. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    4. C. Alexander & M. Coulon & Y. Han & X. Meng, 2024. "Evaluating the discrimination ability of proper multi-variate scoring rules," Annals of Operations Research, Springer, vol. 334(1), pages 857-883, March.
    5. Patton, Andrew, 2013. "Copula Methods for Forecasting Multivariate Time Series," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 899-960, Elsevier.
    6. Diks, Cees & Fang, Hao, 2020. "Comparing density forecasts in a risk management context," International Journal of Forecasting, Elsevier, vol. 36(2), pages 531-551.
    7. Luisa Bisaglia & Matteo Grigoletto, 2018. "A new time-varying model for forecasting long-memory series," Papers 1812.07295, arXiv.org.
    8. Angelica Gianfreda & Francesco Ravazzolo & Luca Rossini, 2020. "Large Time-Varying Volatility Models for Electricity Prices," Working Papers No 05/2020, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    9. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    10. McDonald, Christopher & Thamotheram, Craig & Vahey, Shaun P. & Wakerly, Elizabeth C., 2015. "Assessing the Economic Value of Probabilistic Forecasts in the Presence of an Inflation Target," EMF Research Papers 09, Economic Modelling and Forecasting Group.
    11. Manzan, Sebastiano & Zerom, Dawit, 2013. "Are macroeconomic variables useful for forecasting the distribution of U.S. inflation?," International Journal of Forecasting, Elsevier, vol. 29(3), pages 469-478.
    12. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    13. Bjørnland, Hilde C. & Ravazzolo, Francesco & Thorsrud, Leif Anders, 2017. "Forecasting GDP with global components: This time is different," International Journal of Forecasting, Elsevier, vol. 33(1), pages 153-173.
    14. Ruben Loaiza‐Maya & Gael M. Martin & David T. Frazier, 2021. "Focused Bayesian prediction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 517-543, August.
    15. Elena Andreou & Andros Kourtellos, 2018. "Scoring rules for simple forecasting models: The case of Cyprus GDP and its sectors," Cyprus Economic Policy Review, University of Cyprus, Economics Research Centre, vol. 12(1), pages 59-73, June.
    16. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    17. Fabian Krüger & Sebastian Lerch & Thordis Thorarinsdottir & Tilmann Gneiting, 2021. "Predictive Inference Based on Markov Chain Monte Carlo Output," International Statistical Review, International Statistical Institute, vol. 89(2), pages 274-301, August.
    18. David T. Frazier & Ruben Loaiza-Maya & Gael M. Martin, 2021. "Variational Bayes in State Space Models: Inferential and Predictive Accuracy," Papers 2106.12262, arXiv.org, revised Feb 2022.
    19. Coe, Patrick J & Vahey, Shaun P., 2014. "Probablistic Prediction of the US Great Recession with Historical Expert," EMF Research Papers 06, Economic Modelling and Forecasting Group.
    20. Jonas R. Brehmer & Tilmann Gneiting, 2020. "Properization: constructing proper scoring rules via Bayes acts," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 659-673, June.

    More about this item

    Keywords

    generalized autoregressive score (GAS); dynamic conditional score (DCS); Kullback Leibler; censoring; scoring rule; divergence;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20240051. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.