IDEAS home Printed from https://ideas.repec.org/p/zbw/bubdp1/4173.html
   My bibliography  Save this paper

Evaluating Density Forecasts with an Application to Stock Market Returns

Author

Listed:
  • Raunig, Burkhard
  • de Raaij, Gabriela

Abstract

Density forecasts have become quite important in economics and finance. For example, such forecasts play a central role in modern financial risk management techniques like Value at Risk. This paper suggests a regression based density forecast evaluation framework as a simple alternative to other approaches. In simulation experiments and an empirical application to in- and out-of-sample one-step-ahead density forecasts of daily returns on the S&P 500, DAX and ATX stock market indices, the regression based evaluation strategy is compared with a recently proposed methodology based on likelihood ratio tests. It is demonstrated that misspecifications of forecasting models can be detected within the proposed regression framework. It is further demonstrated that the likelihood ratio methodology without additional misspecification tests has no power in many practical situations and therefore frequently selects incorrect forecasting models. The empirical results provide some evidence that GARCH-t models provide good density forecasts. The results further suggest that extensions of statistical models with fat-tailed conditional distributions to models that incorporate higher order conditional moments beyond the conditional variance might be appropriate to capture the empirical regularities in financial time series in some cases.

Suggested Citation

  • Raunig, Burkhard & de Raaij, Gabriela, 2002. "Evaluating Density Forecasts with an Application to Stock Market Returns," Discussion Paper Series 1: Economic Studies 2002,08, Deutsche Bundesbank.
  • Handle: RePEc:zbw:bubdp1:4173
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/19565/1/200208dkp.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Clements, Michael P. & Smith, Jeremy, 1998. "Evaluating The Forecast Densities Of Linear And Non-Linear Models: Applications To Output Growth And Unemployment," Economic Research Papers 268791, University of Warwick - Department of Economics.
    2. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    3. Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1997. "Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters," NBER Working Papers 6228, National Bureau of Economic Research, Inc.
    4. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    5. Lumsdaine, Robin L, 1996. "Consistency and Asymptotic Normality of the Quasi-maximum Likelihood Estimator in IGARCH(1,1) and Covariance Stationary GARCH(1,1) Models," Econometrica, Econometric Society, vol. 64(3), pages 575-596, May.
    6. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    7. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    8. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    9. Spanos,Aris, 1999. "Probability Theory and Statistical Inference," Cambridge Books, Cambridge University Press, number 9780521424080.
    10. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    11. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:onb:oenbwp:y::i:61:b:1 is not listed on IDEAS
    2. Irfan Akbar Kazi & Suzanne Salloy, 2013. "Contagion effect due to Lehman Brothers’ bankruptcy and the global financial crisis - From the perspective of the Credit Default Swaps’ G14 dealers," EconomiX Working Papers 2013-6, University of Paris Nanterre, EconomiX.
    3. Antonio Di Cesare & Giovanni Guazzarotti, 2010. "An analysis of the determinants of credit default swap spread changes before and during the subprime financial turmoil," Temi di discussione (Economic working papers) 749, Bank of Italy, Economic Research and International Relations Area.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriela De Raaij & Burkhard Raunig, 2005. "Evaluating density forecasts from models of stock market returns," The European Journal of Finance, Taylor & Francis Journals, vol. 11(2), pages 151-166.
    2. Corradi, Valentina & Swanson, Norman R., 2006. "Bootstrap conditional distribution tests in the presence of dynamic misspecification," Journal of Econometrics, Elsevier, vol. 133(2), pages 779-806, August.
    3. M. Hashem Pesaran & Paolo Zaffaroni, 2004. "Model Averaging and Value-at-Risk Based Evaluation of Large Multi Asset Volatility Models for Risk Management," CESifo Working Paper Series 1358, CESifo.
    4. Clements, Michael P., 2006. "Internal consistency of survey respondentsíforecasts: Evidence based on the Survey of Professional Forecasters," Economic Research Papers 269742, University of Warwick - Department of Economics.
    5. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1998. "Real-Time Multivariate Density Forecast Evaluation and Calibration: Monitoring the Risk of High-Frequency Returns on Foreign Exchange," New York University, Leonard N. Stern School Finance Department Working Paper Seires 98-079, New York University, Leonard N. Stern School of Business-.
    6. Sean D. Campbell & Francis X. Diebold, 2005. "Weather Forecasting for Weather Derivatives," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 6-16, March.
    7. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    8. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    9. Chen, Yi-Ting, 2012. "A simple approach to standardized-residuals-based higher-moment tests," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 427-453.
    10. Sébastien Laurent & Luc Bauwens & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109.
    11. González-Rivera, Gloria & Yoldas, Emre, 2012. "Autocontour-based evaluation of multivariate predictive densities," International Journal of Forecasting, Elsevier, vol. 28(2), pages 328-342.
    12. Halkos, George E. & Tsirivis, Apostolos S., 2019. "Effective energy commodity risk management: Econometric modeling of price volatility," Economic Analysis and Policy, Elsevier, vol. 63(C), pages 234-250.
    13. Jondeau, Eric & Rockinger, Michael, 2006. "The Copula-GARCH model of conditional dependencies: An international stock market application," Journal of International Money and Finance, Elsevier, vol. 25(5), pages 827-853, August.
    14. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    15. Christian Bontemps & Nour Meddahi, 2012. "Testing distributional assumptions: A GMM aproach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 978-1012, September.
    16. Andreou, Elena & Werker, Bas J.M., 2015. "Residual-based rank specification tests for AR–GARCH type models," Journal of Econometrics, Elsevier, vol. 185(2), pages 305-331.
    17. Cees Diks & Valentyn Panchenko & Dick van Dijk, 2008. "Partial Likelihood-Based Scoring Rules for Evaluating Density Forecasts in Tails," Tinbergen Institute Discussion Papers 08-050/4, Tinbergen Institute.
    18. Cai, Lili & Swanson, Norman R., 2011. "In- and out-of-sample specification analysis of spot rate models: Further evidence for the period 1982-2008," Journal of Empirical Finance, Elsevier, vol. 18(4), pages 743-764, September.
    19. Dominique Guegan & Bertrand K. Hassani, 2019. "Risk Measurement," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-02119256, HAL.
    20. Markus Haas, 2004. "Mixed Normal Conditional Heteroskedasticity," Journal of Financial Econometrics, Oxford University Press, vol. 2(2), pages 211-250.

    More about this item

    Keywords

    Density forecasting; Forecast evaluation; Risk management; GARCH-models;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:bubdp1:4173. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/dbbgvde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.