IDEAS home Printed from https://ideas.repec.org/p/fip/fedawp/2003-28.html
   My bibliography  Save this paper

Choosing the best volatility models: the model confidence set approach

Author

Listed:
  • Peter Reinhard Hansen
  • Asger Lunde
  • James M. Nason

Abstract

This paper applies the model confidence sets (MCS) procedure to a set of volatility models. A MSC is analogous to a confidence interval of parameter in the sense that the former contains the best forecasting model with a certain probability. The key to the MCS is that it acknowledges the limitations of the information in the data. The empirical exercise is based on fifty-five volatility models, and the MCS includes about a third of these when evaluated by mean square error, whereas the MCS contains only a VGARCH model when mean absolute deviation criterion is used. We conduct a simulation study that shows the MCS captures the superior models across a range of significance levels. When we benchmark the MCS relative to a Bonferroni bound, this bound delivers inferior performance.

Suggested Citation

  • Peter Reinhard Hansen & Asger Lunde & James M. Nason, 2003. "Choosing the best volatility models: the model confidence set approach," FRB Atlanta Working Paper 2003-28, Federal Reserve Bank of Atlanta.
    • Handle: RePEc:fip:fedawp:2003-28
    as

    Download full text from publisher

    File URL: https://www.frbatlanta.org/-/media/documents/research/publications/wp/2003/wp0328.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Duan, Jin-Chuan, 1997. "Augmented GARCH (p,q) process and its diffusion limit," Journal of Econometrics, Elsevier, vol. 79(1), pages 97-127, July.
    2. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    3. Peter Hansen, 2003. "Asymptotic Tests of Composite Hypotheses," Working Papers 2003-09, Brown University, Department of Economics.
    4. Hentschel, Ludger, 1995. "All in the family Nesting symmetric and asymmetric GARCH models," Journal of Financial Economics, Elsevier, vol. 39(1), pages 71-104, September.
    5. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    6. Edwin J. Elton, 2002. "Spiders: Where Are the Bugs?," The Journal of Business, University of Chicago Press, vol. 75(3), pages 453-472, July.
    7. Peter Reinhard Hansen & Asger Lunde & James M. Nason, 2005. "Model confidence sets for forecasting models," FRB Atlanta Working Paper 2005-07, Federal Reserve Bank of Atlanta.
    8. Siem Jan Koopman & Neil Shephard & Jurgen A. Doornik, 1999. "Statistical algorithms for models in state space using SsfPack 2.2," Econometrics Journal, Royal Economic Society, vol. 2(1), pages 107-160.
    9. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    10. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    11. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    12. Higgins, Matthew L & Bera, Anil K, 1992. "A Class of Nonlinear ARCH Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(1), pages 137-158, February.
    13. Baillie, Richard T. & Bollerslev, Tim & Mikkelsen, Hans Ole, 1996. "Fractionally integrated generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 74(1), pages 3-30, September.
    14. Peter Reinhard Hansen, 2001. "An Unbiased and Powerful Test for Superior Predictive Ability," Working Papers 2001-06, Brown University, Department of Economics.
    15. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    16. Peter Hansen & Asger Lunde, 2003. "Consistent Preordering with an Estimated Criterion Function, with an Application to the Evaluation and Comparison of Volatility Models," Working Papers 2003-01, Brown University, Department of Economics.
    17. Johansen, Soren, 1988. "Statistical analysis of cointegration vectors," Journal of Economic Dynamics and Control, Elsevier, vol. 12(2-3), pages 231-254.
    18. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    19. Maria Elvira Mancino & Paul Malliavin, 2002. "Fourier series method for measurement of multivariate volatilities," Finance and Stochastics, Springer, vol. 6(1), pages 49-61.
    20. Ole E. Barndorff-Nielsen & Neil Shephard, 2001. "Estimating quadratic variation using realised volatility," Economics Papers 2001-W20, Economics Group, Nuffield College, University of Oxford, revised 01 Nov 2001.
    21. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    22. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    23. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    24. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    25. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    26. Härdle, Wolfgang & Horowitz, Joel L. & Kreiss, Jens-Peter, 2001. "Bootstrap methods for time series," SFB 373 Discussion Papers 2001,59, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    27. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501.
    28. Enrique Sentana, 1995. "Quadratic ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(4), pages 639-661.
    29. Pantula, Sastry G., 1989. "Testing for Unit Roots in Time Series Data," Econometric Theory, Cambridge University Press, vol. 5(2), pages 256-271, August.
    30. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    31. G. William Schwert, 1988. "Why Does Stock Market Volatility Change Over Time?," NBER Working Papers 2798, National Bureau of Economic Research, Inc.
    32. Barucci, Emilio & Reno, Roberto, 2002. "On measuring volatility of diffusion processes with high frequency data," Economics Letters, Elsevier, vol. 74(3), pages 371-378, February.
    33. Geoffrey F. Loudon & Wing H. Watt & Pradeep K. Yadav, 2000. "An empirical analysis of alternative parametric ARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 117-136.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    2. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    3. Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
    4. Awartani, Basel M.A. & Corradi, Valentina, 2005. "Predicting the volatility of the S&P-500 stock index via GARCH models: the role of asymmetries," International Journal of Forecasting, Elsevier, vol. 21(1), pages 167-183.
    5. Koopman, Siem Jan & Jungbacker, Borus & Hol, Eugenie, 2005. "Forecasting daily variability of the S&P 100 stock index using historical, realised and implied volatility measurements," Journal of Empirical Finance, Elsevier, vol. 12(3), pages 445-475, June.
    6. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    7. Nikolaos A. Kyriazis, 2021. "A Survey on Volatility Fluctuations in the Decentralized Cryptocurrency Financial Assets," JRFM, MDPI, vol. 14(7), pages 1-46, June.
    8. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    9. Tae-Hwy Lee & Yong Bao & Burak Saltoğlu, 2007. "Comparing density forecast models Previous versions of this paper have been circulated with the title, 'A Test for Density Forecast Comparison with Applications to Risk Management' since October 2003;," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(3), pages 203-225.
    10. Carnero, María Ángeles, 2001. "Outliers and conditional autoregressive heteroscedasticity in time series," DES - Working Papers. Statistics and Econometrics. WS ws010704, Universidad Carlos III de Madrid. Departamento de Estadística.
    11. repec:awi:wpaper:0472 is not listed on IDEAS
    12. David E. Rapach & Jack K. Strauss, 2008. "Structural breaks and GARCH models of exchange rate volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(1), pages 65-90.
    13. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    14. Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
    15. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    16. Charles, Amélie, 2010. "The day-of-the-week effects on the volatility: The role of the asymmetry," European Journal of Operational Research, Elsevier, vol. 202(1), pages 143-152, April.
    17. Conrad, Christian & Karanasos, Menelaos & Zeng, Ning, 2011. "Multivariate fractionally integrated APARCH modeling of stock market volatility: A multi-country study," Journal of Empirical Finance, Elsevier, vol. 18(1), pages 147-159, January.
    18. Geoffrey F. Loudon & Wing H. Watt & Pradeep K. Yadav, 2000. "An empirical analysis of alternative parametric ARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 117-136.
    19. Wei, Yu & Wang, Yudong & Huang, Dengshi, 2010. "Forecasting crude oil market volatility: Further evidence using GARCH-class models," Energy Economics, Elsevier, vol. 32(6), pages 1477-1484, November.
    20. Ma, Feng & Wei, Yu & Huang, Dengshi & Chen, Yixiang, 2014. "Which is the better forecasting model? A comparison between HAR-RV and multifractality volatility," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 405(C), pages 171-180.
    21. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedawp:2003-28. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rob Sarwark (email available below). General contact details of provider: https://edirc.repec.org/data/frbatus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.