IDEAS home Printed from https://ideas.repec.org/p/aah/create/2009-56.html
   My bibliography  Save this paper

On the Economic Evaluation of Volatility Forecasts

Author

Listed:
  • Valeri Voev

    (Aarhus University and CREATES)

Abstract

We analyze the applicability of economic criteria for volatility forecast evaluation based on unconditional measures of portfolio performance. The main theoretical finding is that such unconditional measures generally fail to rank conditional forecasts correctly due to the presence of a bias term driven by the variability of the conditional mean and portfolio weights. Simulations and a small empirical study suggest that the bias can be empirically substantial and lead to distortions in forecast evaluation. An important implication is that forecasting superiority of models using high frequency data is likely to be understated if unconditional criteria are used.

Suggested Citation

  • Valeri Voev, 2009. "On the Economic Evaluation of Volatility Forecasts," CREATES Research Papers 2009-56, Department of Economics and Business Economics, Aarhus University.
    • Handle: RePEc:aah:create:2009-56
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/09/rp09_56.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. O. E. Barndorff-Nielsen & P. Reinhard Hansen & A. Lunde & N. Shephard, 2009. "Realized kernels in practice: trades and quotes," Econometrics Journal, Royal Economic Society, vol. 12(3), pages 1-32, November.
    2. Jacod, Jean & Li, Yingying & Mykland, Per A. & Podolskij, Mark & Vetter, Mathias, 2009. "Microstructure noise in the continuous case: The pre-averaging approach," Stochastic Processes and their Applications, Elsevier, vol. 119(7), pages 2249-2276, July.
    3. Barndorff-Nielsen, Ole E. & Hansen, Peter Reinhard & Lunde, Asger & Shephard, Neil, 2011. "Multivariate realised kernels: Consistent positive semi-definite estimators of the covariation of equity prices with noise and non-synchronous trading," Journal of Econometrics, Elsevier, vol. 162(2), pages 149-169, June.
    4. Christensen, Kim & Kinnebrock, Silja & Podolskij, Mark, 2010. "Pre-averaging estimators of the ex-post covariance matrix in noisy diffusion models with non-synchronous data," Journal of Econometrics, Elsevier, vol. 159(1), pages 116-133, November.
    5. Nolte, Ingmar & Voev, Valeri, 2007. "Estimating high-frequency based (co-) variances: A unified approach," CoFE Discussion Papers 07/07, University of Konstanz, Center of Finance and Econometrics (CoFE).
    6. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    7. Neil Shephard & Kevin Sheppard, 2010. "Realising the future: forecasting with high-frequency-based volatility (HEAVY) models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 197-231.
    8. Romain Houssa & Lasse Bork & Hans Dewachter, 2008. "Identification of Macroeconomic Factors in Large Panels," Working Papers 1010, University of Namur, Department of Economics.
    9. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    10. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    11. Matteo Bonato & Massimiliano Caporin & Angelo Ranaldo, 2009. "Forecasting realized (co)variances with a block structure Wishart autoregressive model," Working Papers 2009-03, Swiss National Bank.
    12. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    13. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    14. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    15. Cattaneo, Matias D. & Crump, Richard K. & Jansson, Michael, 2010. "Robust Data-Driven Inference for Density-Weighted Average Derivatives," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1070-1083.
    16. Jean Jacod & Yingying Li & Per A. Mykland & Mark Podolskij & Mathias Vetter, 2007. "Microstructure Noise in the Continuous Case: The Pre-Averaging Approach - JLMPV-9," CREATES Research Papers 2007-43, Department of Economics and Business Economics, Aarhus University.
    17. Adam Clements & Mark Doolan & Stan Hurn & Ralf Becker, 2009. "Evaluating multivariate volatility forecasts," NCER Working Paper Series 41, National Centre for Econometric Research, revised 25 Nov 2009.
    18. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    19. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    20. Zhang, Lan & Mykland, Per A. & Ait-Sahalia, Yacine, 2005. "A Tale of Two Time Scales: Determining Integrated Volatility With Noisy High-Frequency Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1394-1411, December.
    21. Gourieroux, C. & Jasiak, J. & Sufana, R., 2009. "The Wishart Autoregressive process of multivariate stochastic volatility," Journal of Econometrics, Elsevier, vol. 150(2), pages 167-181, June.
    22. Griffin, Jim E. & Oomen, Roel C.A., 2011. "Covariance measurement in the presence of non-synchronous trading and market microstructure noise," Journal of Econometrics, Elsevier, vol. 160(1), pages 58-68, January.
    23. Valeri Voev & Asger Lunde, 2007. "Integrated Covariance Estimation using High-frequency Data in the Presence of Noise," Journal of Financial Econometrics, Oxford University Press, vol. 5(1), pages 68-104.
    24. Engle, Robert, 2002. "Dynamic Conditional Correlation: A Simple Class of Multivariate Generalized Autoregressive Conditional Heteroskedasticity Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 339-350, July.
    25. Fleming, Jeff & Kirby, Chris & Ostdiek, Barbara, 2003. "The economic value of volatility timing using "realized" volatility," Journal of Financial Economics, Elsevier, vol. 67(3), pages 473-509, March.
    26. Mihaela ŞErban & Anthony Brockwell & John Lehoczky & Sanjay Srivastava, 2007. "Modelling the Dynamic Dependence Structure in Multivariate Financial Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 28(5), pages 763-782, September.
    27. LAURENT, Sebastien & ROMBOUTS, Jeroen V.K. & VIOLANTE, FRANCESCO, 2009. "Consistent ranking of multivariate volatility models," LIDAM Discussion Papers CORE 2009002, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    28. Jeff Fleming & Chris Kirby & Barbara Ostdiek, 2001. "The Economic Value of Volatility Timing," Journal of Finance, American Finance Association, vol. 56(1), pages 329-352, February.
    29. Qianqiu Liu, 2009. "On portfolio optimization: How and when do we benefit from high-frequency data?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 560-582.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nikolaus Hautsch & Lada M. Kyj & Peter Malec, 2015. "Do High‐Frequency Data Improve High‐Dimensional Portfolio Allocations?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(2), pages 263-290, March.
    2. Massimiliano Caporin & Michael McAleer, 2011. "Ranking Multivariate GARCH Models by Problem Dimension: An Empirical Evaluation," Documentos de Trabajo del ICAE 2011-20, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
    3. Caporin, Massimiliano & McAleer, Michael, 2014. "Robust ranking of multivariate GARCH models by problem dimension," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 172-185.
    4. Li, Yifan & Nolte, Ingmar & Vasios, Michalis & Voev, Valeri & Xu, Qi, 2022. "Weighted Least Squares Realized Covariation Estimation," Journal of Banking & Finance, Elsevier, vol. 137(C).
    5. repec:hum:wpaper:sfb649dp2013-014 is not listed on IDEAS
    6. Varneskov, Rasmus & Voev, Valeri, 2013. "The role of realized ex-post covariance measures and dynamic model choice on the quality of covariance forecasts," Journal of Empirical Finance, Elsevier, vol. 20(C), pages 83-95.
    7. Rombouts, Jeroen & Stentoft, Lars & Violante, Franceso, 2014. "The value of multivariate model sophistication: An application to pricing Dow Jones Industrial Average options," International Journal of Forecasting, Elsevier, vol. 30(1), pages 78-98.
    8. Nicholas Taylor, 2014. "The Economic Value of Volatility Forecasts: A Conditional Approach," Journal of Financial Econometrics, Oxford University Press, vol. 12(3), pages 433-478.
    9. Dimitrios P. Louzis, 2015. "The economic value of flexible dynamic correlation models," Economics Bulletin, AccessEcon, vol. 35(1), pages 774-782.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Varneskov, Rasmus & Voev, Valeri, 2013. "The role of realized ex-post covariance measures and dynamic model choice on the quality of covariance forecasts," Journal of Empirical Finance, Elsevier, vol. 20(C), pages 83-95.
    2. Roxana Halbleib & Valeri Voev, 2016. "Forecasting Covariance Matrices: A Mixed Approach," Journal of Financial Econometrics, Oxford University Press, vol. 14(2), pages 383-417.
    3. Nicholas Taylor, 2014. "The Economic Value of Volatility Forecasts: A Conditional Approach," Journal of Financial Econometrics, Oxford University Press, vol. 12(3), pages 433-478.
    4. Roxana Halbleib & Valeri Voev, 2011. "Forecasting Covariance Matrices: A Mixed Frequency Approach," CREATES Research Papers 2011-03, Department of Economics and Business Economics, Aarhus University.
    5. Roxana Chiriac & Valeri Voev, 2011. "Modelling and forecasting multivariate realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 922-947, September.
    6. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    7. Wenjing Wang & Minjing Tao, 2020. "Forecasting Realized Volatility Matrix With Copula-Based Models," Papers 2002.08849, arXiv.org.
    8. Elena Ivona Dumitrescu & Georgiana-Denisa Banulescu, 2019. "Do High-frequency-based Measures Improve Conditional Covariance Forecasts?," Post-Print hal-03331122, HAL.
    9. Denisa Banulescu-Radu & Christophe Hurlin & Bertrand Candelon & Sébastien Laurent, 2016. "Do We Need High Frequency Data to Forecast Variances?," Annals of Economics and Statistics, GENES, issue 123-124, pages 135-174.
    10. Vassallo, Danilo & Buccheri, Giuseppe & Corsi, Fulvio, 2021. "A DCC-type approach for realized covariance modeling with score-driven dynamics," International Journal of Forecasting, Elsevier, vol. 37(2), pages 569-586.
    11. Barndorff-Nielsen, Ole E. & Hansen, Peter Reinhard & Lunde, Asger & Shephard, Neil, 2011. "Multivariate realised kernels: Consistent positive semi-definite estimators of the covariation of equity prices with noise and non-synchronous trading," Journal of Econometrics, Elsevier, vol. 162(2), pages 149-169, June.
    12. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2018. "Modeling and forecasting (un)reliable realized covariances for more reliable financial decisions," Journal of Econometrics, Elsevier, vol. 207(1), pages 71-91.
    13. Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
    14. Georgiana-Denisa Banulescu & Bertrand Candelon & Christophe Hurlin & Sébastien Laurent, 2014. "Do We Need Ultra-High Frequency Data to Forecast Variances?," Working Papers halshs-01078158, HAL.
    15. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
    16. Christensen, Kim & Kinnebrock, Silja & Podolskij, Mark, 2010. "Pre-averaging estimators of the ex-post covariance matrix in noisy diffusion models with non-synchronous data," Journal of Econometrics, Elsevier, vol. 159(1), pages 116-133, November.
    17. Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018. "Risk Everywhere: Modeling and Managing Volatility," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.
    18. Gribisch, Bastian & Hartkopf, Jan Patrick, 2023. "Modeling realized covariance measures with heterogeneous liquidity: A generalized matrix-variate Wishart state-space model," Journal of Econometrics, Elsevier, vol. 235(1), pages 43-64.
    19. repec:hal:journl:peer-00815564 is not listed on IDEAS
    20. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    21. BAUWENS, Luc & BRAIONE, Manuela & STORTI, Giuseppe, 2016. "Multiplicative Conditional Correlation Models for Realized Covariance Matrices," LIDAM Discussion Papers CORE 2016041, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).

    More about this item

    Keywords

    Forecast evaluation; Volatility forecasting; Portfolio optimization; Mean-variance analysis;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2009-56. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.