IDEAS home Printed from https://ideas.repec.org/p/uts/rpaper/175.html
   My bibliography  Save this paper

Volatility Forecast Comparison using Imperfect Volatility Proxies

Author

Listed:
  • Andrew Patton

    (Duke University)

Abstract

The use of a conditionally unbiased, but imperfect, volatility proxy can lead to undesirable outcomes in standard methods for comparing conditional variance forecasts. We derive necessary and sufficient conditions on functional form of the loss function for the ranking of competing volatility forecasts to be robust to the presence of noise in the volatility proxy, and derive some interesting special cases of this class of “robust” loss functions. We motivate the theory with analytical results on the distortions caused by some widely-used loss functions, when used with standard volatility proxies such as squared returns, the intra-daily range or realised volatility. The methods are illustrated with an application to the volatility of returns on IBM over the period 1993 to 2003.

Suggested Citation

  • Andrew Patton, 2006. "Volatility Forecast Comparison using Imperfect Volatility Proxies," Research Paper Series 175, Quantitative Finance Research Centre, University of Technology, Sydney.
  • Handle: RePEc:uts:rpaper:175
    as

    Download full text from publisher

    File URL: https://www.uts.edu.au/sites/default/files/qfr-archive-02/QFR-rp175.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    2. Gourieroux, Christian & Monfort, Alain & Trognon, Alain, 1984. "Pseudo Maximum Likelihood Methods: Theory," Econometrica, Econometric Society, vol. 52(3), pages 681-700, May.
    3. Parkinson, Michael, 1980. "The Extreme Value Method for Estimating the Variance of the Rate of Return," The Journal of Business, University of Chicago Press, vol. 53(1), pages 61-65, January.
    4. Meddahi, N., 2001. "A Theoretical Comparison Between Integrated and Realized Volatilies," Cahiers de recherche 2001-26, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    5. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    6. Ball, Clifford A & Torous, Walter N, 1984. "The Maximum Likelihood Estimation of Security Price Volatility: Theory, Evidence, and Application to Option Pricing," The Journal of Business, University of Chicago Press, vol. 57(1), pages 97-112, January.
    7. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    8. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    9. Neil Shephard, 2005. "Stochastic Volatility," Economics Papers 2005-W17, Economics Group, Nuffield College, University of Oxford.
    10. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    11. Timmermann, Allan & Patton, Andrew, 2003. "Properties of Optimal Forecasts," CEPR Discussion Papers 4037, C.E.P.R. Discussion Papers.
    12. Garman, Mark B & Klass, Michael J, 1980. "On the Estimation of Security Price Volatilities from Historical Data," The Journal of Business, University of Chicago Press, vol. 53(1), pages 67-78, January.
    13. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    14. Nour Meddahi, 2002. "A theoretical comparison between integrated and realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 479-508.
    15. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    16. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    17. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    18. Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
    19. Martens, Martin & van Dijk, Dick, 2007. "Measuring volatility with the realized range," Journal of Econometrics, Elsevier, vol. 138(1), pages 181-207, May.
    20. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    21. Andersen, Torben G. & Bollerslev, Tim & Lange, Steve, 1999. "Forecasting financial market volatility: Sample frequency vis-a-vis forecast horizon," Journal of Empirical Finance, Elsevier, vol. 6(5), pages 457-477, December.
    22. Ole E. Barndorff-Nielsen & Neil Shephard, 2004. "Econometric Analysis of Realized Covariation: High Frequency Based Covariance, Regression, and Correlation in Financial Economics," Econometrica, Econometric Society, vol. 72(3), pages 885-925, May.
    23. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    24. Torben G. Andersen & Luca Benzoni & Jesper Lund, 2002. "An Empirical Investigation of Continuous‐Time Equity Return Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1239-1284, June.
    25. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    26. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
    27. Andersen, Torben G. & Bollerslev, Tim & Diebold, Francis X. & Ebens, Heiko, 2001. "The distribution of realized stock return volatility," Journal of Financial Economics, Elsevier, vol. 61(1), pages 43-76, July.
    28. Torben G. Andersen & Tim Bollerslev & Nour Meddahi, 2005. "Correcting the Errors: Volatility Forecast Evaluation Using High-Frequency Data and Realized Volatilities," Econometrica, Econometric Society, vol. 73(1), pages 279-296, January.
    29. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2002. "Parametric and Nonparametric Volatility Measurement," Center for Financial Institutions Working Papers 02-27, Wharton School Center for Financial Institutions, University of Pennsylvania.
    30. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    31. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464.
    32. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    33. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    34. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 3, pages 99-134, Elsevier.
    35. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    36. Sassan Alizadeh & Michael W. Brandt & Francis X. Diebold, 2002. "Range‐Based Estimation of Stochastic Volatility Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1047-1091, June.
    37. repec:cup:etheor:v:13:y:1997:i:6:p:808-17 is not listed on IDEAS
    38. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    39. Robert F. Engle & Che-Hsiung Hong & Alex Kane, 1990. "Valuation of Variance Forecast with Simulated Option Markets," NBER Working Papers 3350, National Bureau of Economic Research, Inc.
    40. Lamoureux, Christopher G & Lastrapes, William D, 1993. "Forecasting Stock-Return Variance: Toward an Understanding of Stochastic Implied Volatilities," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 293-326.
    41. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    42. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    43. Tim Bollerslev & Jonathan H. Wright, 2001. "High-Frequency Data, Frequency Domain Inference, And Volatility Forecasting," The Review of Economics and Statistics, MIT Press, vol. 83(4), pages 596-602, November.
    44. Christensen, Kim & Podolski, Mark, 2005. "Asymptotic theory for range-based estimation of integrated variance of a continuous semi-martingale," Technical Reports 2005,18, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    45. Torben G. Andersen & Tim Bollerslev & Nour Meddahi, 2004. "Analytical Evaluation Of Volatility Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(4), pages 1079-1110, November.
    46. Gourieroux Christian & Monfort Alain & Renault Eric, 1987. "Consistent m-estimators in a semi-parametric model," CEPREMAP Working Papers (Couverture Orange) 8720, CEPREMAP.
    47. Christensen, Kim & Podolskij, Mark, 2006. "Range-Based Estimation of Quadratic Variation," Technical Reports 2006,37, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    48. Christoffersen, Peter & Jacobs, Kris, 2004. "The importance of the loss function in option valuation," Journal of Financial Economics, Elsevier, vol. 72(2), pages 291-318, May.
    49. Sílvia Gonçalves & Nour Meddahi, 2009. "Bootstrapping Realized Volatility," Econometrica, Econometric Society, vol. 77(1), pages 283-306, January.
    50. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    51. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    52. Komunjer, Ivana & Vuong, Quang, 2006. "Efficientt Conditional Quantile Estimation: The Time Series Case," University of California at San Diego, Economics Working Paper Series qt78842570, Department of Economics, UC San Diego.
    53. Christensen, Kim & Podolskij, Mark, 2007. "Realized range-based estimation of integrated variance," Journal of Econometrics, Elsevier, vol. 141(2), pages 323-349, December.
    54. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201.
    55. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew J. Patton & Kevin Sheppard, 2008. "Evaluating Volatility and Correlation Forecasts," OFRC Working Papers Series 2008fe22, Oxford Financial Research Centre.
    2. Patton, Andrew J., 2011. "Data-based ranking of realised volatility estimators," Journal of Econometrics, Elsevier, vol. 161(2), pages 284-303, April.
    3. Ole E. Barndorff-Nielsen & Neil Shephard, 2005. "Variation, jumps, market frictions and high frequency data in financial econometrics," OFRC Working Papers Series 2005fe08, Oxford Financial Research Centre.
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    5. Matei, Marius, 2011. "Non-Linear Volatility Modeling of Economic and Financial Time Series Using High Frequency Data," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(2), pages 116-141, June.
    6. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    7. Michael McAleer & Marcelo Medeiros, 2008. "Realized Volatility: A Review," Econometric Reviews, Taylor & Francis Journals, vol. 27(1-3), pages 10-45.
    8. Bauwens, Luc & Sucarrat, Genaro, 2010. "General-to-specific modelling of exchange rate volatility: A forecast evaluation," International Journal of Forecasting, Elsevier, vol. 26(4), pages 885-907, October.
    9. Patton, Andrew J. & Sheppard, Kevin, 2009. "Optimal combinations of realised volatility estimators," International Journal of Forecasting, Elsevier, vol. 25(2), pages 218-238.
    10. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    11. Robert Ślepaczuk & Grzegorz Zakrzewski, 2009. "High-Frequency and Model-Free Volatility Estimators," Working Papers 2009-13, Faculty of Economic Sciences, University of Warsaw.
    12. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    13. Sucarrat, Genaro, 2009. "Forecast Evaluation of Explanatory Models of Financial Variability," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-33.
    14. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
    15. Bali, Turan G. & Weinbaum, David, 2007. "A conditional extreme value volatility estimator based on high-frequency returns," Journal of Economic Dynamics and Control, Elsevier, vol. 31(2), pages 361-397, February.
    16. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2003. "Some Like it Smooth, and Some Like it Rough: Untangling Continuous and Jump Components in Measuring, Modeling, and Forecasting Asset Return Volatility," PIER Working Paper Archive 03-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Sep 2003.
    17. Andersen, Torben G. & Bollerslev, Tim & Huang, Xin, 2011. "A reduced form framework for modeling volatility of speculative prices based on realized variation measures," Journal of Econometrics, Elsevier, vol. 160(1), pages 176-189, January.
    18. Shirota, Shinichiro & Hizu, Takayuki & Omori, Yasuhiro, 2014. "Realized stochastic volatility with leverage and long memory," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 618-641.
    19. Prateek Sharma & Vipul _, 2015. "Forecasting stock index volatility with GARCH models: international evidence," Studies in Economics and Finance, Emerald Group Publishing Limited, vol. 32(4), pages 445-463, October.
    20. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.

    More about this item

    Keywords

    forecast evaluation; forecast comparison; loss functions; realised Variance; range;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uts:rpaper:175. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Duncan Ford (email available below). General contact details of provider: https://edirc.repec.org/data/qfutsau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.