IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2406.08041.html
   My bibliography  Save this paper

HARd to Beat: The Overlooked Impact of Rolling Windows in the Era of Machine Learning

Author

Listed:
  • Francesco Audrino
  • Jonathan Chassot

Abstract

We investigate the predictive abilities of the heterogeneous autoregressive (HAR) model compared to machine learning (ML) techniques across an unprecedented dataset of 1,455 stocks. Our analysis focuses on the role of fitting schemes, particularly the training window and re-estimation frequency, in determining the HAR model's performance. Despite extensive hyperparameter tuning, ML models fail to surpass the linear benchmark set by HAR when utilizing a refined fitting approach for the latter. Moreover, the simplicity of HAR allows for an interpretable model with drastically lower computational costs. We assess performance using QLIKE, MSE, and realized utility metrics, finding that HAR consistently outperforms its ML counterparts when both rely solely on realized volatility and VIX as predictors. Our results underscore the importance of a correctly specified fitting scheme. They suggest that properly fitted HAR models provide superior forecasting accuracy, establishing robust guidelines for their practical application and use as a benchmark. This study not only reaffirms the efficacy of the HAR model but also provides a critical perspective on the practical limitations of ML approaches in realized volatility forecasting.

Suggested Citation

  • Francesco Audrino & Jonathan Chassot, 2024. "HARd to Beat: The Overlooked Impact of Rolling Windows in the Era of Machine Learning," Papers 2406.08041, arXiv.org.
  • Handle: RePEc:arx:papers:2406.08041
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2406.08041
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Andrea Bucci, 2020. "Realized Volatility Forecasting with Neural Networks," Journal of Financial Econometrics, Oxford University Press, vol. 18(3), pages 502-531.
    2. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    3. Ole E. Barndorff-Nielsen & Neil Shephard, 2002. "Estimating quadratic variation using realized variance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 457-477.
    4. Buncic, Daniel & Gisler, Katja I.M., 2016. "Global equity market volatility spillovers: A broader role for the United States," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1317-1339.
    5. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    6. Clements, Adam & Preve, Daniel P.A., 2021. "A Practical Guide to harnessing the HAR volatility model," Journal of Banking & Finance, Elsevier, vol. 133(C).
    7. Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018. "Risk Everywhere: Modeling and Managing Volatility," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.
    8. Cipollini, Fabrizio & Gallo, Giampiero M. & Otranto, Edoardo, 2021. "Realized volatility forecasting: Robustness to measurement errors," International Journal of Forecasting, Elsevier, vol. 37(1), pages 44-57.
    9. Fei Liu & Athanasios A. Pantelous & Hans-Jörg von Mettenheim, 2018. "Forecasting and trading high frequency volatility on large indices," Quantitative Finance, Taylor & Francis Journals, vol. 18(5), pages 737-748, May.
    10. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    11. Chuong Luong & Nikolai Dokuchaev, 2018. "Forecasting of Realised Volatility with the Random Forests Algorithm," JRFM, MDPI, vol. 11(4), pages 1-15, October.
    12. Kim Christensen & Mathias Siggaard & Bezirgen Veliyev, 2023. "A Machine Learning Approach to Volatility Forecasting," Journal of Financial Econometrics, Oxford University Press, vol. 21(5), pages 1680-1727.
    13. Andrew J. Patton & Kevin Sheppard, 2015. "Good Volatility, Bad Volatility: Signed Jumps and The Persistence of Volatility," The Review of Economics and Statistics, MIT Press, vol. 97(3), pages 683-697, July.
    14. Gunnarsson, Elias Søvik & Isern, Håkon Ramon & Kaloudis, Aristidis & Risstad, Morten & Vigdel, Benjamin & Westgaard, Sjur, 2024. "Prediction of realized volatility and implied volatility indices using AI and machine learning: A review," International Review of Financial Analysis, Elsevier, vol. 93(C).
    15. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    16. Audrino, Francesco & Sigrist, Fabio & Ballinari, Daniele, 2020. "The impact of sentiment and attention measures on stock market volatility," International Journal of Forecasting, Elsevier, vol. 36(2), pages 334-357.
    17. Zhu, Haibin & Bai, Lu & He, Lidan & Liu, Zhi, 2023. "Forecasting realized volatility with machine learning: Panel data perspective," Journal of Empirical Finance, Elsevier, vol. 73(C), pages 251-271.
    18. Francesco Audrino & Simon D. Knaus, 2016. "Lassoing the HAR Model: A Model Selection Perspective on Realized Volatility Dynamics," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1485-1521, December.
    19. Chao Zhang & Yihuang Zhang & Mihai Cucuringu & Zhongmin Qian, 2022. "Volatility forecasting with machine learning and intraday commonality," Papers 2202.08962, arXiv.org, revised Feb 2023.
    20. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    21. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    22. O. E. Barndorff-Nielsen & P. Reinhard Hansen & A. Lunde & N. Shephard, 2009. "Realized kernels in practice: trades and quotes," Econometrics Journal, Royal Economic Society, vol. 12(3), pages 1-32, November.
    23. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    24. Zhang, Yaojie & Ma, Feng & Liao, Yin, 2020. "Forecasting global equity market volatilities," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1454-1475.
    25. Ole E. Barndorff-Nielsen & Neil Shephard, 2002. "Estimating quadratic variation using realized variance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 457-477.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yaojie Zhang & Yudong Wang & Feng Ma & Yu Wei, 2022. "To jump or not to jump: momentum of jumps in crude oil price volatility prediction," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-31, December.
    2. Lyócsa, Štefan & Molnár, Peter & Výrost, Tomáš, 2021. "Stock market volatility forecasting: Do we need high-frequency data?," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1092-1110.
    3. Zhu, Haibin & Bai, Lu & He, Lidan & Liu, Zhi, 2023. "Forecasting realized volatility with machine learning: Panel data perspective," Journal of Empirical Finance, Elsevier, vol. 73(C), pages 251-271.
    4. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    5. Yusui Tang & Feng Ma & Yaojie Zhang & Yu Wei, 2022. "Forecasting the oil price realized volatility: A multivariate heterogeneous autoregressive model," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 4770-4783, October.
    6. Gunnarsson, Elias Søvik & Isern, Håkon Ramon & Kaloudis, Aristidis & Risstad, Morten & Vigdel, Benjamin & Westgaard, Sjur, 2024. "Prediction of realized volatility and implied volatility indices using AI and machine learning: A review," International Review of Financial Analysis, Elsevier, vol. 93(C).
    7. Papantonis, Ioannis & Rompolis, Leonidas & Tzavalis, Elias, 2023. "Improving variance forecasts: The role of Realized Variance features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1221-1237.
    8. Elena Ivona Dumitrescu & Georgiana-Denisa Banulescu, 2019. "Do High-frequency-based Measures Improve Conditional Covariance Forecasts?," Post-Print hal-03331122, HAL.
    9. Clements, Adam & Preve, Daniel P.A., 2021. "A Practical Guide to harnessing the HAR volatility model," Journal of Banking & Finance, Elsevier, vol. 133(C).
    10. Liang, Chao & Li, Yan & Ma, Feng & Wei, Yu, 2021. "Global equity market volatilities forecasting: A comparison of leverage effects, jumps, and overnight information," International Review of Financial Analysis, Elsevier, vol. 75(C).
    11. Junjie Hu & Wolfgang Karl Hardle & Weiyu Kuo, 2019. "Risk of Bitcoin Market: Volatility, Jumps, and Forecasts," Papers 1912.05228, arXiv.org, revised Dec 2021.
    12. Chao Zhang & Yihuang Zhang & Mihai Cucuringu & Zhongmin Qian, 2022. "Volatility forecasting with machine learning and intraday commonality," Papers 2202.08962, arXiv.org, revised Feb 2023.
    13. Dimos S. Kambouroudis & David G. McMillan & Katerina Tsakou, 2021. "Forecasting realized volatility: The role of implied volatility, leverage effect, overnight returns, and volatility of realized volatility," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(10), pages 1618-1639, October.
    14. Tian, Fengping & Yang, Ke & Chen, Langnan, 2017. "Realized volatility forecasting of agricultural commodity futures using the HAR model with time-varying sparsity," International Journal of Forecasting, Elsevier, vol. 33(1), pages 132-152.
    15. Barunik, Jozef & Krehlik, Tomas & Vacha, Lukas, 2016. "Modeling and forecasting exchange rate volatility in time-frequency domain," European Journal of Operational Research, Elsevier, vol. 251(1), pages 329-340.
    16. Bollerslev, Tim & Medeiros, Marcelo C. & Patton, Andrew J. & Quaedvlieg, Rogier, 2022. "From zero to hero: Realized partial (co)variances," Journal of Econometrics, Elsevier, vol. 231(2), pages 348-360.
    17. Dimos Kambouroudis & David McMillan & Katerina Tsakou, 2019. "Forecasting Realized Volatility: The role of implied volatility, leverage effect, overnight returns and volatility of realized volatility," Working Papers 2019-03, Swansea University, School of Management.
    18. Niu, Zibo & Demirer, Riza & Suleman, Muhammad Tahir & Zhang, Hongwei & Zhu, Xuehong, 2024. "Do industries predict stock market volatility? Evidence from machine learning models," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    19. Wang, Jiqian & Lu, Xinjie & He, Feng & Ma, Feng, 2020. "Which popular predictor is more useful to forecast international stock markets during the coronavirus pandemic: VIX vs EPU?," International Review of Financial Analysis, Elsevier, vol. 72(C).
    20. Chao Zhang & Xingyue Pu & Mihai Cucuringu & Xiaowen Dong, 2023. "Graph Neural Networks for Forecasting Multivariate Realized Volatility with Spillover Effects," Papers 2308.01419, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2406.08041. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.