IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v93y2024ics1057521924001534.html
   My bibliography  Save this article

Prediction of realized volatility and implied volatility indices using AI and machine learning: A review

Author

Listed:
  • Gunnarsson, Elias Søvik
  • Isern, Håkon Ramon
  • Kaloudis, Aristidis
  • Risstad, Morten
  • Vigdel, Benjamin
  • Westgaard, Sjur

Abstract

In this systematic literature review, we examine the existing studies predicting realized volatility and implied volatility indices using artificial intelligence and machine learning. We survey the literature in order to discover whether the proposed methods provide superior forecasts compared to traditional econometric models, how widespread the application of explainable AI is, and to outline potential areas for further research. Generally, we find the efficacy of AI and ML methods for volatility prediction to be highly promising, often providing comparative or better results than their econometric counterparts. Neural networks employing memory, such as Long–Short Term Memory and Gated Recurrent Units, consistently rank among the top performing models. However, traditional econometric models are still highly relevant, commonly yielding similar results as more advanced ML and AI models. In light of the success with ensemble methods, a promising area of research is the use of hybrid models, combining machine learning and econometric models. In spite of the common critique of many machine learning models being of a black-box nature, we find that very few papers apply XAI to analyze and support their empirical results. Thus, we recommend that researchers strive harder to employ XAI in future work. Similarly, we see potential for applications of probabilistic machine learning, effectively quantifying uncertainty in volatility forecasts from machine learning models.

Suggested Citation

  • Gunnarsson, Elias Søvik & Isern, Håkon Ramon & Kaloudis, Aristidis & Risstad, Morten & Vigdel, Benjamin & Westgaard, Sjur, 2024. "Prediction of realized volatility and implied volatility indices using AI and machine learning: A review," International Review of Financial Analysis, Elsevier, vol. 93(C).
  • Handle: RePEc:eee:finana:v:93:y:2024:i:c:s1057521924001534
    DOI: 10.1016/j.irfa.2024.103221
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521924001534
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.irfa.2024.103221?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andreas G. F. Hoepner & Jeffrey Unerman, 2012. "Explicit and Implicit Subject Bias in the ABS Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 21(1), pages 3-15, December.
    2. Andrea Bucci, 2020. "Realized Volatility Forecasting with Neural Networks," Journal of Financial Econometrics, Oxford University Press, vol. 18(3), pages 502-531.
    3. Christoph Bergmeir, 2023. "Common Pitfalls and Better Practices in Forecast Evaluation for Data Scientists," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 70, pages 5-12, Q3.
    4. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    5. Çepni, Oğuzhan & Gupta, Rangan & Pienaar, Daniel & Pierdzioch, Christian, 2022. "Forecasting the realized variance of oil-price returns using machine learning: Is there a role for U.S. state-level uncertainty?," Energy Economics, Elsevier, vol. 114(C).
    6. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    7. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    8. Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018. "Risk Everywhere: Modeling and Managing Volatility," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.
    9. Fei Liu & Athanasios A. Pantelous & Hans-Jörg von Mettenheim, 2018. "Forecasting and trading high frequency volatility on large indices," Quantitative Finance, Taylor & Francis Journals, vol. 18(5), pages 737-748, May.
    10. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    11. Chuong Luong & Nikolai Dokuchaev, 2018. "Forecasting of Realised Volatility with the Random Forests Algorithm," JRFM, MDPI, vol. 11(4), pages 1-15, October.
    12. Spyridon D. Vrontos & John Galakis & Ioannis D. Vrontos, 2021. "Implied volatility directional forecasting: a machine learning approach," Quantitative Finance, Taylor & Francis Journals, vol. 21(10), pages 1687-1706, October.
    13. Elie Bouri & Konstantinos Gkillas & Rangan Gupta & Christian Pierdzioch, 2021. "Forecasting Realized Volatility of Bitcoin: The Role of the Trade War," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 29-53, January.
    14. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    15. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    16. Akhilesh Prasad & Priti Bakhshi & Arumugam Seetharaman, 2022. "The Impact of the U.S. Macroeconomic Variables on the CBOE VIX Index," JRFM, MDPI, vol. 15(3), pages 1-25, March.
    17. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    18. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    19. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    20. Rangan Gupta & Jacobus Nel & Christian Pierdzioch, 2023. "Investor Confidence and Forecastability of US Stock Market Realized Volatility: Evidence from Machine Learning," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 24(1), pages 111-122, January.
    21. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    22. Fang Jia & Boli Yang & Benjamin Miranda Tabak, 2021. "Forecasting Volatility of Stock Index: Deep Learning Model with Likelihood-Based Loss Function," Complexity, Hindawi, vol. 2021, pages 1-13, February.
    23. Dai, Zhifeng & Zhou, Huiting & Wen, Fenghua & He, Shaoyi, 2020. "Efficient predictability of stock return volatility: The role of stock market implied volatility," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    24. Kais Tissaoui & Taha Zaghdoudi & Abdelaziz Hakimi & Ousama Ben-Salha & Lamia Ben Amor, 2022. "Does Uncertainty Forecast Crude Oil Volatility before and during the COVID-19 Outbreak? Fresh Evidence Using Machine Learning Models," Energies, MDPI, vol. 15(15), pages 1-20, August.
    25. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    26. Luca Di Persio & Matteo Garbelli & Kai Wallbaum, 2021. "Forward-Looking Volatility Estimation for Risk-Managed Investment Strategies during the COVID-19 Crisis," Risks, MDPI, vol. 9(2), pages 1-16, February.
    27. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    28. Plakandaras, Vasilios & Gupta, Rangan & Wohar, Mark E., 2017. "The depreciation of the pound post-Brexit: Could it have been predicted?," Finance Research Letters, Elsevier, vol. 21(C), pages 206-213.
    29. Robert F. Engle & Eric Ghysels & Bumjean Sohn, 2013. "Stock Market Volatility and Macroeconomic Fundamentals," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 776-797, July.
    30. Becker, Ralf & Clements, Adam E. & White, Scott I., 2007. "Does implied volatility provide any information beyond that captured in model-based volatility forecasts?," Journal of Banking & Finance, Elsevier, vol. 31(8), pages 2535-2549, August.
    31. Qiu, Yue, 2021. "Complete subset least squares support vector regression," Economics Letters, Elsevier, vol. 200(C).
    32. Joerg Osterrieder & Daniel Kucharczyk & Silas Rudolf & Daniel Wittwer, 2020. "Neural networks and arbitrage in the VIX," Digital Finance, Springer, vol. 2(1), pages 97-115, September.
    33. Takuo Higashide & Katsuyuki Tanaka & Takuji Kinkyo & Shigeyuki Hamori, 2021. "New Dataset for Forecasting Realized Volatility: Is the Tokyo Stock Exchange Co-Location Dataset Helpful for Expansion of the Heterogeneous Autoregressive Model in the Japanese Stock Market?," JRFM, MDPI, vol. 14(5), pages 1-18, May.
    34. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francesco Audrino & Jonathan Chassot, 2024. "HARd to Beat: The Overlooked Impact of Rolling Windows in the Era of Machine Learning," Papers 2406.08041, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xue Gong & Weiguo Zhang & Yuan Zhao & Xin Ye, 2023. "Forecasting stock volatility with a large set of predictors: A new forecast combination method," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1622-1647, November.
    2. Takuo Higashide & Katsuyuki Tanaka & Takuji Kinkyo & Shigeyuki Hamori, 2021. "New Dataset for Forecasting Realized Volatility: Is the Tokyo Stock Exchange Co-Location Dataset Helpful for Expansion of the Heterogeneous Autoregressive Model in the Japanese Stock Market?," JRFM, MDPI, vol. 14(5), pages 1-18, May.
    3. Chen Liu & Chao Wang & Minh-Ngoc Tran & Robert Kohn, 2023. "Deep Learning Enhanced Realized GARCH," Papers 2302.08002, arXiv.org, revised Oct 2023.
    4. Francesco Audrino & Jonathan Chassot, 2024. "HARd to Beat: The Overlooked Impact of Rolling Windows in the Era of Machine Learning," Papers 2406.08041, arXiv.org.
    5. Trucíos, Carlos, 2019. "Forecasting Bitcoin risk measures: A robust approach," International Journal of Forecasting, Elsevier, vol. 35(3), pages 836-847.
    6. Catania, Leopoldo & Proietti, Tommaso, 2020. "Forecasting volatility with time-varying leverage and volatility of volatility effects," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1301-1317.
    7. Nikolaos A. Kyriazis, 2021. "A Survey on Volatility Fluctuations in the Decentralized Cryptocurrency Financial Assets," JRFM, MDPI, vol. 14(7), pages 1-46, June.
    8. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    9. Peng, Huan & Chen, Ruoxun & Mei, Dexiang & Diao, Xiaohua, 2018. "Forecasting the realized volatility of the Chinese stock market: Do the G7 stock markets help?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 501(C), pages 78-85.
    10. Yusui Tang & Feng Ma & Yaojie Zhang & Yu Wei, 2022. "Forecasting the oil price realized volatility: A multivariate heterogeneous autoregressive model," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 4770-4783, October.
    11. Turgut Kısınbay, 2010. "Predictive ability of asymmetric volatility models at medium-term horizons," Applied Economics, Taylor & Francis Journals, vol. 42(30), pages 3813-3829.
    12. Hua, Jian & Manzan, Sebastiano, 2013. "Forecasting the return distribution using high-frequency volatility measures," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4381-4403.
    13. Awartani, Basel M.A. & Corradi, Valentina, 2005. "Predicting the volatility of the S&P-500 stock index via GARCH models: the role of asymmetries," International Journal of Forecasting, Elsevier, vol. 21(1), pages 167-183.
    14. Díaz, Juan D. & Hansen, Erwin & Cabrera, Gabriel, 2024. "Machine-learning stock market volatility: Predictability, drivers, and economic value," International Review of Financial Analysis, Elsevier, vol. 94(C).
    15. Ma, Feng & Wei, Yu & Huang, Dengshi & Chen, Yixiang, 2014. "Which is the better forecasting model? A comparison between HAR-RV and multifractality volatility," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 405(C), pages 171-180.
    16. Lyócsa, Štefan & Molnár, Peter & Výrost, Tomáš, 2021. "Stock market volatility forecasting: Do we need high-frequency data?," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1092-1110.
    17. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2011. "Are realized volatility models good candidates for alternative Value at Risk prediction strategies?," MPRA Paper 30364, University Library of Munich, Germany.
    18. Andrea BUCCI, 2017. "Forecasting Realized Volatility A Review," Journal of Advanced Studies in Finance, ASERS Publishing, vol. 8(2), pages 94-138.
    19. Ma, Feng & Li, Yu & Liu, Li & Zhang, Yaojie, 2018. "Are low-frequency data really uninformative? A forecasting combination perspective," The North American Journal of Economics and Finance, Elsevier, vol. 44(C), pages 92-108.
    20. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2014. "Realized volatility models and alternative Value-at-Risk prediction strategies," Economic Modelling, Elsevier, vol. 40(C), pages 101-116.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:93:y:2024:i:c:s1057521924001534. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.