IDEAS home Printed from https://ideas.repec.org/p/zbw/qmsrps/202104.html
   My bibliography  Save this paper

Forecasting Realized Volatility of Crude Oil Futures Prices based on Machine Learning

Author

Listed:
  • Luo, Jiawen
  • Klein, Tony
  • Walther, Thomas
  • Ji, Qiang

Abstract

Extending the popular HAR model with additional information channels to forecast realized volatility of WTI futures prices, we show that machine learning generated forecasts provide better forecasting quality and that portfolios which are constructed with these forecasts outperform their competing models and resulting in economic gains. Analyzing the selection process, we show that information channels vary across forecasting horizon. Variable selection produces clusters and provides evidence that there are structural changes with regard to the significance of information channels.

Suggested Citation

  • Luo, Jiawen & Klein, Tony & Walther, Thomas & Ji, Qiang, 2021. "Forecasting Realized Volatility of Crude Oil Futures Prices based on Machine Learning," QBS Working Paper Series 2021/04, Queen's University Belfast, Queen's Business School.
    • Handle: RePEc:zbw:qmsrps:202104
    DOI: 10.2139/ssrn.3701000
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/271249/1/qms-rp2021-04.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.2139/ssrn.3701000?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Dimitris Korobilis, 2013. "Var Forecasting Using Bayesian Variable Selection," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 204-230, March.
    2. Xavier Gabaix, 2014. "A Sparsity-Based Model of Bounded Rationality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1661-1710.
    3. Sizova, Natalia, 2011. "Integrated variance forecasting: Model based vs. reduced form," Journal of Econometrics, Elsevier, vol. 162(2), pages 294-311, June.
    4. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    5. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    6. Fulvio Corsi & Roberto Renò, 2012. "Discrete-Time Volatility Forecasting With Persistent Leverage Effect and the Link With Continuous-Time Volatility Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 368-380, January.
    7. Yacine Ait-Sahalia & Jialin Yu, 2008. "High Frequency Market Microstructure Noise Estimates and Liquidity Measures," NBER Working Papers 13825, National Bureau of Economic Research, Inc.
    8. Degiannakis, Stavros & Filis, George & Klein, Tony & Walther, Thomas, 2022. "Forecasting realized volatility of agricultural commodities," International Journal of Forecasting, Elsevier, vol. 38(1), pages 74-96.
    9. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    10. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    11. Duc Khuong Nguyen & Thomas Walther, 2020. "Modeling and forecasting commodity market volatility with long‐term economic and financial variables," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 126-142, March.
    12. Luo, Jiawen & Klein, Tony & Ji, Qiang & Hou, Chenghan, 2022. "Forecasting realized volatility of agricultural commodity futures with infinite Hidden Markov HAR models," International Journal of Forecasting, Elsevier, vol. 38(1), pages 51-73.
    13. Degiannakis, Stavros & Filis, George, 2017. "Forecasting oil price realized volatility using information channels from other asset classes," Journal of International Money and Finance, Elsevier, vol. 76(C), pages 28-49.
    14. Fong, Wai Mun & See, Kim Hock, 2002. "A Markov switching model of the conditional volatility of crude oil futures prices," Energy Economics, Elsevier, vol. 24(1), pages 71-95, January.
    15. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    16. Fattouh, Bassam, 2010. "The dynamics of crude oil price differentials," Energy Economics, Elsevier, vol. 32(2), pages 334-342, March.
    17. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    18. Narajewski, Michał & Ziel, Florian, 2020. "Econometric modelling and forecasting of intraday electricity prices," Journal of Commodity Markets, Elsevier, vol. 19(C).
    19. Jeff Fleming & Chris Kirby & Barbara Ostdiek, 2001. "The Economic Value of Volatility Timing," Journal of Finance, American Finance Association, vol. 56(1), pages 329-352, February.
    20. Luo, Yulei & Young, Eric R., 2016. "Induced uncertainty, market price of risk, and the dynamics of consumption and wealth," Journal of Economic Theory, Elsevier, vol. 163(C), pages 1-41.
    21. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    22. Gary Koop & Dimitris Korobilis, 2023. "Bayesian Dynamic Variable Selection In High Dimensions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 1047-1074, August.
    23. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    24. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    25. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    26. Afkhami, Mohamad & Cormack, Lindsey & Ghoddusi, Hamed, 2017. "Google search keywords that best predict energy price volatility," Energy Economics, Elsevier, vol. 67(C), pages 17-27.
    27. Lutz Kilian, 2009. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," American Economic Review, American Economic Association, vol. 99(3), pages 1053-1069, June.
    28. Hamilton, James D., 2003. "What is an oil shock?," Journal of Econometrics, Elsevier, vol. 113(2), pages 363-398, April.
    29. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    30. Luo, Jiawen & Ji, Qiang & Klein, Tony & Todorova, Neda & Zhang, Dayong, 2020. "On realized volatility of crude oil futures markets: Forecasting with exogenous predictors under structural breaks," Energy Economics, Elsevier, vol. 89(C).
    31. Lavko, Matus & Klein, Tony & Walther, Thomas, 2023. "Reinforcement Learning and Portfolio Allocation: Challenging Traditional Allocation Methods," QBS Working Paper Series 2023/01, Queen's University Belfast, Queen's Business School.
    32. Francesco Audrino & Marcelo C. Medeiros, 2011. "Modeling and forecasting short‐term interest rates: The benefits of smooth regimes, macroeconomic variables, and bagging," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 999-1022, September.
    33. Nomikos, Nikos K. & Pouliasis, Panos K., 2011. "Forecasting petroleum futures markets volatility: The role of regimes and market conditions," Energy Economics, Elsevier, vol. 33(2), pages 321-337, March.
    34. James H. Stock & Mark W. Watson, 2012. "Generalized Shrinkage Methods for Forecasting Using Many Predictors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(4), pages 481-493, June.
    35. Reboredo, Juan C., 2011. "How do crude oil prices co-move?: A copula approach," Energy Economics, Elsevier, vol. 33(5), pages 948-955, September.
    36. Lee, Tae-Hwy & Yang, Yang, 2006. "Bagging binary and quantile predictors for time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 465-497.
    37. Sévi, Benoît, 2014. "Forecasting the volatility of crude oil futures using intraday data," European Journal of Operational Research, Elsevier, vol. 235(3), pages 643-659.
    38. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    39. Ederington, Louis H. & Guan, Wei, 2010. "Longer-Term Time-Series Volatility Forecasts," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 45(4), pages 1055-1076, August.
    40. Marcel Prokopczuk & Lazaros Symeonidis & Chardin Wese Simen, 2016. "Do Jumps Matter for Volatility Forecasting? Evidence from Energy Markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 36(8), pages 758-792, August.
    41. Blair, Bevan J. & Poon, Ser-Huang & Taylor, Stephen J., 2001. "Forecasting S&P 100 volatility: the incremental information content of implied volatilities and high-frequency index returns," Journal of Econometrics, Elsevier, vol. 105(1), pages 5-26, November.
    42. Klein, Tony & Todorova, Neda, 2021. "Night trading with futures in China: The case of Aluminum and Copper," Resources Policy, Elsevier, vol. 73(C).
    43. Klein, Tony, 2018. "Trends and contagion in WTI and Brent crude oil spot and futures markets - The role of OPEC in the last decade," Energy Economics, Elsevier, vol. 75(C), pages 636-646.
    44. Ma, Feng & Liu, Jing & Wahab, M.I.M. & Zhang, Yaojie, 2018. "Forecasting the aggregate oil price volatility in a data-rich environment," Economic Modelling, Elsevier, vol. 72(C), pages 320-332.
    45. Elder, John & Miao, Hong & Ramchander, Sanjay, 2014. "Price discovery in crude oil futures," Energy Economics, Elsevier, vol. 46(S1), pages 18-27.
    46. Klein, Tony & Walther, Thomas, 2016. "Oil price volatility forecast with mixture memory GARCH," Energy Economics, Elsevier, vol. 58(C), pages 46-58.
    47. Kaufmann, Robert K. & Banerjee, Shayan, 2014. "A unified world oil market: Regions in physical, economic, geographic, and political space," Energy Policy, Elsevier, vol. 74(C), pages 235-242.
    48. Korobilis, Dimitris, 2017. "Quantile regression forecasts of inflation under model uncertainty," International Journal of Forecasting, Elsevier, vol. 33(1), pages 11-20.
    49. Klein, Tony, 2018. "Trends and Contagion in WTI and Brent Crude Oil Spot and Futures Markets - The Role of OPEC in the last Decade," QBS Working Paper Series 2018/05, Queen's University Belfast, Queen's Business School.
    50. Fleming, Jeff & Kirby, Chris & Ostdiek, Barbara, 2003. "The economic value of volatility timing using "realized" volatility," Journal of Financial Economics, Elsevier, vol. 67(3), pages 473-509, March.
    51. Zhang, Yaojie & Wei, Yu & Zhang, Yi & Jin, Daxiang, 2019. "Forecasting oil price volatility: Forecast combination versus shrinkage method," Energy Economics, Elsevier, vol. 80(C), pages 423-433.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Klein, Tony, 2024. "Investor behavior in times of conflict: A natural experiment on the interplay of geopolitical risk and defense stocks," Journal of Economic Behavior & Organization, Elsevier, vol. 222(C), pages 294-313.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luo, Jiawen & Ji, Qiang & Klein, Tony & Todorova, Neda & Zhang, Dayong, 2020. "On realized volatility of crude oil futures markets: Forecasting with exogenous predictors under structural breaks," Energy Economics, Elsevier, vol. 89(C).
    2. Zhang, Yaojie & Wahab, M.I.M. & Wang, Yudong, 2023. "Forecasting crude oil market volatility using variable selection and common factor," International Journal of Forecasting, Elsevier, vol. 39(1), pages 486-502.
    3. Luo, Jiawen & Demirer, Riza & Gupta, Rangan & Ji, Qiang, 2022. "Forecasting oil and gold volatilities with sentiment indicators under structural breaks," Energy Economics, Elsevier, vol. 105(C).
    4. Hardik A. Marfatia & Qiang Ji & Jiawen Luo, 2022. "Forecasting the volatility of agricultural commodity futures: The role of co‐volatility and oil volatility," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 383-404, March.
    5. Lyócsa, Štefan & Todorova, Neda & Výrost, Tomáš, 2021. "Predicting risk in energy markets: Low-frequency data still matter," Applied Energy, Elsevier, vol. 282(PA).
    6. Lyócsa, Štefan & Todorova, Neda, 2021. "What drives volatility of the U.S. oil and gas firms?," Energy Economics, Elsevier, vol. 100(C).
    7. Danyan Wen & Mengxi He & Yaojie Zhang & Yudong Wang, 2022. "Forecasting realized volatility of Chinese stock market: A simple but efficient truncated approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 230-251, March.
    8. Chen, Yixiang & Ma, Feng & Zhang, Yaojie, 2019. "Good, bad cojumps and volatility forecasting: New evidence from crude oil and the U.S. stock markets," Energy Economics, Elsevier, vol. 81(C), pages 52-62.
    9. Zhang, Yaojie & Ma, Feng & Wei, Yu, 2019. "Out-of-sample prediction of the oil futures market volatility: A comparison of new and traditional combination approaches," Energy Economics, Elsevier, vol. 81(C), pages 1109-1120.
    10. Bonnier, Jean-Baptiste, 2022. "Forecasting crude oil volatility with exogenous predictors: As good as it GETS?," Energy Economics, Elsevier, vol. 111(C).
    11. Qianjie Geng & Xianfeng Hao & Yudong Wang, 2024. "Forecasting the volatility of crude oil futures: A time‐dependent weighted least squares with regularization constraint," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 309-325, March.
    12. Luo, Jiawen & Klein, Tony & Ji, Qiang & Hou, Chenghan, 2022. "Forecasting realized volatility of agricultural commodity futures with infinite Hidden Markov HAR models," International Journal of Forecasting, Elsevier, vol. 38(1), pages 51-73.
    13. Yaojie Zhang & Mengxi He & Yuqi Zhao & Xianfeng Hao, 2023. "Predicting stock realized variance based on an asymmetric robust regression approach," Bulletin of Economic Research, Wiley Blackwell, vol. 75(4), pages 1022-1047, October.
    14. Libo Yin, 2022. "The role of intermediary capital risk in predicting oil volatility," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 401-416, January.
    15. Panagiotis Delis & Stavros Degiannakis & George Filis, 2022. "What matters when developing oil price volatility forecasting frameworks?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 361-382, March.
    16. Ma, Feng & Zhang, Yaojie & Huang, Dengshi & Lai, Xiaodong, 2018. "Forecasting oil futures price volatility: New evidence from realized range-based volatility," Energy Economics, Elsevier, vol. 75(C), pages 400-409.
    17. Wang, Jiqian & He, Xiaofeng & Ma, Feng & Li, Pan, 2022. "Uncertainty and oil volatility: Evidence from shrinkage method," Resources Policy, Elsevier, vol. 75(C).
    18. Degiannakis, Stavros & Filis, George & Klein, Tony & Walther, Thomas, 2022. "Forecasting realized volatility of agricultural commodities," International Journal of Forecasting, Elsevier, vol. 38(1), pages 74-96.
    19. Klein, Tony & Todorova, Neda, 2021. "Night trading with futures in China: The case of Aluminum and Copper," Resources Policy, Elsevier, vol. 73(C).
    20. Yaojie Zhang & Yudong Wang & Feng Ma & Yu Wei, 2022. "To jump or not to jump: momentum of jumps in crude oil price volatility prediction," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-31, December.

    More about this item

    Keywords

    Forecasting; Crude oil; Realized volatility; Exogenous predictors; Machine learning;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:qmsrps:202104. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/dequbuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.