IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v96y2024ipbs1057521924006434.html
   My bibliography  Save this article

Macro-Driven Stock Market Volatility Prediction: Insights from a New Hybrid Machine Learning Approach

Author

Listed:
  • Zeng, Qing
  • Lu, Xinjie
  • Xu, Jin
  • Lin, Yu

Abstract

This study comprehensively investigates stock market volatility based on over one hundred monthly macroeconomic variables, applying machine learning models. Methodological contribution integrating the random forest (RF) with the least absolute shrinkage and selection operator methods (LASSO). Importantly, the RF-LASSO model can robustly achieve the best forecasting performance under different circumstances. In addition, we focus on model explanation from different perspectives based on permutation importance and shapley additive explanation (SHAP) methods. This study illuminates novel insights into the realm of stock market volatility, harnessing the transformative potential of machine learning methodologies.

Suggested Citation

  • Zeng, Qing & Lu, Xinjie & Xu, Jin & Lin, Yu, 2024. "Macro-Driven Stock Market Volatility Prediction: Insights from a New Hybrid Machine Learning Approach," International Review of Financial Analysis, Elsevier, vol. 96(PB).
    • Handle: RePEc:eee:finana:v:96:y:2024:i:pb:s1057521924006434
    DOI: 10.1016/j.irfa.2024.103711
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521924006434
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.irfa.2024.103711?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Daniele Bianchi & Matthias Büchner & Tobias Hoogteijling & Andrea Tamoni, 2021. "Corrigendum: Bond Risk Premiums with Machine Learning [Bond risk premiums with machine learning]," The Review of Financial Studies, Society for Financial Studies, vol. 34(2), pages 1090-1103.
    3. Lawrence Christiano & Mathias Trabandt & Karl Walentin, 2021. "Involuntary Unemployment and the Business Cycle," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 39, pages 26-54, January.
    4. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2008. "Trusting the Stock Market," Journal of Finance, American Finance Association, vol. 63(6), pages 2557-2600, December.
    5. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    6. Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018. "Risk Everywhere: Modeling and Managing Volatility," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.
    7. Leippold, Markus & Wang, Qian & Zhou, Wenyu, 2022. "Machine learning in the Chinese stock market," Journal of Financial Economics, Elsevier, vol. 145(2), pages 64-82.
    8. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    9. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    10. Bollerslev, Tim & Ole Mikkelsen, Hans, 1996. "Modeling and pricing long memory in stock market volatility," Journal of Econometrics, Elsevier, vol. 73(1), pages 151-184, July.
    11. Hedayati , Amin & Hedayati , Moein & Esfandyari, Morteza, 2016. "Stock market index prediction using artificial neural network," Journal of Economics, Finance and Administrative Science, Universidad ESAN, vol. 21(41), pages 89-93.
    12. Gala, Vito D. & Pagliardi, Giovanni & Zenios, Stavros A., 2023. "Global political risk and international stock returns," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 78-102.
    13. Niu, Zibo & Demirer, Riza & Suleman, Muhammad Tahir & Zhang, Hongwei & Zhu, Xuehong, 2024. "Do industries predict stock market volatility? Evidence from machine learning models," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    14. Desheng Wu, 2016. "Risk management and operations research: a review and introduction to the special volume," Annals of Operations Research, Springer, vol. 237(1), pages 1-5, February.
    15. Desheng Wu, 2016. "Risk management and operations research: a review and introduction to the special volume," Annals of Operations Research, Springer, vol. 237(1), pages 1-5, February.
    16. Lu, Xinjie & Ma, Feng & Wang, Jiqian & Zhu, Bo, 2021. "Oil shocks and stock market volatility: New evidence," Energy Economics, Elsevier, vol. 103(C).
    17. Chortareas, Georgios & Noikokyris, Emmanouil, 2014. "Monetary policy and stock returns under the MPC and inflation targeting," International Review of Financial Analysis, Elsevier, vol. 31(C), pages 109-116.
    18. Girardin, Eric & Joyeux, Roselyne, 2013. "Macro fundamentals as a source of stock market volatility in China: A GARCH-MIDAS approach," Economic Modelling, Elsevier, vol. 34(C), pages 59-68.
    19. Daniele Bianchi & Matthias Büchner & Andrea Tamoni, 2021. "Bond Risk Premiums with Machine Learning [Quadratic term structure models: Theory and evidence]," The Review of Financial Studies, Society for Financial Studies, vol. 34(2), pages 1046-1089.
    20. Keywan Christian Rasekhschaffe & Robert C. Jones, 2019. "Machine Learning for Stock Selection," Financial Analysts Journal, Taylor & Francis Journals, vol. 75(3), pages 70-88, July.
    21. Rangan Gupta & Jacobus Nel & Christian Pierdzioch, 2023. "Investor Confidence and Forecastability of US Stock Market Realized Volatility: Evidence from Machine Learning," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 24(1), pages 111-122, January.
    22. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    23. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    24. Pesaran, M. Hashem & Schleicher, Christoph & Zaffaroni, Paolo, 2009. "Model averaging in risk management with an application to futures markets," Journal of Empirical Finance, Elsevier, vol. 16(2), pages 280-305, March.
    25. Wang, Hansheng & Leng, Chenlei, 2008. "A note on adaptive group lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5277-5286, August.
    26. repec:bla:jfinan:v:44:y:1989:i:5:p:1115-53 is not listed on IDEAS
    27. Kim Christensen & Mathias Siggaard & Bezirgen Veliyev, 2023. "A Machine Learning Approach to Volatility Forecasting," Journal of Financial Econometrics, Oxford University Press, vol. 21(5), pages 1680-1727.
    28. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    29. repec:eme:bsppss:09657960410563540 is not listed on IDEAS
    30. Michael Power, 2004. "The risk management of everything," Journal of Risk Finance, Emerald Group Publishing Limited, vol. 5(3), pages 58-65, March.
    31. Fang, Tong & Lee, Tae-Hwy & Su, Zhi, 2020. "Predicting the long-term stock market volatility: A GARCH-MIDAS model with variable selection," Journal of Empirical Finance, Elsevier, vol. 58(C), pages 36-49.
    32. Liang, Chao & Li, Yan & Ma, Feng & Wei, Yu, 2021. "Global equity market volatilities forecasting: A comparison of leverage effects, jumps, and overnight information," International Review of Financial Analysis, Elsevier, vol. 75(C).
    33. Razmi, Seyedeh Fatemeh & Ramezanian Bajgiran, Bahareh & Behname, Mehdi & Salari, Taghi Ebrahimi & Razmi, Seyed Mohammad Javad, 2020. "The relationship of renewable energy consumption to stock market development and economic growth in Iran," Renewable Energy, Elsevier, vol. 145(C), pages 2019-2024.
    34. Liang, Chao & Wang, Lu & Duong, Duy, 2024. "More attention and better volatility forecast accuracy: How does war attention affect stock volatility predictability?," Journal of Economic Behavior & Organization, Elsevier, vol. 218(C), pages 1-19.
    35. Lu, Fei & Ma, Feng & Guo, Qiang, 2023. "Less is more? New evidence from stock market volatility predictability," International Review of Financial Analysis, Elsevier, vol. 89(C).
    36. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    37. Svetlana Borovkova & Ioannis Tsiamas, 2019. "An ensemble of LSTM neural networks for high‐frequency stock market classification," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 38(6), pages 600-619, September.
    38. Feng Ma & Yu Wei & Li Liu & Dengshi Huang, 2018. "Forecasting realized volatility of oil futures market: A new insight," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(4), pages 419-436, July.
    39. McKibbin, Warwick & Fernando, Roshen, 2023. "The global economic impacts of the COVID-19 pandemic," Economic Modelling, Elsevier, vol. 129(C).
    40. Sharma, Prateek & Vipul,, 2016. "Forecasting stock market volatility using Realized GARCH model: International evidence," The Quarterly Review of Economics and Finance, Elsevier, vol. 59(C), pages 222-230.
    41. Ma, Feng & Wang, Jiqian & Wahab, M.I.M. & Ma, Yuanhui, 2023. "Stock market volatility predictability in a data-rich world: A new insight," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1804-1819.
    42. Liu, Qigui & Tang, Jinghua & Li, Donghui & Xing, Lu, 2023. "The role of bad-news coverage and media environments in crash risk around the world," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 488-509.
    43. Aven, Terje, 2016. "Risk assessment and risk management: Review of recent advances on their foundation," European Journal of Operational Research, Elsevier, vol. 253(1), pages 1-13.
    44. Niu, Zibo & Ma, Feng & Zhang, Hongwei, 2022. "The role of uncertainty measures in volatility forecasting of the crude oil futures market before and during the COVID-19 pandemic," Energy Economics, Elsevier, vol. 112(C).
    45. Lawrence Christiano & Mathias Trabandt & Karl Walentin, 2021. "Involuntary Unemployment and the Business Cycle," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 39, pages 26-54, January.
    46. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    47. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    48. Zhang, Yaojie & Wei, Yu & Zhang, Yi & Jin, Daxiang, 2019. "Forecasting oil price volatility: Forecast combination versus shrinkage method," Energy Economics, Elsevier, vol. 80(C), pages 423-433.
    49. Fernandez-Perez, Adrian & Gilbert, Aaron & Indriawan, Ivan & Nguyen, Nhut H., 2021. "COVID-19 pandemic and stock market response: A culture effect," Journal of Behavioral and Experimental Finance, Elsevier, vol. 29(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Díaz, Juan D. & Hansen, Erwin & Cabrera, Gabriel, 2024. "Machine-learning stock market volatility: Predictability, drivers, and economic value," International Review of Financial Analysis, Elsevier, vol. 94(C).
    2. Lu, Xinjie & Ma, Feng & Xu, Jin & Zhang, Zehui, 2022. "Oil futures volatility predictability: New evidence based on machine learning models11All the authors contribute to the paper equally," International Review of Financial Analysis, Elsevier, vol. 83(C).
    3. Niu, Zibo & Demirer, Riza & Suleman, Muhammad Tahir & Zhang, Hongwei & Zhu, Xuehong, 2024. "Do industries predict stock market volatility? Evidence from machine learning models," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    4. Zhang, Yaojie & Wahab, M.I.M. & Wang, Yudong, 2023. "Forecasting crude oil market volatility using variable selection and common factor," International Journal of Forecasting, Elsevier, vol. 39(1), pages 486-502.
    5. Li, Zhao-Chen & Xie, Chi & Wang, Gang-Jin & Zhu, You & Zeng, Zhi-Jian & Gong, Jue, 2024. "Forecasting global stock market volatilities: A shrinkage heterogeneous autoregressive (HAR) model with a large cross-market predictor set," International Review of Economics & Finance, Elsevier, vol. 93(PB), pages 673-711.
    6. Pan, Zhiyuan & Zhong, Hao & Wang, Yudong & Huang, Juan, 2024. "Forecasting oil futures returns with news," Energy Economics, Elsevier, vol. 134(C).
    7. Zhang, Hongwei & Wang, Wentao & Niu, Zibo, 2024. "Geopolitical risks and crude oil futures volatility: Evidence from machine learning," Resources Policy, Elsevier, vol. 98(C).
    8. Borup, Daniel & Christensen, Bent Jesper & Mühlbach, Nicolaj Søndergaard & Nielsen, Mikkel Slot, 2023. "Targeting predictors in random forest regression," International Journal of Forecasting, Elsevier, vol. 39(2), pages 841-868.
    9. Liu, Guangqiang & Guo, Xiaozhu, 2022. "Forecasting stock market volatility using commodity futures volatility information," Resources Policy, Elsevier, vol. 75(C).
    10. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    11. Zhang, Hongwei & Zhao, Xinyi & Gao, Wang & Niu, Zibo, 2023. "The role of higher moments in predicting China's oil futures volatility: Evidence from machine learning models," Journal of Commodity Markets, Elsevier, vol. 32(C).
    12. Wen, Danyan & He, Mengxi & Wang, Yudong & Zhang, Yaojie, 2024. "Forecasting crude oil market volatility: A comprehensive look at uncertainty variables," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1022-1041.
    13. Faria, Gonçalo & Verona, Fabio, 2024. "Enhancing forecast accuracy through frequencydomain combination: Applications to financial and economic indicators," Bank of Finland Research Discussion Papers 14/2024, Bank of Finland.
    14. Niu, Zibo & Wang, Chenlu & Zhang, Hongwei, 2023. "Forecasting stock market volatility with various geopolitical risks categories: New evidence from machine learning models," International Review of Financial Analysis, Elsevier, vol. 89(C).
    15. Cakici, Nusret & Shahzad, Syed Jawad Hussain & Będowska-Sójka, Barbara & Zaremba, Adam, 2024. "Machine learning and the cross-section of cryptocurrency returns," International Review of Financial Analysis, Elsevier, vol. 94(C).
    16. Zhang, Yaojie & Wang, Yudong, 2023. "Forecasting crude oil futures market returns: A principal component analysis combination approach," International Journal of Forecasting, Elsevier, vol. 39(2), pages 659-673.
    17. Wang, Jiqian & He, Xiaofeng & Ma, Feng & Li, Pan, 2022. "Uncertainty and oil volatility: Evidence from shrinkage method," Resources Policy, Elsevier, vol. 75(C).
    18. Wang, Jiqian & Ma, Feng & Bouri, Elie & Zhong, Juandan, 2022. "Volatility of clean energy and natural gas, uncertainty indices, and global economic conditions," Energy Economics, Elsevier, vol. 108(C).
    19. DeMiguel, Victor & Gil-Bazo, Javier & Nogales, Francisco J. & Santos, André A.P., 2023. "Machine learning and fund characteristics help to select mutual funds with positive alpha," Journal of Financial Economics, Elsevier, vol. 150(3).
    20. Luo, Qin & Bu, Jinfeng & Xu, Weiju & Huang, Dengshi, 2023. "Stock market volatility prediction: Evidence from a new bagging model," International Review of Economics & Finance, Elsevier, vol. 87(C), pages 445-456.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:96:y:2024:i:pb:s1057521924006434. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.