IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i4p1804-1819.html
   My bibliography  Save this article

Stock market volatility predictability in a data-rich world: A new insight

Author

Listed:
  • Ma, Feng
  • Wang, Jiqian
  • Wahab, M.I.M.
  • Ma, Yuanhui

Abstract

This study develops a shrinkage method, LASSO with a Markov regime-switching model (MRS-LASSO), to predict US stock market volatility. A set of 17 well-known macroeconomic and financial factors are used. The out-of-sample results reveal that the MRS-LASSO model yields statistically and economically significant volatility predictions. We further investigate the predictability of MRS-LASSO with respect to different market conditions, business cycles, and variable selection. Three factors (equity market returns, a short-term reversal factor, and a consumer sentiment index) are the most frequent predictors. To investigate the practical implications, we construct the expected variance risk premium (VRP) by using volatility forecasts generated from the LASSO and MRS-LASSO models to forecast future stock returns and find that those models are also powerful.

Suggested Citation

  • Ma, Feng & Wang, Jiqian & Wahab, M.I.M. & Ma, Yuanhui, 2023. "Stock market volatility predictability in a data-rich world: A new insight," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1804-1819.
    • Handle: RePEc:eee:intfor:v:39:y:2023:i:4:p:1804-1819
    DOI: 10.1016/j.ijforecast.2022.08.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207022001194
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2022.08.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018. "Risk Everywhere: Modeling and Managing Volatility," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.
    2. Tim Bollerslev & George Tauchen & Hao Zhou, 2009. "Expected Stock Returns and Variance Risk Premia," The Review of Financial Studies, Society for Financial Studies, vol. 22(11), pages 4463-4492, November.
    3. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2007. "Roughing It Up: Including Jump Components in the Measurement, Modeling, and Forecasting of Return Volatility," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 701-720, November.
    4. Andersen, Torben G & Bollerslev, Tim, 1997. "Heterogeneous Information Arrivals and Return Volatility Dynamics: Uncovering the Long-Run in High Frequency Returns," Journal of Finance, American Finance Association, vol. 52(3), pages 975-1005, July.
    5. Degiannakis, Stavros & Filis, George, 2017. "Forecasting oil price realized volatility using information channels from other asset classes," Journal of International Money and Finance, Elsevier, vol. 76(C), pages 28-49.
    6. Wen, Fenghua & Gong, Xu & Cai, Shenghua, 2016. "Forecasting the volatility of crude oil futures using HAR-type models with structural breaks," Energy Economics, Elsevier, vol. 59(C), pages 400-413.
    7. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    8. Franc Klaassen, 2002. "Improving GARCH volatility forecasts with regime-switching GARCH," Empirical Economics, Springer, vol. 27(2), pages 363-394.
    9. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    10. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    11. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    12. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    13. Robert F. Engle & Eric Ghysels & Bumjean Sohn, 2013. "Stock Market Volatility and Macroeconomic Fundamentals," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 776-797, July.
    14. McAleer, Michael & Medeiros, Marcelo C., 2008. "A multiple regime smooth transition Heterogeneous Autoregressive model for long memory and asymmetries," Journal of Econometrics, Elsevier, vol. 147(1), pages 104-119, November.
    15. Xiao, Jihong & Wen, Fenghua & Zhao, Yupei & Wang, Xiong, 2021. "The role of US implied volatility index in forecasting Chinese stock market volatility: Evidence from HAR models," International Review of Economics & Finance, Elsevier, vol. 74(C), pages 311-333.
    16. Marcucci Juri, 2005. "Forecasting Stock Market Volatility with Regime-Switching GARCH Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(4), pages 1-55, December.
    17. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    18. Lux, Thomas & Kaizoji, Taisei, 2007. "Forecasting volatility and volume in the Tokyo Stock Market: Long memory, fractality and regime switching," Journal of Economic Dynamics and Control, Elsevier, vol. 31(6), pages 1808-1843, June.
    19. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
    20. Pesaran, M. Hashem & Timmermann, Allan, 2009. "Testing Dependence Among Serially Correlated Multicategory Variables," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 325-337.
    21. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    22. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    23. Koopman, Siem Jan & Jungbacker, Borus & Hol, Eugenie, 2005. "Forecasting daily variability of the S&P 100 stock index using historical, realised and implied volatility measurements," Journal of Empirical Finance, Elsevier, vol. 12(3), pages 445-475, June.
    24. Zhang, Yaojie & Wei, Yu & Zhang, Yi & Jin, Daxiang, 2019. "Forecasting oil price volatility: Forecast combination versus shrinkage method," Energy Economics, Elsevier, vol. 80(C), pages 423-433.
    25. Fernandes, Marcelo & Medeiros, Marcelo C. & Scharth, Marcel, 2014. "Modeling and predicting the CBOE market volatility index," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 1-10.
    26. Conrad, Christian & Loch, Karin, 2015. "The variance risk premium and fundamental uncertainty," Economics Letters, Elsevier, vol. 132(C), pages 56-60.
    27. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    28. Barunik, Jozef & Krehlik, Tomas & Vacha, Lukas, 2016. "Modeling and forecasting exchange rate volatility in time-frequency domain," European Journal of Operational Research, Elsevier, vol. 251(1), pages 329-340.
    29. Audrino, Francesco & Sigrist, Fabio & Ballinari, Daniele, 2020. "The impact of sentiment and attention measures on stock market volatility," International Journal of Forecasting, Elsevier, vol. 36(2), pages 334-357.
    30. He, Feng & Ma, Feng & Wang, Ziwei & Yang, Bohan, 2021. "Asymmetric volatility spillover between oil-importing and oil-exporting countries' economic policy uncertainty and China's energy sector," International Review of Financial Analysis, Elsevier, vol. 75(C).
    31. Christian Conrad & Onno Kleen, 2020. "Two are better than one: Volatility forecasting using multiplicative component GARCH‐MIDAS models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 19-45, January.
    32. Cheng, Mingmian & Swanson, Norman R. & Yang, Xiye, 2021. "Forecasting volatility using double shrinkage methods," Journal of Empirical Finance, Elsevier, vol. 62(C), pages 46-61.
    33. Yao, Xingzhi & Izzeldin, Marwan & Li, Zhenxiong, 2019. "A novel cluster HAR-type model for forecasting realized volatility," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1318-1331.
    34. Wilms, Ines & Rombouts, Jeroen & Croux, Christophe, 2021. "Multivariate volatility forecasts for stock market indices," International Journal of Forecasting, Elsevier, vol. 37(2), pages 484-499.
    35. Itamar Drechsler & Amir Yaron, 2011. "What's Vol Got to Do with It," The Review of Financial Studies, Society for Financial Studies, vol. 24(1), pages 1-45.
    36. Buncic, Daniel & Gisler, Katja I.M., 2017. "The role of jumps and leverage in forecasting volatility in international equity markets," Journal of International Money and Finance, Elsevier, vol. 79(C), pages 1-19.
    37. Fang, Tong & Lee, Tae-Hwy & Su, Zhi, 2020. "Predicting the long-term stock market volatility: A GARCH-MIDAS model with variable selection," Journal of Empirical Finance, Elsevier, vol. 58(C), pages 36-49.
    38. Sévi, Benoît, 2014. "Forecasting the volatility of crude oil futures using intraday data," European Journal of Operational Research, Elsevier, vol. 235(3), pages 643-659.
    39. Zhang, Yue-Jun & Yao, Ting & He, Ling-Yun & Ripple, Ronald, 2019. "Volatility forecasting of crude oil market: Can the regime switching GARCH model beat the single-regime GARCH models?," International Review of Economics & Finance, Elsevier, vol. 59(C), pages 302-317.
    40. Wang, Jiqian & Lu, Xinjie & He, Feng & Ma, Feng, 2020. "Which popular predictor is more useful to forecast international stock markets during the coronavirus pandemic: VIX vs EPU?," International Review of Financial Analysis, Elsevier, vol. 72(C).
    41. Kim, Chang-Jin, 1994. "Dynamic linear models with Markov-switching," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 1-22.
    42. Wang, Yudong & Wei, Yu & Wu, Chongfeng & Yin, Libo, 2018. "Oil and the short-term predictability of stock return volatility," Journal of Empirical Finance, Elsevier, vol. 47(C), pages 90-104.
    43. Wang, Yudong & Ma, Feng & Wei, Yu & Wu, Chongfeng, 2016. "Forecasting realized volatility in a changing world: A dynamic model averaging approach," Journal of Banking & Finance, Elsevier, vol. 64(C), pages 136-149.
    44. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    45. Chao Liang & Yu Wei & Yaojie Zhang, 2020. "Is implied volatility more informative for forecasting realized volatility: An international perspective," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(8), pages 1253-1276, December.
    46. Lyócsa, Štefan & Molnár, Peter & Výrost, Tomáš, 2021. "Stock market volatility forecasting: Do we need high-frequency data?," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1092-1110.
    47. Marc Lavielle & Gilles Teyssière, 2007. "Adaptive Detection of Multiple Change-Points in Asset Price Volatility," Springer Books, in: Gilles Teyssière & Alan P. Kirman (ed.), Long Memory in Economics, pages 129-156, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Junyu & Ruan, Xinfeng & Zhang, Jin E., 2023. "Do short-term market swings improve realized volatility forecasts?," Finance Research Letters, Elsevier, vol. 58(PD).
    2. Li, Xiaodan & Gong, Xue & Xing, Lu, 2024. "The impact of presidential economic approval rating on stock volatility: An industrial perspective," Finance Research Letters, Elsevier, vol. 63(C).
    3. Feng, Lingbing & Qi, Jiajun & Lucey, Brian, 2024. "Enhancing cryptocurrency market volatility forecasting with daily dynamic tuning strategy," International Review of Financial Analysis, Elsevier, vol. 94(C).
    4. Jixiang, Zhang & Feng, Ma, 2024. "Video apps user engagement and stock market volatility: Evidence from China," Finance Research Letters, Elsevier, vol. 64(C).
    5. Díaz, Juan D. & Hansen, Erwin & Cabrera, Gabriel, 2024. "Machine-learning stock market volatility: Predictability, drivers, and economic value," International Review of Financial Analysis, Elsevier, vol. 94(C).
    6. Chen, Yan & Liu, Yakun & Zhang, Feipeng, 2024. "Coskewness and the short-term predictability for Bitcoin return," Technological Forecasting and Social Change, Elsevier, vol. 200(C).
    7. Niu, Zibo & Demirer, Riza & Suleman, Muhammad Tahir & Zhang, Hongwei & Zhu, Xuehong, 2024. "Do industries predict stock market volatility? Evidence from machine learning models," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Ping & Han, Wei & Huang, Chengcheng & Duong, Duy, 2022. "Forecasting realised volatility from search volume and overnight sentiment: Evidence from China," Research in International Business and Finance, Elsevier, vol. 62(C).
    2. Wang, Jiqian & He, Xiaofeng & Ma, Feng & Li, Pan, 2022. "Uncertainty and oil volatility: Evidence from shrinkage method," Resources Policy, Elsevier, vol. 75(C).
    3. Liang, Chao & Luo, Qin & Li, Yan & Huynh, Luu Duc Toan, 2023. "Global financial stress index and long-term volatility forecast for international stock markets," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 88(C).
    4. Zhang, Yaojie & Lei, Likun & Wei, Yu, 2020. "Forecasting the Chinese stock market volatility with international market volatilities: The role of regime switching," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    5. Ma, Feng & Wahab, M.I.M. & Zhang, Yaojie, 2019. "Forecasting the U.S. stock volatility: An aligned jump index from G7 stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 132-146.
    6. Zhang, Lixia & Luo, Qin & Guo, Xiaozhu & Umar, Muhammad, 2022. "Medium-term and long-term volatility forecasts for EUA futures with country-specific economic policy uncertainty indices," Resources Policy, Elsevier, vol. 77(C).
    7. Chen, Wang & Ma, Feng & Wei, Yu & Liu, Jing, 2020. "Forecasting oil price volatility using high-frequency data: New evidence," International Review of Economics & Finance, Elsevier, vol. 66(C), pages 1-12.
    8. Jiqian Wang & Feng Ma & Chao Liang & Zhonglu Chen, 2022. "Volatility forecasting revisited using Markov‐switching with time‐varying probability transition," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 1387-1400, January.
    9. Zhang, Yaojie & Ma, Feng & Wei, Yu, 2019. "Out-of-sample prediction of the oil futures market volatility: A comparison of new and traditional combination approaches," Energy Economics, Elsevier, vol. 81(C), pages 1109-1120.
    10. Jin, Daxiang & He, Mengxi & Xing, Lu & Zhang, Yaojie, 2022. "Forecasting China's crude oil futures volatility: How to dig out the information of other energy futures volatilities?," Resources Policy, Elsevier, vol. 78(C).
    11. Yi, Yongsheng & He, Mengxi & Zhang, Yaojie, 2022. "Out-of-sample prediction of Bitcoin realized volatility: Do other cryptocurrencies help?," The North American Journal of Economics and Finance, Elsevier, vol. 62(C).
    12. Ma, Feng & Wahab, M.I.M. & Huang, Dengshi & Xu, Weiju, 2017. "Forecasting the realized volatility of the oil futures market: A regime switching approach," Energy Economics, Elsevier, vol. 67(C), pages 136-145.
    13. Ding, Hui & Huang, Yisu & Wang, Jiqian, 2023. "Have the predictability of oil changed during the COVID-19 pandemic: Evidence from international stock markets," International Review of Financial Analysis, Elsevier, vol. 87(C).
    14. Yaojie Zhang & Mengxi He & Yuqi Zhao & Xianfeng Hao, 2023. "Predicting stock realized variance based on an asymmetric robust regression approach," Bulletin of Economic Research, Wiley Blackwell, vol. 75(4), pages 1022-1047, October.
    15. Liang, Chao & Tang, Linchun & Li, Yan & Wei, Yu, 2020. "Which sentiment index is more informative to forecast stock market volatility? Evidence from China," International Review of Financial Analysis, Elsevier, vol. 71(C).
    16. Danyan Wen & Mengxi He & Yaojie Zhang & Yudong Wang, 2022. "Forecasting realized volatility of Chinese stock market: A simple but efficient truncated approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 230-251, March.
    17. Chen, Yixiang & Ma, Feng & Zhang, Yaojie, 2019. "Good, bad cojumps and volatility forecasting: New evidence from crude oil and the U.S. stock markets," Energy Economics, Elsevier, vol. 81(C), pages 52-62.
    18. Chao Liang & Yan Li & Feng Ma & Yaojie Zhang, 2022. "Forecasting international equity market volatility: A new approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(7), pages 1433-1457, November.
    19. Yaojie Zhang & Yudong Wang & Feng Ma & Yu Wei, 2022. "To jump or not to jump: momentum of jumps in crude oil price volatility prediction," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-31, December.
    20. Li, Zhao-Chen & Xie, Chi & Zeng, Zhi-Jian & Wang, Gang-Jin & Zhang, Ting, 2023. "Forecasting global stock market volatilities in an uncertain world," International Review of Financial Analysis, Elsevier, vol. 85(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:4:p:1804-1819. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.