IDEAS home Printed from https://ideas.repec.org/a/taf/hbhfxx/v24y2023i1p111-122.html
   My bibliography  Save this article

Investor Confidence and Forecastability of US Stock Market Realized Volatility: Evidence from Machine Learning

Author

Listed:
  • Rangan Gupta
  • Jacobus Nel
  • Christian Pierdzioch

Abstract

Using a machine-learning technique known as random forests, we analyze the role of investor confidence in forecasting monthly aggregate realized stock-market volatility of the United States (US), over and above a wide-array of macroeconomic and financial variables. We estimate random forests on data for a period from 2001 to 2020, and study horizons up to one year by computing forecasts for recursive and a rolling estimation window. We find that investor confidence, and especially investor confidence uncertainty has out-of-sample predictive value for overall realized volatility, as well as its “good” and “bad” variants. Our results have important implications for investors and policymakers.

Suggested Citation

  • Rangan Gupta & Jacobus Nel & Christian Pierdzioch, 2023. "Investor Confidence and Forecastability of US Stock Market Realized Volatility: Evidence from Machine Learning," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 24(1), pages 111-122, January.
    • Handle: RePEc:taf:hbhfxx:v:24:y:2023:i:1:p:111-122
    DOI: 10.1080/15427560.2021.1949719
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/15427560.2021.1949719
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/15427560.2021.1949719?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Nasr, Adnen Ben & Lux, Thomas & Ajmi, Ahdi Noomen & Gupta, Rangan, 2016. "Forecasting the volatility of the Dow Jones Islamic Stock Market Index: Long memory vs. regime switching," International Review of Economics & Finance, Elsevier, vol. 45(C), pages 559-571.
    2. Asgharian, Hossein & Hou, Ai Jun & Javed, Farrukh, 2013. "Importance of the macroeconomic variables for variance prediction A GARCH-MIDAS approach," Knut Wicksell Working Paper Series 2013/4, Lund University, Knut Wicksell Centre for Financial Studies.
    3. Robert F. Engle & Jose Gonzalo Rangel, 2008. "The Spline-GARCH Model for Low-Frequency Volatility and Its Global Macroeconomic Causes," The Review of Financial Studies, Society for Financial Studies, vol. 21(3), pages 1187-1222, May.
    4. Afees A. Salisu & Rangan Gupta & Ahamuefula E. Ogbonna, 2022. "A moving average heterogeneous autoregressive model for forecasting the realized volatility of the US stock market: Evidence from over a century of data," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 384-400, January.
    5. X. Frank Zhang, 2006. "Information Uncertainty and Stock Returns," Journal of Finance, American Finance Association, vol. 61(1), pages 105-137, February.
    6. Guofu Zhou, 2018. "Measuring Investor Sentiment," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 239-259, November.
    7. Stelios Bekiros & Rangan Gupta & Clement Kyei, 2016. "A non-linear approach for predicting stock returns and volatility with the use of investor sentiment indices," Applied Economics, Taylor & Francis Journals, vol. 48(31), pages 2895-2898, July.
    8. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    9. José Rangel & Robert Engle, 2012. "The Factor–Spline–GARCH Model for High and Low Frequency Correlations," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 109-124.
    10. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    11. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    12. Diego Escobari & Mohammad Jafarinejad, 2019. "Investors’ Uncertainty and Stock Market Risk," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 20(3), pages 304-315, July.
    13. Elie Bouri & Konstantinos Gkillas & Rangan Gupta & Christian Pierdzioch, 2021. "Forecasting Realized Volatility of Bitcoin: The Role of the Trade War," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 29-53, January.
    14. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    15. Zhi Da & Joseph Engelberg & Pengjie Gao, 2015. "Editor's Choice The Sum of All FEARS Investor Sentiment and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 28(1), pages 1-32.
    16. John Y. Campbell, 2008. "Viewpoint: Estimating the equity premium," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(1), pages 1-21, February.
    17. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    18. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    19. Muller, Ulrich A. & Dacorogna, Michel M. & Dave, Rakhal D. & Olsen, Richard B. & Pictet, Olivier V. & von Weizsacker, Jacob E., 1997. "Volatilities of different time resolutions -- Analyzing the dynamics of market components," Journal of Empirical Finance, Elsevier, vol. 4(2-3), pages 213-239, June.
    20. Adnen Ben Nasr & Ahdi Noomen Ajmi & Rangan Gupta, 2014. "Modelling the volatility of the Dow Jones Islamic Market World Index using a fractionally integrated time-varying GARCH (FITVGARCH) model," Applied Financial Economics, Taylor & Francis Journals, vol. 24(14), pages 993-1004, July.
    21. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    22. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    23. John Y. Campbell, 2007. "Estimating the Equity Premium," NBER Working Papers 13423, National Bureau of Economic Research, Inc.
    24. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    25. Robert F. Engle & Eric Ghysels & Bumjean Sohn, 2013. "Stock Market Volatility and Macroeconomic Fundamentals," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 776-797, July.
    26. Kaminska, Iryna & Roberts-Sklar, Matt, 2018. "Volatility in equity markets and monetary policy rate uncertainty," Journal of Empirical Finance, Elsevier, vol. 45(C), pages 68-83.
    27. Mei, Dexiang & Liu, Jing & Ma, Feng & Chen, Wang, 2017. "Forecasting stock market volatility: Do realized skewness and kurtosis help?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 481(C), pages 153-159.
    28. Tiwari, Aviral Kumar & Cunado, Juncal & Gupta, Rangan & Wohar, Mark E., 2018. "Volatility spillovers across global asset classes: Evidence from time and frequency domains," The Quarterly Review of Economics and Finance, Elsevier, vol. 70(C), pages 194-202.
    29. Deven Bathia & Don Bredin, 2013. "An examination of investor sentiment effect on G7 stock market returns," The European Journal of Finance, Taylor & Francis Journals, vol. 19(9), pages 909-937, October.
    30. Christian Conrad & Karin Loch, 2015. "Anticipating Long‐Term Stock Market Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(7), pages 1090-1114, November.
    31. Giot, Pierre & Laurent, Sébastien & Petitjean, Mikael, 2010. "Trading activity, realized volatility and jumps," Journal of Empirical Finance, Elsevier, vol. 17(1), pages 168-175, January.
    32. Sydney C. Ludvigson & Sai Ma & Serena Ng, 2021. "Uncertainty and Business Cycles: Exogenous Impulse or Endogenous Response?," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(4), pages 369-410, October.
    33. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    34. Hossein Asgharian & Ai Jun Hou & Farrukh Javed, 2013. "The Importance of the Macroeconomic Variables in Forecasting Stock Return Variance: A GARCH‐MIDAS Approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(7), pages 600-612, November.
    35. Sydney C. Ludvigson & Serena Ng, 2009. "Macro Factors in Bond Risk Premia," The Review of Financial Studies, Society for Financial Studies, vol. 22(12), pages 5027-5067, December.
    36. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    37. Scott R Baker & Nicholas Bloom & Steven J Davis & Kyle Kost & Marco Sammon & Tasaneeya Viratyosin & Jeffrey Pontiff, 0. "The Unprecedented Stock Market Reaction to COVID-19," The Review of Asset Pricing Studies, Society for Financial Studies, vol. 10(4), pages 742-758.
    38. Mittnik, Stefan & Robinzonov, Nikolay & Spindler, Martin, 2015. "Stock market volatility: Identifying major drivers and the nature of their impact," Journal of Banking & Finance, Elsevier, vol. 58(C), pages 1-14.
    39. Jun Ma & Mark Wohar (ed.), 2014. "Recent Advances in Estimating Nonlinear Models," Springer Books, Springer, edition 127, number 978-1-4614-8060-0, April.
    40. Jason Greene & Scott Smart, 1999. "Liquidity Provision and Noise Trading: Evidence from the “Investment Dartboard” Column," Journal of Finance, American Finance Association, vol. 54(5), pages 1885-1899, October.
    41. Clark, Peter K, 1973. "A Subordinated Stochastic Process Model with Finite Variance for Speculative Prices," Econometrica, Econometric Society, vol. 41(1), pages 135-155, January.
    42. Liu, Li & Zhang, Tao, 2015. "Economic policy uncertainty and stock market volatility," Finance Research Letters, Elsevier, vol. 15(C), pages 99-105.
    43. Copeland, Thomas E, 1976. "A Model of Asset Trading under the Assumption of Sequential Information Arrival," Journal of Finance, American Finance Association, vol. 31(4), pages 1149-1168, September.
    44. Mehmet Balcilar & Rangan Gupta & Clement Kyei, 2018. "Predicting Stock Returns And Volatility With Investor Sentiment Indices: A Reconsideration Using A Nonparametric Causality†In†Quantiles Test," Bulletin of Economic Research, Wiley Blackwell, vol. 70(1), pages 74-87, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bonato, Matteo & Cepni, Oguzhan & Gupta, Rangan & Pierdzioch, Christian, 2023. "Climate risks and state-level stock market realized volatility," Journal of Financial Markets, Elsevier, vol. 66(C).
    2. Afees A. Salisu & Wenting Liao & Rangan Gupta & Oguzhan Cepni, 2023. "Economic Conditions and Predictability of US Stock Returns Volatility: Local Factor versus National Factor in a GARCH-MIDAS Model," Working Papers 202323, University of Pretoria, Department of Economics.
    3. Tang, Pan & Xu, Wei & Wang, Haosen, 2024. "Network-Based prediction of financial cross-sector risk spillover in China: A deep learning approach," The North American Journal of Economics and Finance, Elsevier, vol. 72(C).
    4. Gunnarsson, Elias Søvik & Isern, Håkon Ramon & Kaloudis, Aristidis & Risstad, Morten & Vigdel, Benjamin & Westgaard, Sjur, 2024. "Prediction of realized volatility and implied volatility indices using AI and machine learning: A review," International Review of Financial Analysis, Elsevier, vol. 93(C).
    5. Matteo Bonato & Oguzhan Cepni & Rangan Gupta & Christian Pierdzioch, 2024. "Business applications and state‐level stock market realized volatility: A forecasting experiment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 456-472, March.
    6. Cai, Yi & Tang, Zhenpeng & Chen, Ying, 2024. "Can real-time investor sentiment help predict the high-frequency stock returns? Evidence from a mixed-frequency-rolling decomposition forecasting method," The North American Journal of Economics and Finance, Elsevier, vol. 72(C).
    7. Etaf Alshawarbeh & Alanazi Talal Abdulrahman & Eslam Hussam, 2023. "Statistical Modeling of High Frequency Datasets Using the ARIMA-ANN Hybrid," Mathematics, MDPI, vol. 11(22), pages 1-17, November.
    8. Yuvana Jaichand & Renee van Eyden & Rangan Gupta, 2024. "Presidential Approval Ratings and Stock Market Performance in Latin America," Working Papers 202411, University of Pretoria, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo Bonato & Oguzhan Cepni & Rangan Gupta & Christian Pierdzioch, 2024. "Business applications and state‐level stock market realized volatility: A forecasting experiment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 456-472, March.
    2. Ruipeng Liu & Rangan Gupta & Elie Bouri, 2021. "Conventional and Unconventional Monetary Policy Rate Uncertainty and Stock Market Volatility: A Forecasting Perspective," Working Papers 202178, University of Pretoria, Department of Economics.
    3. Riza Demirer & Rangan Gupta & Christian Pierdzioch, 2020. "Forecasting Realized Stock-Market Volatility: Do Industry Returns have Predictive Value?," Working Papers 2020107, University of Pretoria, Department of Economics.
    4. Matteo Bonato & Konstantinos Gkillas & Rangan Gupta & Christian Pierdzioch, 2020. "Investor Happiness and Predictability of the Realized Volatility of Oil Price," Sustainability, MDPI, vol. 12(10), pages 1-11, May.
    5. Oguzhan Cepni & Riza Demirer & Rangan Gupta & Christian Pierdzioch, 2024. "Political Geography and Stock Market Volatility: The Role of Political Alignment across Sentiment Regimes," Working Papers 202414, University of Pretoria, Department of Economics.
    6. Afees A. Salisu & Wenting Liao & Rangan Gupta & Oguzhan Cepni, 2023. "Economic Conditions and Predictability of US Stock Returns Volatility: Local Factor versus National Factor in a GARCH-MIDAS Model," Working Papers 202323, University of Pretoria, Department of Economics.
    7. Rangan Gupta & Yuvana Jaichand & Christian Pierdzioch & Reneé van Eyden, 2023. "Realized Stock-Market Volatility of the United States and the Presidential Approval Rating," Mathematics, MDPI, vol. 11(13), pages 1-27, July.
    8. Riza Demirer & Rangan Gupta & He Li & Yu You, 2021. "Financial Vulnerability and Volatility in Emerging Stock Markets: Evidence from GARCH-MIDAS Models," Working Papers 202112, University of Pretoria, Department of Economics.
    9. Bonato, Matteo & Gkillas, Konstantinos & Gupta, Rangan & Pierdzioch, Christian, 2021. "A note on investor happiness and the predictability of realized volatility of gold," Finance Research Letters, Elsevier, vol. 39(C).
    10. Hossein Hassani & Mohammad Reza Yeganegi & Rangan Gupta & Riza Demirer, 2018. "Forecasting Stock Market (Realized) Volatility in the United Kingdom: Is There a Role for Economic Inequality?," Working Papers 201880, University of Pretoria, Department of Economics.
    11. Afees A. Salisu & Riza Demirer & Rangan Gupta, 2023. "Technological Shocks and Stock Market Volatility Over a Century: A GARCH-MIDAS Approach," Working Papers 202308, University of Pretoria, Department of Economics.
    12. Megaritis, Anastasios & Vlastakis, Nikolaos & Triantafyllou, Athanasios, 2021. "Stock market volatility and jumps in times of uncertainty," Journal of International Money and Finance, Elsevier, vol. 113(C).
    13. Hossein Hassani & Mohammad Reza Yeganegi & Rangan Gupta & Riza Demirer, 2022. "Forecasting stock market (realized) volatility in the United Kingdom: Is there a role of inequality?," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 2146-2152, April.
    14. Bonato, Matteo & Cepni, Oguzhan & Gupta, Rangan & Pierdzioch, Christian, 2023. "Climate risks and state-level stock market realized volatility," Journal of Financial Markets, Elsevier, vol. 66(C).
    15. Souropanis, Ioannis & Vivian, Andrew, 2023. "Forecasting realized volatility with wavelet decomposition," Journal of Empirical Finance, Elsevier, vol. 74(C).
    16. Salisu, Afees A. & Gupta, Rangan & Demirer, Riza, 2022. "Global financial cycle and the predictability of oil market volatility: Evidence from a GARCH-MIDAS model," Energy Economics, Elsevier, vol. 108(C).
    17. Rangan Gupta & Mark Wohar, 2019. "The role of monetary policy uncertainty in predicting equity market volatility of the United Kingdom: evidence from over 150 years of data," Economics and Business Letters, Oviedo University Press, vol. 8(3), pages 138-146.
    18. Zongwu Cai & Pixiong Chen, 2022. "New Online Investor Sentiment and Asset Returns," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202216, University of Kansas, Department of Economics, revised Nov 2022.
    19. Ma, Feng & Wahab, M.I.M. & Zhang, Yaojie, 2019. "Forecasting the U.S. stock volatility: An aligned jump index from G7 stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 132-146.
    20. Bonato, Matteo & Cepni, Oguzhan & Gupta, Rangan & Pierdzioch, Christian, 2023. "Climate risks and realized volatility of major commodity currency exchange rates," Journal of Financial Markets, Elsevier, vol. 62(C).

    More about this item

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:hbhfxx:v:24:y:2023:i:1:p:111-122. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/hbhf .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.