IDEAS home Printed from https://ideas.repec.org/a/eee/ecofin/v72y2024ics106294082400072x.html
   My bibliography  Save this article

Can real-time investor sentiment help predict the high-frequency stock returns? Evidence from a mixed-frequency-rolling decomposition forecasting method

Author

Listed:
  • Cai, Yi
  • Tang, Zhenpeng
  • Chen, Ying

Abstract

This research examines the predictive effect of real-time investor sentiment on high-frequency stock returns. Utilizing text sentiment analysis, we extract investor sentiment with a half-hour frequency from the stock message board. The RR-MIDAS method is used to model half-hourly sentiment and three-minute stock returns, and economic analysis reveals that investor sentiment significantly affects the stock returns during seven high-frequency periods, and the influence gradually weakens. Subsequently, we propose the “MF-EEMD-ML” prediction system, which introduces a rolling decomposition algorithm into the RR-MIDAS framework for predicting high-frequency trend items combined with real-time forum sentiment. The results, using rolling EMD decomposition for comparison, show that the “MF-EEMD-ML” system achieves a maximum reduction of 19.18 % in MAE, 19.08 % in RMSE, 11.71 % in SMAPE, and a maximum improvement of 16.66 % in DS. Additionally, the outcomes of the Diebold-Mariano (DM) tests also demonstrate that the “MF-EEMD-ML” prediction system significantly outperforms both the “MF-EMD-ML” system and the LR model.

Suggested Citation

  • Cai, Yi & Tang, Zhenpeng & Chen, Ying, 2024. "Can real-time investor sentiment help predict the high-frequency stock returns? Evidence from a mixed-frequency-rolling decomposition forecasting method," The North American Journal of Economics and Finance, Elsevier, vol. 72(C).
  • Handle: RePEc:eee:ecofin:v:72:y:2024:i:c:s106294082400072x
    DOI: 10.1016/j.najef.2024.102147
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S106294082400072X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.najef.2024.102147?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Leung, Henry & Ton, Thai, 2015. "The impact of internet stock message boards on cross-sectional returns of small-capitalization stocks," Journal of Banking & Finance, Elsevier, vol. 55(C), pages 37-55.
    2. Costola, Michele & Hinz, Oliver & Nofer, Michael & Pelizzon, Loriana, 2023. "Machine learning sentiment analysis, COVID-19 news and stock market reactions," Research in International Business and Finance, Elsevier, vol. 64(C).
    3. Guofu Zhou, 2018. "Measuring Investor Sentiment," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 239-259, November.
    4. Frazzini, Andrea & Lamont, Owen A., 2008. "Dumb money: Mutual fund flows and the cross-section of stock returns," Journal of Financial Economics, Elsevier, vol. 88(2), pages 299-322, May.
    5. Matthias W. Uhl & Milos Novacek, 2021. "When it Pays to Ignore: Focusing on Top News and their Sentiment," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 22(4), pages 461-479, October.
    6. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    7. Schmeling, Maik, 2009. "Investor sentiment and stock returns: Some international evidence," Journal of Empirical Finance, Elsevier, vol. 16(3), pages 394-408, June.
    8. Broadstock, David C. & Zhang, Dayong, 2019. "Social-media and intraday stock returns: The pricing power of sentiment," Finance Research Letters, Elsevier, vol. 30(C), pages 116-123.
    9. Deng, Shangkun & Huang, Xiaoru & Zhu, Yingke & Su, Zhihao & Fu, Zhe & Shimada, Tatsuro, 2023. "Stock index direction forecasting using an explainable eXtreme Gradient Boosting and investor sentiments," The North American Journal of Economics and Finance, Elsevier, vol. 64(C).
    10. David E. Allen & Michael McAleer & Abhay K. Singh, 2019. "Daily market news sentiment and stock prices," Applied Economics, Taylor & Francis Journals, vol. 51(30), pages 3212-3235, June.
    11. Chen, Rongda & Wu, Ling & Jin, Chenglu & Wang, Shengnan, 2021. "Unintended investor sentiment on bank financial products: Evidence from China," Emerging Markets Review, Elsevier, vol. 49(C).
    12. Liu, Wenwen & Zhang, Chang & Qiao, Gaoxiu & Xu, Lei, 2022. "Impact of network investor sentiment and news arrival on jumps," The North American Journal of Economics and Finance, Elsevier, vol. 62(C).
    13. Constantinos Antoniou & John A. Doukas & Avanidhar Subrahmanyam, 2016. "Investor Sentiment, Beta, and the Cost of Equity Capital," Management Science, INFORMS, vol. 62(2), pages 347-367, February.
    14. Li, Yelin & Bu, Hui & Li, Jiahong & Wu, Junjie, 2020. "The role of text-extracted investor sentiment in Chinese stock price prediction with the enhancement of deep learning," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1541-1562.
    15. Rangan Gupta & Jacobus Nel & Christian Pierdzioch, 2023. "Investor Confidence and Forecastability of US Stock Market Realized Volatility: Evidence from Machine Learning," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 24(1), pages 111-122, January.
    16. Robert J. Shiller, 2003. "From Efficient Markets Theory to Behavioral Finance," Journal of Economic Perspectives, American Economic Association, vol. 17(1), pages 83-104, Winter.
    17. Fraiberger, Samuel P. & Lee, Do & Puy, Damien & Ranciere, Romain, 2021. "Media sentiment and international asset prices," Journal of International Economics, Elsevier, vol. 133(C).
    18. Zhang, Tingting & Tang, Zhenpeng & Wu, Junchuan & Du, Xiaoxu & Chen, Kaijie, 2021. "Multi-step-ahead crude oil price forecasting based on two-layer decomposition technique and extreme learning machine optimized by the particle swarm optimization algorithm," Energy, Elsevier, vol. 229(C).
    19. Emre Cevik & Buket Kirci Altinkeski & Emrah Ismail Cevik & Sel Dibooglu, 2022. "Investor sentiments and stock markets during the COVID-19 pandemic," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-34, December.
    20. Chuangxia Huang & Shigang Wen & Xin Yang & Jinde Cao & Xiaoguang Yang, 2022. "Measurement of Individual Investor Sentiment and Its Application: Evidence from Chinese Stock Message Board," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 58(3), pages 681-691, February.
    21. Sun, Wei & Zhang, Chongchong, 2018. "Analysis and forecasting of the carbon price using multi—resolution singular value decomposition and extreme learning machine optimized by adaptive whale optimization algorithm," Applied Energy, Elsevier, vol. 231(C), pages 1354-1371.
    22. Wang, Hailong & Hu, Duni, 2022. "Heterogenous beliefs with sentiments and asset pricing," The North American Journal of Economics and Finance, Elsevier, vol. 63(C).
    23. Thomas Dimpfl & Stephan Jank, 2016. "Can Internet Search Queries Help to Predict Stock Market Volatility?," European Financial Management, European Financial Management Association, vol. 22(2), pages 171-192, March.
    24. Cetin Ciner, 2014. "The Time Varying Relation Between Consumer Confidence and Equities," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 15(4), pages 312-317, October.
    25. Zhenni Jin & Kun Guo & Yi Sun & Lin Lai & Zhewen Liao, 2020. "The industrial asymmetry of the stock price prediction with investor sentiment: Based on the comparison of predictive effects with SVR," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(7), pages 1166-1178, November.
    26. Gao, Zhenbin & Zhang, Jie, 2023. "The fluctuation correlation between investor sentiment and stock index using VMD-LSTM: Evidence from China stock market," The North American Journal of Economics and Finance, Elsevier, vol. 66(C).
    27. Shen, Dehua & Liu, Lanbiao & Zhang, Yongjie, 2018. "Quantifying the cross-sectional relationship between online sentiment and the skewness of stock returns," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 928-934.
    28. Robin Greenwood & Andrei Shleifer, 2014. "Expectations of Returns and Expected Returns," The Review of Financial Studies, Society for Financial Studies, vol. 27(3), pages 714-746.
    29. Swamy, Vighneswara & Lagesh, M.A., 2023. "Does happy Twitter forecast gold price?," Resources Policy, Elsevier, vol. 81(C).
    30. Gao, Ya & Xiong, Xiong & Feng, Xu & Li, Youwei & Vigne, Samuel A., 2019. "A new attention proxy and order imbalance: Evidence from China," Finance Research Letters, Elsevier, vol. 29(C), pages 411-417.
    31. Miwa, Kotaro, 2023. "Divergent opinions on social media," International Review of Economics & Finance, Elsevier, vol. 86(C), pages 182-196.
    32. Pegah Eslamieh & Mehdi Shajari & Ahmad Nickabadi, 2023. "User2Vec: A Novel Representation for the Information of the Social Networks for Stock Market Prediction Using Convolutional and Recurrent Neural Networks," Mathematics, MDPI, vol. 11(13), pages 1-26, July.
    33. Wen, Fenghua & Xu, Longhao & Ouyang, Guangda & Kou, Gang, 2019. "Retail investor attention and stock price crash risk: Evidence from China," International Review of Financial Analysis, Elsevier, vol. 65(C).
    34. Li, Tong & Chen, Hui & Liu, Wei & Yu, Guang & Yu, Yongtian, 2023. "Understanding the role of social media sentiment in identifying irrational herding behavior in the stock market," International Review of Economics & Finance, Elsevier, vol. 87(C), pages 163-179.
    35. Chung, San-Lin & Hung, Chi-Hsiou & Yeh, Chung-Ying, 2012. "When does investor sentiment predict stock returns?," Journal of Empirical Finance, Elsevier, vol. 19(2), pages 217-240.
    36. Peng Chen & Andrew Vivian & Cheng Ye, 2022. "Forecasting carbon futures price: a hybrid method incorporating fuzzy entropy and extreme learning machine," Annals of Operations Research, Springer, vol. 313(1), pages 559-601, June.
    37. Chang, Yen-Cheng & Shao, Ran & Wang, Na, 2022. "Can stock message board sentiment predict future returns? Local versus nonlocal posts," Journal of Behavioral and Experimental Finance, Elsevier, vol. 34(C).
    38. Ding, Rong & Hou, Wenxuan, 2015. "Retail investor attention and stock liquidity," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 37(C), pages 12-26.
    39. Wang, Deyun & Luo, Hongyuan & Grunder, Olivier & Lin, Yanbing & Guo, Haixiang, 2017. "Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm," Applied Energy, Elsevier, vol. 190(C), pages 390-407.
    40. Choi, Sujung & Choi, Woon Youl, 2019. "Effects of limited attention on investors' trading behavior: Evidence from online ranking data," Pacific-Basin Finance Journal, Elsevier, vol. 56(C), pages 273-289.
    41. Liyan Han & Ziying Li & Libo Yin, 2018. "Investor Attention and Stock Returns: International Evidence," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 54(14), pages 3168-3188, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tang, Zhenpeng & Lin, Qiaofeng & Cai, Yi & Chen, Kaijie & Liu, Dinggao, 2024. "Harnessing the power of real-time forum opinion: Unveiling its impact on stock market dynamics using intraday high-frequency data in China," International Review of Financial Analysis, Elsevier, vol. 93(C).
    2. Seok, Sang Ik & Cho, Hoon & Ryu, Doojin, 2021. "Stock Market’s responses to intraday investor sentiment," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    3. Wang, Wenzhao & Duxbury, Darren, 2021. "Institutional investor sentiment and the mean-variance relationship: Global evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 415-441.
    4. Seok, Sangik & Cho, Hoon & Ryu, Doojin, 2022. "Scheduled macroeconomic news announcements and intraday market sentiment," The North American Journal of Economics and Finance, Elsevier, vol. 62(C).
    5. Wang, Wenzhao & Su, Chen & Duxbury, Darren, 2021. "Investor sentiment and stock returns: Global evidence," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 365-391.
    6. Geng, Yuedan & Ye, Qiang & Jin, Yu & Shi, Wen, 2022. "Crowd wisdom and internet searches: What happens when investors search for stocks?," International Review of Financial Analysis, Elsevier, vol. 82(C).
    7. Wang, Wenzhao & Su, Chen & Duxbury, Darren, 2022. "The conditional impact of investor sentiment in global stock markets: A two-channel examination," Journal of Banking & Finance, Elsevier, vol. 138(C).
    8. Ahmed, Bouteska, 2020. "Understanding the impact of investor sentiment on the price formation process: A review of the conduct of American stock markets," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    9. Wang, Wenzhao, 2018. "Investor sentiment and the mean-variance relationship: European evidence," Research in International Business and Finance, Elsevier, vol. 46(C), pages 227-239.
    10. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    11. Ahmed Salhin & Mo Sherif & Edward Jones, 2016. "Investor Sentiment and Sector Returns," CFI Discussion Papers 1602, Centre for Finance and Investment, Heriot Watt University.
    12. Salhin, Ahmed & Sherif, Mohamed & Jones, Edward, 2016. "Managerial sentiment, consumer confidence and sector returns," International Review of Financial Analysis, Elsevier, vol. 47(C), pages 24-38.
    13. Marwane El Alaoui & Elie Bouri & Nehme Azoury, 2020. "The Determinants of the U.S. Consumer Sentiment: Linear and Nonlinear Models," IJFS, MDPI, vol. 8(3), pages 1-13, July.
    14. Seok, Sang Ik & Cho, Hoon & Ryu, Doojin, 2019. "Firm-specific investor sentiment and daily stock returns," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    15. Szymon Lis, 2022. "Investor Sentiment in Asset Pricing Models: A Review," Working Papers 2022-14, Faculty of Economic Sciences, University of Warsaw.
    16. Mehwish Aziz Khan & Eatzaz Ahmad, 2018. "Measurement of Investor Sentiment and Its Bi-Directional Contemporaneous and Lead–Lag Relationship with Returns: Evidence from Pakistan," Sustainability, MDPI, vol. 11(1), pages 1-20, December.
    17. Eleni Zafeiriou & Constantinos Katrakilidis & Chrysanthi Pegiou, 2019. "Consumer Confidence on Heating Oil Prices: An Empirical Study of their Relationship for European Union in a Nonlinear Framework," European Research Studies Journal, European Research Studies Journal, vol. 0(1), pages 63-90.
    18. Zachary McGurk & Adam Nowak & Joshua C. Hall, 2020. "Stock returns and investor sentiment: textual analysis and social media," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 44(3), pages 458-485, July.
    19. Seok, Sangik & Cho, Hoon & Ryu, Doojin, 2024. "Dual effects of investor sentiment and uncertainty in financial markets," The Quarterly Review of Economics and Finance, Elsevier, vol. 95(C), pages 300-315.
    20. Ung, Sze Nie & Gebka, Bartosz & Anderson, Robert D.J., 2023. "Is sentiment the solution to the risk–return puzzle? A (cautionary) note," Journal of Behavioral and Experimental Finance, Elsevier, vol. 37(C).

    More about this item

    Keywords

    Stock message boards; Real-time investor sentiment; High-frequency stock returns; Reverse mixed-frequency data sampling; Rolling decomposition; Machine learning prediction;
    All these keywords.

    JEL classification:

    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecofin:v:72:y:2024:i:c:s106294082400072x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620163 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.