IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2502.10008.html
   My bibliography  Save this paper

ChatGPT and Deepseek: Can They Predict the Stock Market and Macroeconomy?

Author

Listed:
  • Jian Chen
  • Guohao Tang
  • Guofu Zhou
  • Wu Zhu

Abstract

We study whether ChatGPT and DeepSeek can extract information from the Wall Street Journal to predict the stock market and the macroeconomy. We find that ChatGPT has predictive power. DeepSeek underperforms ChatGPT, which is trained more extensively in English. Other large language models also underperform. Consistent with financial theories, the predictability is driven by investors' underreaction to positive news, especially during periods of economic downturn and high information uncertainty. Negative news correlates with returns but lacks predictive value. At present, ChatGPT appears to be the only model capable of capturing economic news that links to the market risk premium.

Suggested Citation

  • Jian Chen & Guohao Tang & Guofu Zhou & Wu Zhu, 2025. "ChatGPT and Deepseek: Can They Predict the Stock Market and Macroeconomy?," Papers 2502.10008, arXiv.org.
    • Handle: RePEc:arx:papers:2502.10008
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2502.10008
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Paul C. Tetlock & Maytal Saar‐Tsechansky & Sofus Macskassy, 2008. "More Than Words: Quantifying Language to Measure Firms' Fundamentals," Journal of Finance, American Finance Association, vol. 63(3), pages 1437-1467, June.
    3. Merton, Robert C, 1973. "An Intertemporal Capital Asset Pricing Model," Econometrica, Econometric Society, vol. 41(5), pages 867-887, September.
    4. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    5. Larry G. Epstein & Martin Schneider, 2008. "Ambiguity, Information Quality, and Asset Pricing," Journal of Finance, American Finance Association, vol. 63(1), pages 197-228, February.
    6. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    7. X. Frank Zhang, 2006. "Information Uncertainty and Stock Returns," Journal of Finance, American Finance Association, vol. 61(1), pages 105-137, February.
    8. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    9. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    10. García, Diego & Hu, Xiaowen & Rohrer, Maximilian, 2023. "The colour of finance words," Journal of Financial Economics, Elsevier, vol. 147(3), pages 525-549.
    11. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," The Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-386.
    12. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    13. R. David Mclean & Jeffrey Pontiff, 2016. "Does Academic Research Destroy Stock Return Predictability?," Journal of Finance, American Finance Association, vol. 71(1), pages 5-32, February.
    14. Andrew Ang & Geert Bekaert, 2007. "Stock Return Predictability: Is it There?," The Review of Financial Studies, Society for Financial Studies, vol. 20(3), pages 651-707.
    15. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    16. Azi Ben-Rephael & Zhi Da & Ryan D. Israelsen, 2017. "It Depends on Where You Search: Institutional Investor Attention and Underreaction to News," The Review of Financial Studies, Society for Financial Studies, vol. 30(9), pages 3009-3047.
    17. Amit Goyal & Ivo Welch & Athanasse Zafirov, 2024. "A Comprehensive 2022 Look at the Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 37(11), pages 3490-3557.
    18. Hai Lin & Chunchi Wu & Guofu Zhou, 2018. "Forecasting Corporate Bond Returns with a Large Set of Predictors: An Iterated Combination Approach," Management Science, INFORMS, vol. 64(9), pages 4218-4238, September.
    19. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    20. Kandel, Shmuel & Stambaugh, Robert F, 1996. "On the Predictability of Stock Returns: An Asset-Allocation Perspective," Journal of Finance, American Finance Association, vol. 51(2), pages 385-424, June.
    21. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    22. repec:bla:jfinan:v:59:y:2004:i:3:p:1259-1294 is not listed on IDEAS
    23. Tim Loughran & Bill McDonald, 2020. "Textual Analysis in Finance," Annual Review of Financial Economics, Annual Reviews, vol. 12(1), pages 357-375, December.
    24. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    25. Hui Chen & Scott Joslin & Sophie Xiaoyan Ni, 2019. "Demand for Crash Insurance, Intermediary Constraints, and Risk Premia in Financial Markets," The Review of Financial Studies, Society for Financial Studies, vol. 32(1), pages 228-265.
    26. Leland Bybee & Bryan Kelly & Yinan Su & Tarun Ramadorai, 2023. "Narrative Asset Pricing: Interpretable Systematic Risk Factors from News Text," The Review of Financial Studies, Society for Financial Studies, vol. 36(12), pages 4759-4787.
    27. Fama, Eugene F. & Schwert, G. William, 1977. "Asset returns and inflation," Journal of Financial Economics, Elsevier, vol. 5(2), pages 115-146, November.
    28. Stefano Dellavigna & Joshua M. Pollet, 2009. "Investor Inattention and Friday Earnings Announcements," Journal of Finance, American Finance Association, vol. 64(2), pages 709-749, April.
    29. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    30. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    31. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    32. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    33. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    34. Yaqing Xiao & Hongjun Yan & Jinfan Zhang, 2022. "A Global Version of Samuelson's Dictum," American Economic Review: Insights, American Economic Association, vol. 4(2), pages 239-254, June.
    35. David Hirshleifer & Sonya Seongyeon Lim & Siew Hong Teoh, 2009. "Driven to Distraction: Extraneous Events and Underreaction to Earnings News," Journal of Finance, American Finance Association, vol. 64(5), pages 2289-2325, October.
    36. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    37. Manela, Asaf & Moreira, Alan, 2017. "News implied volatility and disaster concerns," Journal of Financial Economics, Elsevier, vol. 123(1), pages 137-162.
    38. Veronesi, Pietro, 1999. "Stock Market Overreaction to Bad News in Good Times: A Rational Expectations Equilibrium Model," The Review of Financial Studies, Society for Financial Studies, vol. 12(5), pages 975-1007.
    39. Hui Chen & Scott Joslin & Sophie X. Ni, 2019. "Demand for Crash Insurance, Intermediary Constraints, and Risk Premia in Financial Markets," NBER Working Papers 25573, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    2. Ma, Feng & Wang, Ruoxin & Lu, Xinjie & Wahab, M.I.M., 2021. "A comprehensive look at stock return predictability by oil prices using economic constraint approaches," International Review of Financial Analysis, Elsevier, vol. 78(C).
    3. Jiang, Fuwei & Liu, Hongkui & Yu, Jiasheng & Zhang, Huajing, 2023. "International stock return predictability: The role of U.S. uncertainty spillover," Pacific-Basin Finance Journal, Elsevier, vol. 82(C).
    4. Wang, Yudong & Pan, Zhiyuan & Liu, Li & Wu, Chongfeng, 2019. "Oil price increases and the predictability of equity premium," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 43-58.
    5. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    6. Yu, Deshui & Huang, Difang, 2023. "Cross-sectional uncertainty and expected stock returns," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 321-340.
    7. Guofu Zhou, 2018. "Measuring Investor Sentiment," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 239-259, November.
    8. Jiang, Fuwei & Liu, Hongkui & Tang, Guohao & Yu, Jiasheng, 2024. "Global mispricing matters," Journal of International Money and Finance, Elsevier, vol. 147(C).
    9. Dong, Dayong & Yue, Sishi & Cao, Jiawei, 2020. "Site visit information content and return predictability: Evidence from China," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    10. Gonçalo Faria & Fabio Verona, 2016. "Forecasting the equity risk premium with frequency-decomposed predictors," Working Papers de Economia (Economics Working Papers) 06, Católica Porto Business School, Universidade Católica Portuguesa.
    11. Dai, Zhifeng & Zhu, Huan, 2020. "Stock return predictability from a mixed model perspective," Pacific-Basin Finance Journal, Elsevier, vol. 60(C).
    12. Lawrenz, Jochen & Zorn, Josef, 2017. "Predicting international stock returns with conditional price-to-fundamental ratios," Journal of Empirical Finance, Elsevier, vol. 43(C), pages 159-184.
    13. Lin, Qi & Lin, Xi, 2021. "Cash conversion cycle and aggregate stock returns," Journal of Financial Markets, Elsevier, vol. 52(C).
    14. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    15. Jian Chen & Jiaquan Yao & Qunzi Zhang & Xiaoneng Zhu, 2023. "Global Disaster Risk Matters," Management Science, INFORMS, vol. 69(1), pages 576-597, January.
    16. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    17. , & Stein, Tobias, 2021. "Equity premium predictability over the business cycle," CEPR Discussion Papers 16357, C.E.P.R. Discussion Papers.
    18. Li, Yan & Ng, David T. & Swaminathan, Bhaskaran, 2013. "Predicting market returns using aggregate implied cost of capital," Journal of Financial Economics, Elsevier, vol. 110(2), pages 419-436.
    19. Bätje, Fabian & Menkhoff, Lukas, 2016. "Predicting the equity premium via its components," VfS Annual Conference 2016 (Augsburg): Demographic Change 145789, Verein für Socialpolitik / German Economic Association.
    20. Faias, José Afonso, 2023. "Predicting the equity risk premium using the smooth cross-sectional tail risk: The importance of correlation," Journal of Financial Markets, Elsevier, vol. 63(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2502.10008. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.