IDEAS home Printed from https://ideas.repec.org/a/spr/digfin/v3y2021i2d10.1007_s42521-021-00038-2.html
   My bibliography  Save this article

How to gauge investor behavior? A comparison of online investor sentiment measures

Author

Listed:
  • Daniele Ballinari

    (University of Basel)

  • Simon Behrendt

    (d-fine GmbH)

Abstract

Given the increasing interest in and the growing number of publicly available methods to estimate investor sentiment from social media platforms, researchers and practitioners alike are facing one crucial question – which is best to gauge investor sentiment? We compare the performance of daily investor sentiment measures estimated from Twitter and StockTwits short messages by publicly available dictionary and machine learning based methods for a large sample of stocks. To determine their relevance for financial applications, these investor sentiment measures are compared by their effects on the cross-section of stocks (i) within a Fama and MacBeth (J Polit Econ 81:607–636, 1973) regression framework applied to a measure of retail investors’ order imbalances and (ii) by their ability to forecast abnormal returns in a model-free portfolio sorting exercise. Interestingly, we find that investor sentiment measures based on finance-specific dictionaries do not only have a greater impact on retail investors’ order imbalances than measures based on machine learning approaches, but also perform very well compared to the latter in our asset pricing application.

Suggested Citation

  • Daniele Ballinari & Simon Behrendt, 2021. "How to gauge investor behavior? A comparison of online investor sentiment measures," Digital Finance, Springer, vol. 3(2), pages 169-204, June.
    • Handle: RePEc:spr:digfin:v:3:y:2021:i:2:d:10.1007_s42521-021-00038-2
    DOI: 10.1007/s42521-021-00038-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s42521-021-00038-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s42521-021-00038-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sanjiv R. Das & Mike Y. Chen, 2007. "Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web," Management Science, INFORMS, vol. 53(9), pages 1375-1388, September.
    2. Brad M. Barber & Terrance Odean & Ning Zhu, 2009. "Do Retail Trades Move Markets?," The Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 151-186, January.
    3. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    4. Steve Y. Yang & Sheung Yin Kevin Mo & Anqi Liu, 2015. "Twitter financial community sentiment and its predictive relationship to stock market movement," Quantitative Finance, Taylor & Francis Journals, vol. 15(10), pages 1637-1656, October.
    5. Zhi Da & Joseph Engelberg & Pengjie Gao, 2015. "Editor's Choice The Sum of All FEARS Investor Sentiment and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 28(1), pages 1-32.
    6. Kathleen Weiss Hanley, 2010. "The Information Content of IPO Prospectuses," The Review of Financial Studies, Society for Financial Studies, vol. 23(7), pages 2821-2864, July.
    7. Newey, Whitney K & West, Kenneth D, 1987. "Hypothesis Testing with Efficient Method of Moments Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 28(3), pages 777-787, October.
    8. Renault, Thomas, 2017. "Intraday online investor sentiment and return patterns in the U.S. stock market," Journal of Banking & Finance, Elsevier, vol. 84(C), pages 25-40.
    9. Malcolm Baker & Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 129-152, Spring.
    10. De Long, J Bradford & Andrei Shleifer & Lawrence H. Summers & Robert J. Waldmann, 1990. "Noise Trader Risk in Financial Markets," Journal of Political Economy, University of Chicago Press, vol. 98(4), pages 703-738, August.
    11. Michela Nardo & Marco Petracco-Giudici & Minás Naltsidis, 2016. "Walking Down Wall Street With A Tablet: A Survey Of Stock Market Predictions Using The Web," Journal of Economic Surveys, Wiley Blackwell, vol. 30(2), pages 356-369, April.
    12. Thomas Renault, 2017. "Intraday online investor sentiment and return patterns in the U.S. stock market," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03205113, HAL.
    13. Liu, Baixiao & McConnell, John J., 2013. "The role of the media in corporate governance: Do the media influence managers' capital allocation decisions?," Journal of Financial Economics, Elsevier, vol. 110(1), pages 1-17.
    14. Behrendt, Simon & Schmidt, Alexander, 2018. "The Twitter myth revisited: Intraday investor sentiment, Twitter activity and individual-level stock return volatility," Journal of Banking & Finance, Elsevier, vol. 96(C), pages 355-367.
    15. Thomas Dimpfl & Stephan Jank, 2016. "Can Internet Search Queries Help to Predict Stock Market Volatility?," European Financial Management, European Financial Management Association, vol. 22(2), pages 171-192, March.
    16. Paul C. Tetlock & Maytal Saar‐Tsechansky & Sofus Macskassy, 2008. "More Than Words: Quantifying Language to Measure Firms' Fundamentals," Journal of Finance, American Finance Association, vol. 63(3), pages 1437-1467, June.
    17. Leung, Henry & Ton, Thai, 2015. "The impact of internet stock message boards on cross-sectional returns of small-capitalization stocks," Journal of Banking & Finance, Elsevier, vol. 55(C), pages 37-55.
    18. Alexander Hillert & Heiko Jacobs & Sebastian Müller, 2014. "Media Makes Momentum," The Review of Financial Studies, Society for Financial Studies, vol. 27(12), pages 3467-3501.
    19. O. E. Barndorff-Nielsen & P. Reinhard Hansen & A. Lunde & N. Shephard, 2009. "Realized kernels in practice: trades and quotes," Econometrics Journal, Royal Economic Society, vol. 12(3), pages 1-32, November.
    20. Fama, Eugene F & MacBeth, James D, 1973. "Risk, Return, and Equilibrium: Empirical Tests," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 607-636, May-June.
    21. Kyle, Albert S, 1985. "Continuous Auctions and Insider Trading," Econometrica, Econometric Society, vol. 53(6), pages 1315-1335, November.
    22. Casey Dougal & Joseph Engelberg & Diego García & Christopher A. Parsons, 2012. "Journalists and the Stock Market," The Review of Financial Studies, Society for Financial Studies, vol. 25(3), pages 639-679.
    23. Joseph, Kissan & Babajide Wintoki, M. & Zhang, Zelin, 2011. "Forecasting abnormal stock returns and trading volume using investor sentiment: Evidence from online search," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1116-1127, October.
    24. Giannini, Robert & Irvine, Paul & Shu, Tao, 2019. "The convergence and divergence of investors' opinions around earnings news: Evidence from a social network," Journal of Financial Markets, Elsevier, vol. 42(C), pages 94-120.
    25. Engelberg, Joseph E. & Reed, Adam V. & Ringgenberg, Matthew C., 2012. "How are shorts informed?," Journal of Financial Economics, Elsevier, vol. 105(2), pages 260-278.
    26. Audrino, Francesco & Sigrist, Fabio & Ballinari, Daniele, 2020. "The impact of sentiment and attention measures on stock market volatility," International Journal of Forecasting, Elsevier, vol. 36(2), pages 334-357.
    27. Zhi Da & Joseph Engelberg & Pengjie Gao, 2011. "In Search of Attention," Journal of Finance, American Finance Association, vol. 66(5), pages 1461-1499, October.
    28. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    29. Kearney, Colm & Liu, Sha, 2014. "Textual sentiment in finance: A survey of methods and models," International Review of Financial Analysis, Elsevier, vol. 33(C), pages 171-185.
    30. Diego García, 2013. "Sentiment during Recessions," Journal of Finance, American Finance Association, vol. 68(3), pages 1267-1300, June.
    31. Steven Lehrer & Tian Xie & Tao Zeng, 2021. "Does High-Frequency Social Media Data Improve Forecasts of Low-Frequency Consumer Confidence Measures? [Regression Models with Mixed Sampling Frequencies]," Journal of Financial Econometrics, Oxford University Press, vol. 19(5), pages 910-933.
    32. Shleifer, Andrei & Vishny, Robert W, 1997. "The Limits of Arbitrage," Journal of Finance, American Finance Association, vol. 52(1), pages 35-55, March.
    33. Timm O. Sprenger & Andranik Tumasjan & Philipp G. Sandner & Isabell M. Welpe, 2014. "Tweets and Trades: the Information Content of Stock Microblogs," European Financial Management, European Financial Management Association, vol. 20(5), pages 926-957, November.
    34. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    35. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    36. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    37. Timm O. Sprenger & Philipp G. Sandner & Andranik Tumasjan & Isabell M. Welpe, 2014. "News or Noise? Using Twitter to Identify and Understand Company-specific News Flow," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 41(7-8), pages 791-830, September.
    38. repec:bla:jfinan:v:59:y:2004:i:3:p:1259-1294 is not listed on IDEAS
    39. Nofer, Michael & Hinz, Oliver, 2015. "Using Twitter to Predict the Stock Market: Where is the Mood Effect?," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 77140, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    40. Das, Sanjiv Ranjan, 2014. "Text and Context: Language Analytics in Finance," Foundations and Trends(R) in Finance, now publishers, vol. 8(3), pages 145-261, November.
    41. J. Anthony Cookson & Marina Niessner, 2020. "Why Don't We Agree? Evidence from a Social Network of Investors," Journal of Finance, American Finance Association, vol. 75(1), pages 173-228, February.
    42. Ballinari, Daniele & Behrendt, Simon, 2020. "Structural breaks in online investor sentiment: A note on the nonstationarity of financial chatter," Finance Research Letters, Elsevier, vol. 35(C).
    43. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    44. Hailiang Chen & Prabuddha De & Yu (Jeffrey) Hu & Byoung-Hyoun Hwang, 2014. "Wisdom of Crowds: The Value of Stock Opinions Transmitted Through Social Media," The Review of Financial Studies, Society for Financial Studies, vol. 27(5), pages 1367-1403.
    45. Alok Kumar & Charles M.C. Lee, 2006. "Retail Investor Sentiment and Return Comovements," Journal of Finance, American Finance Association, vol. 61(5), pages 2451-2486, October.
    46. Michael Nofer & Oliver Hinz, 2015. "Using Twitter to Predict the Stock Market," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 57(4), pages 229-242, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Qing Liu & Hosung Son, 2024. "Methods for aggregating investor sentiment from social media," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-22, December.
    2. John Hua Fan & Sebastian Binnewies & Sanuri De Silva, 2023. "Wisdom of crowds and commodity pricing," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 43(8), pages 1040-1068, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Renault, Thomas, 2017. "Intraday online investor sentiment and return patterns in the U.S. stock market," Journal of Banking & Finance, Elsevier, vol. 84(C), pages 25-40.
    2. Ahmad, Khurshid & Han, JingGuang & Hutson, Elaine & Kearney, Colm & Liu, Sha, 2016. "Media-expressed negative tone and firm-level stock returns," Journal of Corporate Finance, Elsevier, vol. 37(C), pages 152-172.
    3. Szymon Lis, 2022. "Investor Sentiment in Asset Pricing Models: A Review," Working Papers 2022-14, Faculty of Economic Sciences, University of Warsaw.
    4. Tom Marty & Bruce Vanstone & Tobias Hahn, 2020. "News media analytics in finance: a survey," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 60(2), pages 1385-1434, June.
    5. Qing Liu & Hosung Son, 2024. "Methods for aggregating investor sentiment from social media," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-22, December.
    6. Santi, Caterina, 2023. "Investor climate sentiment and financial markets," International Review of Financial Analysis, Elsevier, vol. 86(C).
    7. Xiong, Xiong & Meng, Yongqiang & Joseph, Nathan Lael & Shen, Dehua, 2020. "Stock mispricing, hard-to-value stocks and the influence of internet stock message boards," International Review of Financial Analysis, Elsevier, vol. 72(C).
    8. Prajwal Eachempati & Praveen Ranjan Srivastava, 2021. "Accounting for unadjusted news sentiment for asset pricing," Qualitative Research in Financial Markets, Emerald Group Publishing Limited, vol. 13(3), pages 383-422, May.
    9. Wang, Wenzhao & Su, Chen & Duxbury, Darren, 2022. "The conditional impact of investor sentiment in global stock markets: A two-channel examination," Journal of Banking & Finance, Elsevier, vol. 138(C).
    10. Zachary McGurk & Adam Nowak & Joshua C. Hall, 2020. "Stock returns and investor sentiment: textual analysis and social media," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 44(3), pages 458-485, July.
    11. Roland Füss & Massimo Guidolin & Christian Koeppel, 2019. "Sentiment Risk Premia In The Cross-Section of Global Equity," Working Papers on Finance 1913, University of St. Gallen, School of Finance, revised May 2020.
    12. Roland Fuess & Massimo Guidolin & Christian Koeppel, 2019. "Sentiment Risk Premia in the Cross-Section of Global Equity and Currency Returns," BAFFI CAREFIN Working Papers 19116, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    13. Bask, Mikael & Forsberg, Lars & Östling, Andreas, 2024. "Media sentiment and stock returns," The Quarterly Review of Economics and Finance, Elsevier, vol. 94(C), pages 303-311.
    14. Rui Fan & Oleksandr Talavera & Vu Tran, 2020. "Social media bots and stock markets," European Financial Management, European Financial Management Association, vol. 26(3), pages 753-777, June.
    15. Alomari, Mohammad & Al Rababa’a, Abdel Razzaq & El-Nader, Ghaith & Alkhataybeh, Ahmad & Ur Rehman, Mobeen, 2021. "Examining the effects of news and media sentiments on volatility and correlation: Evidence from the UK," The Quarterly Review of Economics and Finance, Elsevier, vol. 82(C), pages 280-297.
    16. Al-Nasseri, Alya & Menla Ali, Faek & Tucker, Allan, 2021. "Investor sentiment and the dispersion of stock returns: Evidence based on the social network of investors," International Review of Financial Analysis, Elsevier, vol. 78(C).
    17. Mahmoudi, Nader & Docherty, Paul & Melia, Adrian, 2022. "Firm-level investor sentiment and corporate announcement returns," Journal of Banking & Finance, Elsevier, vol. 144(C).
    18. Eierle, Brigitte & Klamer, Sebastian & Muck, Matthias, 2022. "Does it really pay off for investors to consider information from social media?," International Review of Financial Analysis, Elsevier, vol. 81(C).
    19. Qing Liu & Hosung Son, 2024. "Data selection and collection for constructing investor sentiment from social media," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    20. Liu, Sha & Han, Jingguang, 2020. "Media tone and expected stock returns," International Review of Financial Analysis, Elsevier, vol. 70(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:digfin:v:3:y:2021:i:2:d:10.1007_s42521-021-00038-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.