IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2407.18327.html
   My bibliography  Save this paper

The Structure of Financial Equity Research Reports -- Identification of the Most Frequently Asked Questions in Financial Analyst Reports to Automate Equity Research Using Llama 3 and GPT-4

Author

Listed:
  • Adria Pop
  • Jan Sporer
  • Siegfried Handschuh

Abstract

This research dissects financial equity research reports (ERRs) by mapping their content into categories. There is insufficient empirical analysis of the questions answered in ERRs. In particular, it is not understood how frequently certain information appears, what information is considered essential, and what information requires human judgment to distill into an ERR. The study analyzes 72 ERRs sentence-by-sentence, classifying their 4940 sentences into 169 unique question archetypes. We did not predefine the questions but derived them solely from the statements in the ERRs. This approach provides an unbiased view of the content of the observed ERRs. Subsequently, we used public corporate reports to classify the questions' potential for automation. Answers were labeled "text-extractable" if the answers to the question were accessible in corporate reports. 78.7% of the questions in ERRs can be automated. Those automatable question consist of 48.2% text-extractable (suited to processing by large language models, LLMs) and 30.5% database-extractable questions. Only 21.3% of questions require human judgment to answer. We empirically validate using Llama-3-70B and GPT-4-turbo-2024-04-09 that recent advances in language generation and information extraction enable the automation of approximately 80% of the statements in ERRs. Surprisingly, the models complement each other's strengths and weaknesses well. The research confirms that the current writing process of ERRs can likely benefit from additional automation, improving quality and efficiency. The research thus allows us to quantify the potential impacts of introducing large language models in the ERR writing process. The full question list, including the archetypes and their frequency, will be made available online after peer review.

Suggested Citation

  • Adria Pop & Jan Sporer & Siegfried Handschuh, 2024. "The Structure of Financial Equity Research Reports -- Identification of the Most Frequently Asked Questions in Financial Analyst Reports to Automate Equity Research Using Llama 3 and GPT-4," Papers 2407.18327, arXiv.org.
  • Handle: RePEc:arx:papers:2407.18327
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2407.18327
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    2. Elton, Edwin J & Gruber, Martin J & Grossman, Seth, 1986. "Discrete Expectational Data and Portfolio Performance," Journal of Finance, American Finance Association, vol. 41(3), pages 699-713, July.
    3. Bjerring, James H & Lakonishok, Josef & Vermaelen, Theo, 1983. "Stock Prices and Financial Analysts' Recommendations," Journal of Finance, American Finance Association, vol. 38(1), pages 187-204, March.
    4. Mikhail, Michael B. & Walther, Beverly R. & Willis, Richard H., 2004. "Do security analysts exhibit persistent differences in stock picking ability?," Journal of Financial Economics, Elsevier, vol. 74(1), pages 67-91, October.
    5. Womack, Kent L, 1996. "Do Brokerage Analysts' Recommendations Have Investment Value?," Journal of Finance, American Finance Association, vol. 51(1), pages 137-167, March.
    6. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    7. Clifford S. Asness & Tobias J. Moskowitz & Lasse Heje Pedersen, 2013. "Value and Momentum Everywhere," Journal of Finance, American Finance Association, vol. 68(3), pages 929-985, June.
    8. Stefano Bonini & Laura Zanetti & Roberto Bianchini & Antonio Salvi, 2010. "Target Price Accuracy in Equity Research," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 37(9‐10), pages 1177-1217, November.
    9. Shijie Wu & Ozan Irsoy & Steven Lu & Vadim Dabravolski & Mark Dredze & Sebastian Gehrmann & Prabhanjan Kambadur & David Rosenberg & Gideon Mann, 2023. "BloombergGPT: A Large Language Model for Finance," Papers 2303.17564, arXiv.org, revised Dec 2023.
    10. Michaely, Roni & Womack, Kent L, 1999. "Conflict of Interest and the Credibility of Underwriter Analyst Recommendations," The Review of Financial Studies, Society for Financial Studies, vol. 12(4), pages 653-686.
    11. Cristi A. Gleason & W. Bruce Johnson & Haidan Li, 2013. "Valuation Model Use and the Price Target Performance of Sell†Side Equity Analysts," Contemporary Accounting Research, John Wiley & Sons, vol. 30(1), pages 80-115, March.
    12. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    13. Beneish, Messod D, 1991. "Stock Prices and the Dissemination of Analysts' Recommendations," The Journal of Business, University of Chicago Press, vol. 64(3), pages 393-416, July.
    14. Liu, Pu & Smith, Stanley D. & Syed, Azmat A., 1990. "Stock Price Reactions to The Wall Street Journal's Securities Recommendations," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 25(3), pages 399-410, September.
    15. Asquith, Paul & Mikhail, Michael B. & Au, Andrea S., 2005. "Information content of equity analyst reports," Journal of Financial Economics, Elsevier, vol. 75(2), pages 245-282, February.
    16. Brad Barber & Reuven Lehavy & Maureen McNichols & Brett Trueman, 2001. "Can Investors Profit from the Prophets? Security Analyst Recommendations and Stock Returns," Journal of Finance, American Finance Association, vol. 56(2), pages 531-563, April.
    17. Fama, Eugene F & French, Kenneth R, 1995. "Size and Book-to-Market Factors in Earnings and Returns," Journal of Finance, American Finance Association, vol. 50(1), pages 131-155, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Savor, Pavel G., 2012. "Stock returns after major price shocks: The impact of information," Journal of Financial Economics, Elsevier, vol. 106(3), pages 635-659.
    2. Marina Balboa & J. Carlos Gómez‐Sala & Germán López‐Espinosa, 2009. "The Value of Adjusting the Bias in Recommendations: International Evidence," European Financial Management, European Financial Management Association, vol. 15(1), pages 208-230, January.
    3. Stefano Bonini & Laura Zanetti & Roberto Bianchini & Antonio Salvi, 2010. "Target Price Accuracy in Equity Research," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 37(9‐10), pages 1177-1217, November.
    4. Thabang Mokoaleli-Mokoteli & Richard J. Taffler & Vineet Agarwal, 2009. "Behavioural Bias and Conflicts of Interest in Analyst Stock Recommendations," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 36(3-4), pages 384-418.
    5. Moshirian, Fariborz & Ng, David & Wu, Eliza, 2009. "The value of stock analysts' recommendations: Evidence from emerging markets," International Review of Financial Analysis, Elsevier, vol. 18(1-2), pages 74-83, March.
    6. Asquith, Paul & Mikhail, Michael & Au, Andrea, 2004. "Information Content of Equity Analyst Reports," Working papers 4264-02, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    7. Paul Asquith & Michael B. Mikhail & Andrea S. Au, 2002. "Information Content of Equity Analyst Reports," NBER Working Papers 9246, National Bureau of Economic Research, Inc.
    8. Rúben Miguel Torcato Peixinho, 2011. "Are analysts misleading investors? The case of goingconcern opinions," CEFAGE-UE Working Papers 2011_22, University of Evora, CEFAGE-UE (Portugal).
    9. Jeffrey Hobbs & Vivek Singh, 2015. "A comparison of buy‐side and sell‐side analysts," Review of Financial Economics, John Wiley & Sons, vol. 24(1), pages 42-51, January.
    10. Hiren Patel, 2021. "Target Price Achievement and Target Price Accuracy Models: An Analysis of Advisory Firms’ Recommendation for the Indian Banking Stocks," Global Business Review, International Management Institute, vol. 22(2), pages 459-473, April.
    11. Nerissa C. Brown & Kelsey D. Wei & Russ Wermers, 2014. "Analyst Recommendations, Mutual Fund Herding, and Overreaction in Stock Prices," Management Science, INFORMS, vol. 60(1), pages 1-20, January.
    12. Altınkılıç, Oya & Hansen, Robert S. & Ye, Liyu, 2016. "Can analysts pick stocks for the long-run?," Journal of Financial Economics, Elsevier, vol. 119(2), pages 371-398.
    13. Tsung-Yu Hsieh & Tsai-Yin Lin & Fangjhy Li & Yi-Ting Huang, 2023. "Analyst’s Target Price Revision and Dealer’s Trading Behavior Analysis: Evidence from Taiwanese Stock Market," Sustainability, MDPI, vol. 15(4), pages 1-9, February.
    14. Hobbs, Jeffrey & Singh, Vivek, 2015. "A comparison of buy-side and sell-side analysts," Review of Financial Economics, Elsevier, vol. 24(C), pages 42-51.
    15. Hall, Jason L. & Tacon, Paul B., 2010. "Forecast accuracy and stock recommendations," Journal of Contemporary Accounting and Economics, Elsevier, vol. 6(1), pages 18-33.
    16. Jan Klobucnik & Daniel Kreutzmann & Soenke Sievers & Stefan Kanne, 2012. "To buy or not to buy? The value of contradictory analyst signals," Cologne Graduate School Working Paper Series 03-03, Cologne Graduate School in Management, Economics and Social Sciences.
    17. Son, Byung-Gak & Sodhi, ManMohan & Kocabasoglu-Hillmer, Canan & Lee, Tae-Hee, 2016. "Supply chain information in analyst reports on publicly traded companies," International Journal of Production Economics, Elsevier, vol. 171(P3), pages 350-360.
    18. Thabang Mokoaleli‐Mokoteli & Richard J. Taffler & Vineet Agarwal, 2009. "Behavioural Bias and Conflicts of Interest in Analyst Stock Recommendations," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 36(3‐4), pages 384-418, April.
    19. Jorida Papakroni, 2018. "The dispersion anomaly and analyst recommendations," Review of Quantitative Finance and Accounting, Springer, vol. 50(3), pages 861-896, April.
    20. Carole Comerton‐Forde & David R. Gallagher & Joyce Lai & Terry Walter, 2011. "Broker recommendations and Australian small‐cap equity fund management," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 51(4), pages 893-922, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2407.18327. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.