IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/2025-11.html
   My bibliography  Save this paper

Research in Commotion: Measuring AI Research and Development through Conference Call Transcripts

Author

Abstract

This paper introduces a novel measure of firm-level Artificial Intelligence (AI) Research & Development—the AIR Index—derived from the semantic similarity between earnings conference call transcripts and leading AI research papers. The AIR Index varies widely across industries, with sustained strength in computer and electronic manufacturing, and accelerating growth in computing infrastructure and educational services seen after the introduction of ChatGPT in November 2022. I find that the AIR Index is associated with an immediate increase in Tobin’s Q and can help explain the cross-section of cumulative absolute returns following the conference call, suggestive of investors valuing substantive AI discussions in the near-term. A sharp rise in the AIR Index leads to persistent increases in year-over-year capex growth, lasting about a year before tapering off, indicative of the life cycle of AI-induced capital deepening. However, I find no significant effects of AI R&D on productivity or employment. Using industry level survey data from Census, I find that recent growth in the AIR Index correlates with broader AI adoption trends. The positive association of the AIR Index with capex and valuation holds across previous time periods, suggesting that Generative AI may be the latest form of an ongoing technical innovation process, albeit at an accelerated pace.

Suggested Citation

  • Paul E. Soto, 2025. "Research in Commotion: Measuring AI Research and Development through Conference Call Transcripts," Finance and Economics Discussion Series 2025-011, Board of Governors of the Federal Reserve System (U.S.).
    • Handle: RePEc:fip:fedgfe:2025-11
    DOI: 10.17016/FEDS.2025.011
    as

    Download full text from publisher

    File URL: https://www.federalreserve.gov/econres/feds/files/2025011pap.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.17016/FEDS.2025.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2021. "The Productivity J-Curve: How Intangibles Complement General Purpose Technologies," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(1), pages 333-372, January.
    2. Carol Corrado & Charles Hulten & Daniel Sichel, 2005. "Measuring Capital and Technology: An Expanded Framework," NBER Chapters, in: Measuring Capital in the New Economy, pages 11-46, National Bureau of Economic Research, Inc.
    3. Dario Caldara & Matteo Iacoviello, 2022. "Measuring Geopolitical Risk," American Economic Review, American Economic Association, vol. 112(4), pages 1194-1225, April.
    4. David M. Byrne & John G. Fernald & Marshall B. Reinsdorf, 2016. "Does the United States Have a Productivity Slowdown or a Measurement Problem?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 47(1 (Spring), pages 109-182.
    5. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue Nov.
    6. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    7. Kewei Hou & Chen Xue & Lu Zhang, 2015. "Editor's Choice Digesting Anomalies: An Investment Approach," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 650-705.
    8. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    9. Kevin J. Stiroh, 2002. "Information Technology and the U.S. Productivity Revival: What Do the Industry Data Say?," American Economic Review, American Economic Association, vol. 92(5), pages 1559-1576, December.
    10. Elliott Ash & Stephen Hansen, 2023. "Text Algorithms in Economics," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 659-688, September.
    11. Michael J. Cooper & Orlin Dimitrov & P. Raghavendra Rau, 2001. "A Rose.com by Any Other Name," Journal of Finance, American Finance Association, vol. 56(6), pages 2371-2388, December.
    12. Babina, Tania & Fedyk, Anastassia & He, Alex & Hodson, James, 2024. "Artificial intelligence, firm growth, and product innovation," Journal of Financial Economics, Elsevier, vol. 151(C).
    13. Tyna Eloundou & Sam Manning & Pamela Mishkin & Daniel Rock, 2023. "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models," Papers 2303.10130, arXiv.org, revised Aug 2023.
    14. Hayashi, Fumio, 1982. "Tobin's Marginal q and Average q: A Neoclassical Interpretation," Econometrica, Econometric Society, vol. 50(1), pages 213-224, January.
    15. Paul E. Soto, 2021. "Breaking the Word Bank: Measurement and Effects of Bank Level Uncertainty," Journal of Financial Services Research, Springer;Western Finance Association, vol. 59(1), pages 1-45, April.
    16. Humlum, Anders & Vestergaard, Emilie, 2024. "The Adoption of ChatGPT," IZA Discussion Papers 16992, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    2. Cederburg, Scott & O’Doherty, Michael S. & Wang, Feifei & Yan, Xuemin (Sterling), 2020. "On the performance of volatility-managed portfolios," Journal of Financial Economics, Elsevier, vol. 138(1), pages 95-117.
    3. Cao, Sean & Jiang, Wei & Wang, Junbo & Yang, Baozhong, 2024. "From Man vs. Machine to Man + Machine: The art and AI of stock analyses," Journal of Financial Economics, Elsevier, vol. 160(C).
    4. Kristina McElheran & J. Frank Li & Erik Brynjolfsson & Zachary Kroff & Emin Dinlersoz & Lucia Foster & Nikolas Zolas, 2024. "AI adoption in America: Who, what, and where," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(2), pages 375-415, March.
    5. Alexander Murray, 2017. "What Explains the Post-2004 U.S.Productivity Slowdown?," CSLS Research Reports 2017-05, Centre for the Study of Living Standards.
    6. Lu Zhang, 2017. "The Investment CAPM," European Financial Management, European Financial Management Association, vol. 23(4), pages 545-603, September.
    7. Kewei Hou & Haitao Mo & Chen Xue & Lu Zhang, 2017. "The Economics of Value Investing," NBER Working Papers 23563, National Bureau of Economic Research, Inc.
    8. Cujean, Julien & Andrei, Daniel & Fournier, Mathieu, 2019. "The Low-Minus-High Portfolio and the Factor Zoo," CEPR Discussion Papers 14153, C.E.P.R. Discussion Papers.
    9. Kewei Hou & Haitao Mo & Chen Xue & Lu Zhang, 2019. "Which Factors?," Review of Finance, European Finance Association, vol. 23(1), pages 1-35.
    10. Gallipoli, Giovanni & Makridis, Christos A., 2018. "Structural transformation and the rise of information technology," Journal of Monetary Economics, Elsevier, vol. 97(C), pages 91-110.
    11. Tatsuru Kikuchi, 2024. "Impact Evaluation on the European Privacy Laws governing generative-AI models -- Evidence in Relation between Internet Censorship and the Ban of ChatGPT in Italy," Papers 2407.06495, arXiv.org.
    12. Kreitmeir, David & Raschky, Paul Anton, 2023. "The Unintended Consequences of Censoring Digital Technology - Evidence from Italy's ChatGPT Ban," SocArXiv v3cgs, Center for Open Science.
    13. Wang, Qiao & Balvers, Ronald, 2021. "Determinants and predictability of commodity producer returns," Journal of Banking & Finance, Elsevier, vol. 133(C).
    14. Luca Grilli & Sergio Mariotti & Riccardo Marzano, 2024. "Artificial intelligence and shapeshifting capitalism," Journal of Evolutionary Economics, Springer, vol. 34(2), pages 303-318, April.
    15. Huynh, Nhan, 2023. "Unemployment beta and the cross-section of stock returns: Evidence from Australia," International Review of Financial Analysis, Elsevier, vol. 86(C).
    16. Sakemoto, Ryuta, 2023. "The long-run risk premium in the intertemporal CAPM: International evidence," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 89(C).
    17. Iacovone, Leonardo & Pereira-López, Mariana & Schiffbauer, Marc, 2023. "Competition makes IT better: Evidence on when firms use IT more effectively," Research Policy, Elsevier, vol. 52(8).
    18. Long, Huaigang & Chiah, Mardy & Zaremba, Adam & Umar, Zaghum, 2024. "Changes in shares outstanding and country stock returns around the world," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    19. Stefan Schweikl & Robert Obermaier, 2020. "Lessons from three decades of IT productivity research: towards a better understanding of IT-induced productivity effects," Management Review Quarterly, Springer, vol. 70(4), pages 461-507, November.
    20. Long, Huaigang & Zaremba, Adam & Zhou, Wenyu & Bouri, Elie, 2022. "Macroeconomics matter: Leading economic indicators and the cross-section of global stock returns," Journal of Financial Markets, Elsevier, vol. 61(C).

    More about this item

    Keywords

    Artificial intelligence; Capital expenditure; Corporate finance; Natural language; Processing; productivity;
    All these keywords.

    JEL classification:

    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • E22 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Investment; Capital; Intangible Capital; Capacity
    • C49 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2025-11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.