IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/1208.html
   My bibliography  Save this paper

Generative AI and labour productivity: a field experiment on coding

Author

Listed:
  • Leonardo Gambacorta
  • Han Qiu
  • Shuo Shan
  • Daniel M Rees

Abstract

In this paper we examine the effects of generative artificial intelligence (gen AI) on labour productivity. In September 2023, Ant Group introduced CodeFuse, a large language model (LLM) designed to assist programmer teams with coding. While one group of programmers used it, other programmer teams were not informed about this LLM. Leveraging this event, we conducted a field experiment on these two groups of programmers. We identified employees who used CodeFuse as the treatment group and paired them with comparable employees in the control group, to assess the impact of AI on their productivity. Our findings indicate that the use of gen AI increased code output by more than 50%. However, productivity gains are statistically significant only among entry-level or junior staff, while the impact on more senior employees is less pronounced.

Suggested Citation

  • Leonardo Gambacorta & Han Qiu & Shuo Shan & Daniel M Rees, 2024. "Generative AI and labour productivity: a field experiment on coding," BIS Working Papers 1208, Bank for International Settlements.
    • Handle: RePEc:bis:biswps:1208
    as

    Download full text from publisher

    File URL: https://www.bis.org/publ/work1208.pdf
    File Function: Full PDF document
    Download Restriction: no
    File URL: https://www.bis.org/publ/work1208.htm
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2023. "Generative AI at Work," Papers 2304.11771, arXiv.org.
    2. Zied Bahroun & Chiraz Anane & Vian Ahmed & Andrew Zacca, 2023. "Transforming Education: A Comprehensive Review of Generative Artificial Intelligence in Educational Settings through Bibliometric and Content Analysis," Sustainability, MDPI, vol. 15(17), pages 1-40, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 05 Aug 2024.
    2. Gaétan de Rassenfosse & Adam B. Jaffe & Joel Waldfogel, 2024. "Intellectual Property and Creative Machines," NBER Chapters, in: Entrepreneurship and Innovation Policy and the Economy, volume 4, National Bureau of Economic Research, Inc.
    3. Alexander Cuntz & Carsten Fink & Hansueli Stamm, 2024. "Artificial Intelligence and Intellectual Property : An Economic Perspective," WIPO Economic Research Working Papers 77, World Intellectual Property Organization - Economics and Statistics Division.
    4. Lilia Patrignani, 2024. "Understanding digital trade," Questioni di Economia e Finanza (Occasional Papers) 841, Bank of Italy, Economic Research and International Relations Area.
    5. Amali Matharaarachchi & Wishmitha Mendis & Kanishka Randunu & Daswin De Silva & Gihan Gamage & Harsha Moraliyage & Nishan Mills & Andrew Jennings, 2024. "Optimizing Generative AI Chatbots for Net-Zero Emissions Energy Internet-of-Things Infrastructure," Energies, MDPI, vol. 17(8), pages 1-19, April.
    6. Christian Peukert & Florian Abeillon & Jérémie Haese & Franziska Kaiser & Alexander Staub, 2024. "Strategic Behavior and AI Training Data," CESifo Working Paper Series 11099, CESifo.
    7. Aldasoro, Inaki & Gambacorta, Leonardo & Korinek, Anton & Shreeti, Vatsala & Stein, Merlin, 2024. "Intelligent financial system: how AI is transforming finance," CEPR Discussion Papers 19181, C.E.P.R. Discussion Papers.
    8. Morgan Blangeois, 2023. "Generative AI: Revolution or Threat for Digital Service Companies ? [IA générative : révolution ou menace pour les entreprises de services du numérique ?]," Post-Print hal-04355219, HAL.
    9. Spencer Bastani & Daniel Waldenström, 2024. "AI, Automation and Taxation," CESifo Working Paper Series 11084, CESifo.
    10. Raphael Auer & David Köpfer & Josef Sveda, 2024. "The rise of generative AI: modelling exposure, substitution and inequality effects on the US labour market," BIS Working Papers 1207, Bank for International Settlements.
    11. Aldasoro, Iñaki & Armantier, Olivier & Doerr, Sebastian & Gambacorta, Leonardo & Oliviero, Tommaso, 2024. "The gen AI gender gap," Economics Letters, Elsevier, vol. 241(C).
    12. Bastani, Spencer & Waldenström, Daniel, 2024. "AI, Automation and Taxation," IZA Policy Papers 212, Institute of Labor Economics (IZA).
    13. Suleymenova, Kamilya & Dawood, Mary & Psyllou, Maria, 2024. "Essays in economics in ICU: Resuscitate or pull the plug?," International Review of Economics Education, Elsevier, vol. 45(C).
    14. Myriam Raymond & Aymeric Hemon & Frantz Rowe, 2024. "Ease of use and facilitating conditions in the context of technology promises: Lessons from experiments with code- and text-generating AI tools in a professional context [La facilité d'usage et les," Post-Print hal-04634708, HAL.
    15. Gary Charness & Brian Jabarian & John List, 2023. "Generation Next: Experimentation with AI," Artefactual Field Experiments 00777, The Field Experiments Website.
    16. Daniel Goller & Christian Gschwendt & Stefan C. Wolter, 2023. ""This time it's different" Generative Artificial Intelligence and Occupational Choice," Economics of Education Working Paper Series 0209, University of Zurich, Department of Business Administration (IBW).
    17. Aldasoro, Inaki & Gambacorta, Leonardo & Korinek, Anton & Shreeti, Vatsala & Stein, Merlin, 2024. "Intelligent financial system: how AI is transforming finance," CEPR Discussion Papers 19181, C.E.P.R. Discussion Papers.
    18. Eaman Jahani & Benjamin S. Manning & Joe Zhang & Hong-Yi TuYe & Mohammed Alsobay & Christos Nicolaides & Siddharth Suri & David Holtz, 2024. "As Generative Models Improve, People Adapt Their Prompts," Papers 2407.14333, arXiv.org, revised Aug 2024.
    19. Danah Henriksen & Punya Mishra & Rachel Stern, 2024. "Creative Learning for Sustainability in a World of AI: Action, Mindset, Values," Sustainability, MDPI, vol. 16(11), pages 1-20, May.
    20. Fosso Wamba, Samuel & Queiroz, Maciel M. & Chiappetta Jabbour, Charbel Jose & Shi, Chunming (Victor), 2023. "Are both generative AI and ChatGPT game changers for 21st-Century operations and supply chain excellence?," International Journal of Production Economics, Elsevier, vol. 265(C).

    More about this item

    Keywords

    artificial intelligence; productivity; field experiment; big tech;
    All these keywords.

    JEL classification:

    • D22 - Microeconomics - - Production and Organizations - - - Firm Behavior: Empirical Analysis
    • G31 - Financial Economics - - Corporate Finance and Governance - - - Capital Budgeting; Fixed Investment and Inventory Studies
    • R30 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Real Estate Markets, Spatial Production Analysis, and Firm Location - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:1208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Martin Fessler (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.