IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/1208.html
   My bibliography  Save this paper

Generative AI and labour productivity: a field experiment on coding

Author

Listed:
  • Leonardo Gambacorta
  • Han Qiu
  • Shuo Shan
  • Daniel M Rees

Abstract

In this paper we examine the effects of generative artificial intelligence (gen AI) on labour productivity. In September 2023, Ant Group introduced CodeFuse, a large language model (LLM) designed to assist programmer teams with coding. While one group of programmers used it, other programmer teams were not informed about this LLM. Leveraging this event, we conducted a field experiment on these two groups of programmers. We identified employees who used CodeFuse as the treatment group and paired them with comparable employees in the control group, to assess the impact of AI on their productivity. Our findings indicate that the use of gen AI increased code output by more than 50%. However, productivity gains are statistically significant only among entry-level or junior staff, while the impact on more senior employees is less pronounced.

Suggested Citation

  • Leonardo Gambacorta & Han Qiu & Shuo Shan & Daniel M Rees, 2024. "Generative AI and labour productivity: a field experiment on coding," BIS Working Papers 1208, Bank for International Settlements.
    • Handle: RePEc:bis:biswps:1208
    as

    Download full text from publisher

    File URL: https://www.bis.org/publ/work1208.pdf
    File Function: Full PDF document
    Download Restriction: no
    File URL: https://www.bis.org/publ/work1208.htm
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2023. "Generative AI at Work," Papers 2304.11771, arXiv.org, revised Nov 2024.
    2. Zied Bahroun & Chiraz Anane & Vian Ahmed & Andrew Zacca, 2023. "Transforming Education: A Comprehensive Review of Generative Artificial Intelligence in Educational Settings through Bibliometric and Content Analysis," Sustainability, MDPI, vol. 15(17), pages 1-40, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    2. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 20 Mar 2025.
    3. Gaétan de Rassenfosse & Adam B. Jaffe & Joel Waldfogel, 2025. "Intellectual Property and Creative Machines," Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 4(1), pages 47-79.
    4. Leonardo Banh & Gero Strobel, 2023. "Generative artificial intelligence," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-17, December.
    5. Alexander Cuntz & Carsten Fink & Hansueli Stamm, 2024. "Artificial Intelligence and Intellectual Property : An Economic Perspective," WIPO Economic Research Working Papers 77, World Intellectual Property Organization - Economics and Statistics Division.
    6. Lilia Patrignani, 2024. "Understanding digital trade," Questioni di Economia e Finanza (Occasional Papers) 841, Bank of Italy, Economic Research and International Relations Area.
    7. Amali Matharaarachchi & Wishmitha Mendis & Kanishka Randunu & Daswin De Silva & Gihan Gamage & Harsha Moraliyage & Nishan Mills & Andrew Jennings, 2024. "Optimizing Generative AI Chatbots for Net-Zero Emissions Energy Internet-of-Things Infrastructure," Energies, MDPI, vol. 17(8), pages 1-19, April.
    8. Bohren, Noah & Hakimov, Rustamdjan & Lalive, Rafael, 2024. "Creative and Strategic Capabilities of Generative AI: Evidence from Large-Scale Experiments," IZA Discussion Papers 17302, Institute of Labor Economics (IZA).
    9. Anthony Harding & Juan Moreno-Cruz, 2024. "Watts and Bots: The Energy Implications of AI Adoption," Papers 2409.06626, arXiv.org.
    10. Andreas D. Landmark & Johan E. Ravn & Hans Y. Torvatn & Lisbeth Øyum, 2024. "Digital Transformations Through the Lens of the Collaborative, Co-Generative and Domesticative," Systemic Practice and Action Research, Springer, vol. 37(5), pages 537-548, October.
    11. Becker, Dominik & Deck, Luca & Feulner, Simon & Gutheil, Niklas & Schüll, Moritz & Decker, Stefan & Eymann, Torsten & Gimpel, Henner & Pippow, Andreas & Röglinger, Maximilian & Urbach, Nils, 2024. "Lohnt sich Microsoft 365 Copilot? Eine Potenzialanalyse für Unternehmen und Bildungseinrichtungen," Bayreuth Reports on Information Systems Management 72, University of Bayreuth, Chair of Information Systems Management.
    12. Pouliakas, Konstantinos & Santangelo, Giulia, 2025. "Are Artificial Intelligence (AI) Skills a Reward or a Gamble? Deconstructing the AI Wage Premium in Europe," IZA Discussion Papers 17607, Institute of Labor Economics (IZA).
    13. Christian Peukert & Florian Abeillon & Jérémie Haese & Franziska Kaiser & Alexander Staub, 2024. "Strategic Behavior and AI Training Data," CESifo Working Paper Series 11099, CESifo.
    14. Antonia Meythaler & Annika Baumann & Hanna Krasnova & Oliver Hinz & Sarah Spiekermann, 2023. "Technology for Humanity," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(5), pages 487-496, October.
    15. Piyush Gulati & Arianna Marchetti & Phanish Puranam & Victoria Sevcenko, 2025. "Generative AI Adoption and Higher Order Skills," Papers 2503.09212, arXiv.org.
    16. Stankov, Petar, 2024. "The death of exams? Grade inflation and student satisfaction when coursework replaces exams," International Review of Economics Education, Elsevier, vol. 46(C).
    17. Iñaki Aldasoro & Leonardo Gambacorta & Anton Korinek & Vatsala Shreeti & Merlin Stein, 2024. "Intelligent financial system: how AI is transforming finance," BIS Working Papers 1194, Bank for International Settlements.
    18. William G. Resh & Yi Ming & Xinyao Xia & Michael Overton & Gul Nisa Gurbuz & Brandon De Breuhl, 2025. "Complementarity, Augmentation, or Substitutivity? The Impact of Generative Artificial Intelligence on the U.S. Federal Workforce," Papers 2503.09637, arXiv.org.
    19. Grimon, Marie-Pascale & Mills, Christopher, 2025. "Better Together? A Field Experiment on Human-Algorithm Interaction in Child Protection," SOFI Working Papers in Labour Economics 2/2025, Stockholm University, Swedish Institute for Social Research.
    20. Udayan Mukherjee & Harry Nicholls, 2024. "The impact of artificial intelligence – an economic analysis," Treasury Analytical Notes Series an24/06, New Zealand Treasury.

    More about this item

    Keywords

    artificial intelligence; productivity; field experiment; big tech;
    All these keywords.

    JEL classification:

    • D22 - Microeconomics - - Production and Organizations - - - Firm Behavior: Empirical Analysis
    • G31 - Financial Economics - - Corporate Finance and Governance - - - Capital Budgeting; Fixed Investment and Inventory Studies
    • R30 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Real Estate Markets, Spatial Production Analysis, and Firm Location - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:1208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Martin Fessler (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.