IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2303.10130.html
   My bibliography  Save this paper

GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models

Author

Listed:
  • Tyna Eloundou
  • Sam Manning
  • Pamela Mishkin
  • Daniel Rock

Abstract

We investigate the potential implications of large language models (LLMs), such as Generative Pre-trained Transformers (GPTs), on the U.S. labor market, focusing on the increased capabilities arising from LLM-powered software compared to LLMs on their own. Using a new rubric, we assess occupations based on their alignment with LLM capabilities, integrating both human expertise and GPT-4 classifications. Our findings reveal that around 80% of the U.S. workforce could have at least 10% of their work tasks affected by the introduction of LLMs, while approximately 19% of workers may see at least 50% of their tasks impacted. We do not make predictions about the development or adoption timeline of such LLMs. The projected effects span all wage levels, with higher-income jobs potentially facing greater exposure to LLM capabilities and LLM-powered software. Significantly, these impacts are not restricted to industries with higher recent productivity growth. Our analysis suggests that, with access to an LLM, about 15% of all worker tasks in the US could be completed significantly faster at the same level of quality. When incorporating software and tooling built on top of LLMs, this share increases to between 47 and 56% of all tasks. This finding implies that LLM-powered software will have a substantial effect on scaling the economic impacts of the underlying models. We conclude that LLMs such as GPTs exhibit traits of general-purpose technologies, indicating that they could have considerable economic, social, and policy implications.

Suggested Citation

  • Tyna Eloundou & Sam Manning & Pamela Mishkin & Daniel Rock, 2023. "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models," Papers 2303.10130, arXiv.org, revised Aug 2023.
  • Handle: RePEc:arx:papers:2303.10130
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2303.10130
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2021. "The Productivity J-Curve: How Intangibles Complement General Purpose Technologies," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(1), pages 333-372, January.
    2. Daron Acemoglu & Pascual Restrepo, 2019. "Automation and New Tasks: How Technology Displaces and Reinstates Labor," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 3-30, Spring.
    3. Goldfarb, Avi & Taska, Bledi & Teodoridis, Florenta, 2023. "Could machine learning be a general purpose technology? A comparison of emerging technologies using data from online job postings," Research Policy, Elsevier, vol. 52(1).
    4. Benjamin Meindl & Morgan R. Frank & Joana Mendonc{c}a, 2021. "Exposure of occupations to technologies of the fourth industrial revolution," Papers 2110.13317, arXiv.org.
    5. Seth G. Benzell & Laurence J. Kotlikoff & Guillermo LaGarda & Victor Yifan Ye, 2021. "Simulating Endogenous Global Automation," NBER Working Papers 29220, National Bureau of Economic Research, Inc.
    6. Benjamin Moll & Lukasz Rachel & Pascual Restrepo, 2022. "Uneven Growth: Automation's Impact on Income and Wealth Inequality," Econometrica, Econometric Society, vol. 90(6), pages 2645-2683, November.
    7. David Autor & Caroline Chin & Anna Salomons & Bryan Seegmiller, 2024. "New Frontiers: The Origins and Content of New Work, 1940–2018," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(3), pages 1399-1465.
    8. Daron Acemoglu & David Autor & Jonathon Hazell & Pascual Restrepo, 2020. "AI and Jobs: Evidence from Online Vacancies," NBER Working Papers 28257, National Bureau of Economic Research, Inc.
    9. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    10. Timothy Bresnahan & Shane Greenstein, 1996. "Technical Progress and Co-invention in Computing and in the Uses of Computers," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 27(1996 Micr), pages 1-83.
    11. Leonid Kogan & Dimitris Papanikolaou & Lawrence D. W. Schmidt & Bryan Seegmiller, 2021. "Technology, Vintage-Specific Human Capital, and Labor Displacement: Evidence from Linking Patents with Occupations," NBER Working Papers 29552, National Bureau of Economic Research, Inc.
    12. Daron Acemoglu & Pascual Restrepo, 2018. "The Race between Man and Machine: Implications of Technology for Growth, Factor Shares, and Employment," American Economic Review, American Economic Association, vol. 108(6), pages 1488-1542, June.
    13. Korinek, Anton, 2023. "Language Models and Cognitive Automation for Economic Research," CEPR Discussion Papers 17923, C.E.P.R. Discussion Papers.
    14. Van Reenen, John, 2011. "Wage inequality, technology and trade: 21st century evidence," Labour Economics, Elsevier, vol. 18(6), pages 730-741.
    15. Daron Acemoglu & Pascual Restrepo, 2022. "Demographics and Automation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(1), pages 1-44.
    16. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    17. Jay Dixon & Bryan Hong & Lynn Wu, 2021. "The Robot Revolution: Managerial and Employment Consequences for Firms," Management Science, INFORMS, vol. 67(9), pages 5586-5605, September.
    18. Daron Acemoglu & Pascual Restrepo, 2022. "Tasks, Automation, and the Rise in U.S. Wage Inequality," Econometrica, Econometric Society, vol. 90(5), pages 1973-2016, September.
    19. Katya Klinova & Anton Korinek, 2021. "AI and Shared Prosperity," Papers 2105.08475, arXiv.org.
    20. Lipsey, Richard G. & Carlaw, Kenneth I. & Bekar, Clifford T., 2005. "Economic Transformations: General Purpose Technologies and Long-Term Economic Growth," OUP Catalogue, Oxford University Press, number 9780199290895.
    21. Erik Brynjolfsson & Tom Mitchell & Daniel Rock, 2018. "What Can Machines Learn, and What Does It Mean for Occupations and the Economy?," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 43-47, May.
    22. Frey, Carl Benedikt & Osborne, Michael A., 2017. "The future of employment: How susceptible are jobs to computerisation?," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 254-280.
    23. Ajay K. Agrawal & Joshua S. Gans & Avi Goldfarb, 2021. "AI Adoption and System-Wide Change," NBER Working Papers 28811, National Bureau of Economic Research, Inc.
    24. Bresnahan, Timothy F, 1999. "Computerisation and Wage Dispersion: An Analytical Reinterpretation," Economic Journal, Royal Economic Society, vol. 109(456), pages 390-415, June.
    25. Arntz, Melanie & Gregory, Terry & Zierahn, Ulrich, 2017. "Revisiting the risk of automation," Economics Letters, Elsevier, vol. 159(C), pages 157-160.
    26. Edward W. Felten & Manav Raj & Robert Seamans, 2018. "A Method to Link Advances in Artificial Intelligence to Occupational Abilities," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 54-57, May.
    27. Ed Felten & Manav Raj & Robert Seamans, 2023. "How will Language Modelers like ChatGPT Affect Occupations and Industries?," Papers 2303.01157, arXiv.org, revised Mar 2023.
    28. Daron Acemoglu, 2002. "Technical Change, Inequality, and the Labor Market," Journal of Economic Literature, American Economic Association, vol. 40(1), pages 7-72, March.
    29. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    30. Iain M. Cockburn & Rebecca Henderson & Scott Stern, 2018. "The Impact of Artificial Intelligence on Innovation," NBER Working Papers 24449, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jasmine Mondolo, 2022. "The composite link between technological change and employment: A survey of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1027-1068, September.
    2. Qin Chen & Jinfeng Ge & Huaqing Xie & Xingcheng Xu & Yanqing Yang, 2023. "Large Language Models at Work in China's Labor Market," Papers 2308.08776, arXiv.org.
    3. Fossen, Frank M. & McLemore, Trevor & Sorgner, Alina, 2024. "Artificial Intelligence and Entrepreneurship," IZA Discussion Papers 17055, Institute of Labor Economics (IZA).
    4. Fossen, Frank M. & Sorgner, Alina, 2022. "New digital technologies and heterogeneous wage and employment dynamics in the United States: Evidence from individual-level data," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    5. Genz, Sabrina & Schnabel, Claus, 2021. "Digging into the Digital Divide: Workers' Exposure to Digitalization and Its Consequences for Individual Employment," IZA Discussion Papers 14649, Institute of Labor Economics (IZA).
    6. Fabio Montobbio & Jacopo Staccioli & Maria Enrica Virgillito & Marco Vivarelli, 2021. "Labour-saving automation and occupational exposure: a text-similarity measure," DISCE - Quaderni del Dipartimento di Politica Economica dipe0021, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    7. Czarnitzki, Dirk & Fernández, Gastón P. & Rammer, Christian, 2023. "Artificial intelligence and firm-level productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 188-205.
    8. Kristina McElheran & J. Frank Li & Erik Brynjolfsson & Zachary Kroff & Emin Dinlersoz & Lucia Foster & Nikolas Zolas, 2024. "AI adoption in America: Who, what, and where," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(2), pages 375-415, March.
    9. Songul Tolan & Annarosa Pesole & Fernando Martinez-Plumed & Enrique Fernandez-Macias & José Hernandez-Orallo & Emilia Gomez, 2020. "Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks," JRC Working Papers on Labour, Education and Technology 2020-02, Joint Research Centre.
    10. Cheng, Can & Luo, Jiayu & Zhu, Chun & Zhang, Shangfeng, 2024. "Artificial intelligence and the skill premium: A numerical analysis of theoretical models," Technological Forecasting and Social Change, Elsevier, vol. 200(C).
    11. Zhang, Xinchun & Sun, Murong & Liu, Jianxu & Xu, Aijia, 2024. "The nexus between industrial robot and employment in China: The effects of technology substitution and technology creation," Technological Forecasting and Social Change, Elsevier, vol. 202(C).
    12. Nikolova, Milena & Cnossen, Femke & Nikolaev, Boris, 2024. "Robots, meaning, and self-determination," Research Policy, Elsevier, vol. 53(5).
    13. Roberto Antonietti & Luca Cattani & Francesca Gambarotto & Giulio Pedrini, 2021. "Education, routine, and complexity-biased Knowledge Enabling Technologies: Evidence from Emilia-Romagna, Italy," Discussion Paper series in Regional Science & Economic Geography 2021-07, Gran Sasso Science Institute, Social Sciences, revised May 2021.
    14. Innocenti, Stefania & Golin, Marta, 2022. "Human capital investment and perceived automation risks: Evidence from 16 countries," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 27-41.
    15. Mauro Caselli & Andrea Fracasso & Arianna Marcolin & Sergio Scicchitano, 2023. "The reassuring effect of firms' technological innovations on workers' job insecurity," International Journal of Manpower, Emerald Group Publishing Limited, vol. 45(4), pages 754-778, October.
    16. Caselli, Mauro & Fracasso, Andrea & Scicchitano, Sergio & Traverso, Silvio & Tundis, Enrico, 2021. "Stop worrying and love the robot: An activity-based approach to assess the impact of robotization on employment dynamics," GLO Discussion Paper Series 802, Global Labor Organization (GLO).
    17. Hang, Leiming & Lu, Wei & Ge, Xiaowei & Ye, Bin & Zhao, Zhiqi & Cheng, Fangfang, 2024. "R&D innovation, industrial evolution and the labor skill structure in China manufacturing," Technological Forecasting and Social Change, Elsevier, vol. 204(C).
    18. Wei, Xiahai & Xu, Jiawei & Cao, Hui, 2024. "Production automation upgrades and the mystery of workers' overwork: Evidence from a manufacturing employer-employee matching survey in China," Journal of Asian Economics, Elsevier, vol. 91(C).
    19. Barth, Erling & Davis, James C. & Freeman, Richard B. & McElheran, Kristina, 2023. "Twisting the demand curve: Digitalization and the older workforce," Journal of Econometrics, Elsevier, vol. 233(2), pages 443-467.
    20. Montobbio, Fabio & Staccioli, Jacopo & Virgillito, Maria Enrica & Vivarelli, Marco, 2022. "Robots and the origin of their labour-saving impact," Technological Forecasting and Social Change, Elsevier, vol. 174(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2303.10130. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.