IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2409.02391.html
   My bibliography  Save this paper

Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translation

Author

Listed:
  • Ali Merali

Abstract

This paper derives 'scaling laws' -- empirical relationships between the amount of training compute used for a Large Language Model (LLM) and its performance -- for economic outcomes. In a preregistered experiment, 300 professional translators completed 1800 tasks with access to one of thirteen LLMs with differing model training compute sizes (or a control). Our results show that model scaling substantially raises productivity: for every 10x increase in model compute, translators completed tasks 12.3% quicker, received 0.18 s.d. higher grades, and earned 16.1% more per minute (including bonus payments). Further, the gains from model scaling are much higher for lower-skilled workers who gain a 4x larger improvement in task completion speed. These results imply further frontier model scaling -- which is currently estimated at 4x increase per year -- may have significant economic implications.

Suggested Citation

  • Ali Merali, 2024. "Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translation," Papers 2409.02391, arXiv.org.
  • Handle: RePEc:arx:papers:2409.02391
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2409.02391
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tyna Eloundou & Sam Manning & Pamela Mishkin & Daniel Rock, 2023. "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models," Papers 2303.10130, arXiv.org, revised Aug 2023.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 05 Aug 2024.
    2. Evangelos Katsamakas & Oleg V. Pavlov & Ryan Saklad, 2024. "Artificial intelligence and the transformation of higher education institutions," Papers 2402.08143, arXiv.org.
    3. Yang Shen, 2024. "Future jobs: analyzing the impact of artificial intelligence on employment and its mechanisms," Economic Change and Restructuring, Springer, vol. 57(2), pages 1-33, April.
    4. Jai Vipra & Anton Korinek, 2023. "Market Concentration Implications of Foundation Models," Papers 2311.01550, arXiv.org.
    5. Kristina McElheran & J. Frank Li & Erik Brynjolfsson & Zachary Kroff & Emin Dinlersoz & Lucia Foster & Nikolas Zolas, 2024. "AI adoption in America: Who, what, and where," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(2), pages 375-415, March.
    6. Lan Chen & Yufei Ji & Xichen Yao & Hengshu Zhu, 2024. "Occupation Life Cycle," Papers 2406.15373, arXiv.org.
    7. Caleb Peppiatt, 2024. "The Future of Work: Inequality, Artificial Intelligence, and What Can Be Done About It. A Literature Review," Papers 2408.13300, arXiv.org.
    8. D'Al, Francesco & Santarelli, Enrico & Vivarelli, Marco, 2024. "The KSTE+I approach and the advent of AI technologies: evidence from the European regions," GLO Discussion Paper Series 1473, Global Labor Organization (GLO).
    9. Amali Matharaarachchi & Wishmitha Mendis & Kanishka Randunu & Daswin De Silva & Gihan Gamage & Harsha Moraliyage & Nishan Mills & Andrew Jennings, 2024. "Optimizing Generative AI Chatbots for Net-Zero Emissions Energy Internet-of-Things Infrastructure," Energies, MDPI, vol. 17(8), pages 1-19, April.
    10. Anna Davies & Betsy Donald & Mia Gray, 2023. "The power of platforms—precarity and place," Cambridge Journal of Regions, Economy and Society, Cambridge Political Economy Society, vol. 16(2), pages 245-256.
    11. Ylenia Curci & Nathalie Greenan & Silvia Napolitano, 2024. "Innovating for the good or for the bad. An EU-wide analysis of the impact of technological transformation on job polarisation and unemployment," TEPP Working Paper 2024-02, TEPP.
    12. Samir Huseynov, 2023. "ChatGPT and the Labor Market: Unraveling the Effect of AI Discussions on Students' Earnings Expectations," Papers 2305.11900, arXiv.org, revised Aug 2023.
    13. Christian Peukert & Florian Abeillon & Jérémie Haese & Franziska Kaiser & Alexander Staub, 2024. "Strategic Behavior and AI Training Data," CESifo Working Paper Series 11099, CESifo.
    14. Dario Guarascio & Jelena Reljic & Roman Stollinger, 2023. "Artificial Intelligence and Employment: A Look into the Crystal Ball," LEM Papers Series 2023/34, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    15. Tatsuru Kikuchi, 2024. "Impact Evaluation on the European Privacy Laws governing generative-AI models -- Evidence in Relation between Internet Censorship and the Ban of ChatGPT in Italy," Papers 2407.06495, arXiv.org.
    16. Fossen, Frank M. & McLemore, Trevor & Sorgner, Alina, 2024. "Artificial Intelligence and Entrepreneurship," IZA Discussion Papers 17055, Institute of Labor Economics (IZA).
    17. Kreitmeir, David & Raschky, Paul Anton, 2023. "The Unintended Consequences of Censoring Digital Technology - Evidence from Italy's ChatGPT Ban," SocArXiv v3cgs, Center for Open Science.
    18. Jin Liu & Xingchen Xu & Xi Nan & Yongjun Li & Yong Tan, 2023. ""Generate" the Future of Work through AI: Empirical Evidence from Online Labor Markets," Papers 2308.05201, arXiv.org, revised Jun 2024.
    19. Dandan Qiao & Huaxia Rui & Qian Xiong, 2023. "AI and Jobs: Has the Inflection Point Arrived? Evidence from an Online Labor Platform," Papers 2312.04180, arXiv.org, revised Aug 2024.
    20. Shun Yiu & Rob Seamans & Manav Raj & Ted Liu, 2024. "Strategic Responses to Technological Change: Evidence from ChatGPT and Upwork," Papers 2403.15262, arXiv.org, revised Apr 2024.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2409.02391. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.