IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2407.14333.html
   My bibliography  Save this paper

Prompt Adaptation as a Dynamic Complement in Generative AI Systems

Author

Listed:
  • Eaman Jahani
  • Benjamin S. Manning
  • Joe Zhang
  • Hong-Yi TuYe
  • Mohammed Alsobay
  • Christos Nicolaides
  • Siddharth Suri
  • David Holtz

Abstract

As generative AI systems rapidly improve, a key question emerges: How do users keep up-and what happens if they fail to do so. Drawing on theories of dynamic capabilities and IT complements, we examine prompt adaptation-the adjustments users make to their inputs in response to evolving model behavior-as a mechanism that helps determine whether technical advances translate into realized economic value. In a preregistered online experiment with 1,893 participants, who submitted over 18,000 prompts and generated more than 300,000 images, users attempted to replicate a target image in 10 tries using one of three randomly assigned models: DALL-E 2, DALL-E 3, or DALL-E 3 with automated prompt rewriting. We find that users with access to DALL-E 3 achieved higher image similarity than those with DALL-E 2-but only about half of this gain (51%) came from the model itself. The other half (49%) resulted from users adapting their prompts in response to the model's capabilities. This adaptation emerged across the skill distribution, was driven by trial-and-error, and could not be replicated by automated prompt rewriting, which erased 58% of the performance improvement associated with DALL-E 3. Our findings position prompt adaptation as a dynamic complement to generative AI-and suggest that without it, a substantial share of the economic value created when models advance may go unrealized.

Suggested Citation

  • Eaman Jahani & Benjamin S. Manning & Joe Zhang & Hong-Yi TuYe & Mohammed Alsobay & Christos Nicolaides & Siddharth Suri & David Holtz, 2024. "Prompt Adaptation as a Dynamic Complement in Generative AI Systems," Papers 2407.14333, arXiv.org, revised Apr 2025.
  • Handle: RePEc:arx:papers:2407.14333
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2407.14333
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2023. "Generative AI at Work," Papers 2304.11771, arXiv.org, revised Nov 2024.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    2. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 20 Mar 2025.
    3. Gaétan de Rassenfosse & Adam B. Jaffe & Joel Waldfogel, 2025. "Intellectual Property and Creative Machines," Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 4(1), pages 47-79.
    4. Leonardo Banh & Gero Strobel, 2023. "Generative artificial intelligence," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-17, December.
    5. Alexander Cuntz & Carsten Fink & Hansueli Stamm, 2024. "Artificial Intelligence and Intellectual Property : An Economic Perspective," WIPO Economic Research Working Papers 77, World Intellectual Property Organization - Economics and Statistics Division.
    6. Lilia Patrignani, 2024. "Understanding digital trade," Questioni di Economia e Finanza (Occasional Papers) 841, Bank of Italy, Economic Research and International Relations Area.
    7. Amali Matharaarachchi & Wishmitha Mendis & Kanishka Randunu & Daswin De Silva & Gihan Gamage & Harsha Moraliyage & Nishan Mills & Andrew Jennings, 2024. "Optimizing Generative AI Chatbots for Net-Zero Emissions Energy Internet-of-Things Infrastructure," Energies, MDPI, vol. 17(8), pages 1-19, April.
    8. Bohren, Noah & Hakimov, Rustamdjan & Lalive, Rafael, 2024. "Creative and Strategic Capabilities of Generative AI: Evidence from Large-Scale Experiments," IZA Discussion Papers 17302, Institute of Labor Economics (IZA).
    9. Anthony Harding & Juan Moreno-Cruz, 2024. "Watts and Bots: The Energy Implications of AI Adoption," Papers 2409.06626, arXiv.org.
    10. Andreas D. Landmark & Johan E. Ravn & Hans Y. Torvatn & Lisbeth Øyum, 2024. "Digital Transformations Through the Lens of the Collaborative, Co-Generative and Domesticative," Systemic Practice and Action Research, Springer, vol. 37(5), pages 537-548, October.
    11. Leonardo Gambacorta & Han Qiu & Shuo Shan & Daniel M Rees, 2024. "Generative AI and labour productivity: a field experiment on coding," BIS Working Papers 1208, Bank for International Settlements.
    12. Becker, Dominik & Deck, Luca & Feulner, Simon & Gutheil, Niklas & Schüll, Moritz & Decker, Stefan & Eymann, Torsten & Gimpel, Henner & Pippow, Andreas & Röglinger, Maximilian & Urbach, Nils, 2024. "Lohnt sich Microsoft 365 Copilot? Eine Potenzialanalyse für Unternehmen und Bildungseinrichtungen," Bayreuth Reports on Information Systems Management 72, University of Bayreuth, Chair of Information Systems Management.
    13. Pouliakas, Konstantinos & Santangelo, Giulia, 2025. "Are Artificial Intelligence (AI) Skills a Reward or a Gamble? Deconstructing the AI Wage Premium in Europe," IZA Discussion Papers 17607, Institute of Labor Economics (IZA).
    14. Christian Peukert & Florian Abeillon & Jérémie Haese & Franziska Kaiser & Alexander Staub, 2024. "Strategic Behavior and AI Training Data," CESifo Working Paper Series 11099, CESifo.
    15. Antonia Meythaler & Annika Baumann & Hanna Krasnova & Oliver Hinz & Sarah Spiekermann, 2023. "Technology for Humanity," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(5), pages 487-496, October.
    16. Piyush Gulati & Arianna Marchetti & Phanish Puranam & Victoria Sevcenko, 2025. "Generative AI Adoption and Higher Order Skills," Papers 2503.09212, arXiv.org.
    17. Stankov, Petar, 2024. "The death of exams? Grade inflation and student satisfaction when coursework replaces exams," International Review of Economics Education, Elsevier, vol. 46(C).
    18. Iñaki Aldasoro & Leonardo Gambacorta & Anton Korinek & Vatsala Shreeti & Merlin Stein, 2024. "Intelligent financial system: how AI is transforming finance," BIS Working Papers 1194, Bank for International Settlements.
    19. William G. Resh & Yi Ming & Xinyao Xia & Michael Overton & Gul Nisa Gurbuz & Brandon De Breuhl, 2025. "Complementarity, Augmentation, or Substitutivity? The Impact of Generative Artificial Intelligence on the U.S. Federal Workforce," Papers 2503.09637, arXiv.org.
    20. Grimon, Marie-Pascale & Mills, Christopher, 2025. "Better Together? A Field Experiment on Human-Algorithm Interaction in Child Protection," SOFI Working Papers in Labour Economics 2/2025, Stockholm University, Swedish Institute for Social Research.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2407.14333. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.