IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/2393.html
   My bibliography  Save this paper

STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

Author

Listed:
  • Chuanhao Li

    (Yale University)

  • Runhan Yang

    (The Chinese University of Hong Kong)

  • Tiankai Li

    (University of Science and Technology of China)

  • Milad Bafarassat

    (Sabanci University)

  • Kourosh Sharifi

    (Sabanci University)

  • Dirk Bergemann

    (Yale University)

  • Zhuoran Yang

    (Yale University)

Abstract

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments is hampered by significant limitations including poor mathematical reasoning, difficulty in following instructions, and a tendency to generate incorrect information. These deficiencies hinder their performance in strategic and interactive tasks that demand adherence to nuanced game rules, long-term planning, exploration in unknown environments, and anticipation of opponentsÕ moves. To overcome these obstacles, this paper presents a novel LLM agent framework equipped with memory and specialized tools to enhance their strategic decision-making capabilities. We deploy the tools in a number of economically important environments, in particular bilateral bargaining and multi-agent and dynamic mechanism design. We employ quantitative metrics to assess the frameworkÕs performance in various strategic decision-making problems. Our findings establish that our enhanced framework significantly improves the strategic decision-making capability of LLMs. While we highlight the inherent limitations of current LLM models, we demonstrate the improvements through targeted enhancements, suggesting a promising direction for future developments in LLM applications for interactive environments.

Suggested Citation

  • Chuanhao Li & Runhan Yang & Tiankai Li & Milad Bafarassat & Kourosh Sharifi & Dirk Bergemann & Zhuoran Yang, 2024. "STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making," Cowles Foundation Discussion Papers 2393, Cowles Foundation for Research in Economics, Yale University.
  • Handle: RePEc:cwl:cwldpp:2393
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/2024-05/d2393.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rubinstein, Ariel, 1982. "Perfect Equilibrium in a Bargaining Model," Econometrica, Econometric Society, vol. 50(1), pages 97-109, January.
    2. Dirk Bergemann & Juuso Välimäki, 2019. "Dynamic Mechanism Design: An Introduction," Journal of Economic Literature, American Economic Association, vol. 57(2), pages 235-274, June.
    3. Dirk Bergemann & Juuso V‰lim‰ki, 2010. "The Dynamic Pivot Mechanism," Econometrica, Econometric Society, vol. 78(2), pages 771-789, March.
    4. Peter C. Cramton, 1984. "Bargaining with Incomplete Information: An Infinite-Horizon Model with Two-Sided Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 51(4), pages 579-593.
    5. Nunzio Lor`e & Babak Heydari, 2023. "Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framing," Papers 2309.05898, arXiv.org.
    6. Joel Sobel & Ichiro Takahashi, 1983. "A Multistage Model of Bargaining," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 50(3), pages 411-426.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Merlo, Antonio & Ortalo-Magne, Francois, 2004. "Bargaining over residential real estate: evidence from England," Journal of Urban Economics, Elsevier, vol. 56(2), pages 192-216, September.
    2. Antonio Merlo & François Ortalo-Magné, 2002. "Bargaining over Residential Real Estate: Evidence from England (Third Version)," PIER Working Paper Archive 04-020, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Mar 2004.
    3. Daughety, Andrew F. & Reinganum, Jennifer F., 1994. "Settlement negotiations with two-sided asymmetric information: Model duality, information distribution, and efficiency," International Review of Law and Economics, Elsevier, vol. 14(3), pages 283-298, September.
    4. Wang, Ruqu, 2001. "Optimal pricing strategy for durable-goods monopoly," Journal of Economic Dynamics and Control, Elsevier, vol. 25(5), pages 789-804, May.
    5. Kjell Hausken, 1997. "Game-theoretic and Behavioral Negotiation Theory," Group Decision and Negotiation, Springer, vol. 6(6), pages 511-528, December.
    6. Stefan Kohler, 2012. "Incomplete Information about Social Preferences Explains Equal Division and Delay in Bargaining," Games, MDPI, vol. 3(3), pages 1-19, September.
    7. Francesc Dilmé, 2021. "The Role of Discounting in Bargaining with One-Sided Offers," ECONtribute Discussion Papers Series 063, University of Bonn and University of Cologne, Germany.
    8. Kamdem, Cyrille Bergaly & Galtier, Franck & Gockowski, James & Helene, David-Benz & Egg, Johny & Dia, Bernadette Kamgnia, 2010. "What determines the price received by cocoa farmers in Cameroon? An empirical analysis based on bargaining theory," African Journal of Agricultural and Resource Economics, African Association of Agricultural Economists, vol. 5(2), pages 1-22, December.
    9. Manuel Adelino & Kristopher Gerardi & Barney Hartman-Glaser, 2016. "Are Lemons Sold First? Dynamic Signaling in the Mortgage Market," FRB Atlanta Working Paper 2016-8, Federal Reserve Bank of Atlanta.
    10. Van Damme, Eric & Selten, Reinhard & Winter, Eyal, 1990. "Alternating bid bargaining with a smallest money unit," Games and Economic Behavior, Elsevier, vol. 2(2), pages 188-201, June.
    11. D. Abreu & D. Pearce, 1999. "A Behavioral Model of Bargaining with Endogenous Types," Princeton Economic Theory Papers 00s15, Economics Department, Princeton University.
    12. Kyung nok Chun & Zachary Schaller & Stergios Skaperdas, 2020. "Why Are There Strikes?," Revue d'économie politique, Dalloz, vol. 130(6), pages 929-956.
    13. Colin F. Camerer & Gideon Nave & Alec Smith, 2019. "Dynamic Unstructured Bargaining with Private Information: Theory, Experiment, and Outcome Prediction via Machine Learning," Management Science, INFORMS, vol. 65(4), pages 1867-1890, April.
    14. David Bounies & Antoine Dubus & Patrick Waelbroeck, 2020. "Market for Information and Selling Mechanisms," Working Papers ECARES 2020-07, ULB -- Universite Libre de Bruxelles.
    15. Milam, Garrett, 2006. "A laboratory study of haggling with deadlines," International Journal of Industrial Organization, Elsevier, vol. 24(3), pages 505-520, May.
    16. Tsoy, Anton, 2018. "Alternating-offer bargaining with the global games information structure," Theoretical Economics, Econometric Society, vol. 13(2), May.
    17. Heggedal, Tom-Reiel & Helland, Leif & Våge Knutsen, Magnus, 2022. "The power of outside options in the presence of obstinate types," Games and Economic Behavior, Elsevier, vol. 136(C), pages 454-468.
    18. Yasushi Masuda & Seungjin Whang, 2021. "Digitization and profitability," Information Systems and e-Business Management, Springer, vol. 19(2), pages 389-403, June.
    19. Rasmusen, E., 1994. "A Model of Negotiation, not Bargainig," Papers 94-007, Indiana - Center for Econometric Model Research.
    20. Kalyan Chatterjee & Gary L. Lilien, 1984. "Efficiency of Alternative Bargaining Procedures," Journal of Conflict Resolution, Peace Science Society (International), vol. 28(2), pages 270-295, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:2393. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.