IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2408.07865.html
   My bibliography  Save this paper

Capturing the Complexity of Human Strategic Decision-Making with Machine Learning

Author

Listed:
  • Jian-Qiao Zhu
  • Joshua C. Peterson
  • Benjamin Enke
  • Thomas L. Griffiths

Abstract

Understanding how people behave in strategic settings--where they make decisions based on their expectations about the behavior of others--is a long-standing problem in the behavioral sciences. We conduct the largest study to date of strategic decision-making in the context of initial play in two-player matrix games, analyzing over 90,000 human decisions across more than 2,400 procedurally generated games that span a much wider space than previous datasets. We show that a deep neural network trained on these data predicts people's choices better than leading theories of strategic behavior, indicating that there is systematic variation that is not explained by those theories. We then modify the network to produce a new, interpretable behavioral model, revealing what the original network learned about people: their ability to optimally respond and their capacity to reason about others are dependent on the complexity of individual games. This context-dependence is critical in explaining deviations from the rational Nash equilibrium, response times, and uncertainty in strategic decisions. More broadly, our results demonstrate how machine learning can be applied beyond prediction to further help generate novel explanations of complex human behavior.

Suggested Citation

  • Jian-Qiao Zhu & Joshua C. Peterson & Benjamin Enke & Thomas L. Griffiths, 2024. "Capturing the Complexity of Human Strategic Decision-Making with Machine Learning," Papers 2408.07865, arXiv.org.
  • Handle: RePEc:arx:papers:2408.07865
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2408.07865
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Drew Fudenberg & Jon Kleinberg & Annie Liang & Sendhil Mullainathan, 2022. "Measuring the Completeness of Economic Models," Journal of Political Economy, University of Chicago Press, vol. 130(4), pages 956-990.
    2. Benjamin Enke & Cassidy Shubatt, 2023. "Quantifying Lottery Choice Complexity," CESifo Working Paper Series 10644, CESifo.
    3. McKelvey, Richard D & Palfrey, Thomas R, 1992. "An Experimental Study of the Centipede Game," Econometrica, Econometric Society, vol. 60(4), pages 803-836, July.
    4. Stahl, Dale II & Wilson, Paul W., 1994. "Experimental evidence on players' models of other players," Journal of Economic Behavior & Organization, Elsevier, vol. 25(3), pages 309-327, December.
    5. Robert Bell & Thomas M. Cover, 1988. "Game-Theoretic Optimal Portfolios," Management Science, INFORMS, vol. 34(6), pages 724-733, June.
    6. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    7. Benjamin Enke & Cassidy Shubatt, 2023. "Quantifying Lottery Choice Complexity," NBER Working Papers 31677, National Bureau of Economic Research, Inc.
    8. Costa-Gomes, Miguel & Crawford, Vincent P & Broseta, Bruno, 2001. "Cognition and Behavior in Normal-Form Games: An Experimental Study," Econometrica, Econometric Society, vol. 69(5), pages 1193-1235, September.
    9. Devetag, Giovanna & Warglien, Massimo, 2008. "Playing the wrong game: An experimental analysis of relational complexity and strategic misrepresentation," Games and Economic Behavior, Elsevier, vol. 62(2), pages 364-382, March.
    10. Harsanyi John C., 1995. "A New Theory of Equilibrium Selection for Games with Incomplete Information," Games and Economic Behavior, Elsevier, vol. 10(2), pages 318-332, August.
    11. Weizsacker, Georg, 2003. "Ignoring the rationality of others: evidence from experimental normal-form games," Games and Economic Behavior, Elsevier, vol. 44(1), pages 145-171, July.
    12. Drew Fudenberg & Annie Liang, 2019. "Predicting and Understanding Initial Play," American Economic Review, American Economic Association, vol. 109(12), pages 4112-4141, December.
    13. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    14. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    15. Murnighan, J Keith & Roth, Alvin E & Schoumaker, Francoise, 1988. "Risk Aversion in Bargaining: An Experimental Study," Journal of Risk and Uncertainty, Springer, vol. 1(1), pages 101-124, March.
    16. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    17. Vincent P. Crawford & Miguel A. Costa-Gomes & Nagore Iriberri, 2013. "Structural Models of Nonequilibrium Strategic Thinking: Theory, Evidence, and Applications," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 5-62, March.
    18. Chris L. Baker & Julian Jara-Ettinger & Rebecca Saxe & Joshua B. Tenenbaum, 2017. "Rational quantitative attribution of beliefs, desires and percepts in human mentalizing," Nature Human Behaviour, Nature, vol. 1(4), pages 1-10, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jian-Qiao Zhu & Joshua C. Peterson & Benjamin Enke & Thomas L. Griffiths, 2024. "Capturing the Complexity of Human Strategic Decision-Making with Machine Learning," CESifo Working Paper Series 11296, CESifo.
    2. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    3. Polonio, Luca & Coricelli, Giorgio, 2019. "Testing the level of consistency between choices and beliefs in games using eye-tracking," Games and Economic Behavior, Elsevier, vol. 113(C), pages 566-586.
    4. Despoina Alempaki & Andrew M. Colman & Felix Kölle & Graham Loomes & Briony D. Pulford, 2022. "Investigating the failure to best respond in experimental games," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 656-679, April.
    5. Giovanna Devetag & Sibilla Guida & Luca Polonio, 2016. "An eye-tracking study of feature-based choice in one-shot games," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 177-201, March.
    6. Georganas, Sotiris & Healy, Paul J. & Weber, Roberto A., 2015. "On the persistence of strategic sophistication," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 369-400.
    7. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," Papers 2202.12292, arXiv.org, revised Feb 2022.
    8. Vincent P. Crawford & Nagore Iriberri, 2004. "Fatal Attraction: Focality, Naivete, and Sophistication in Experimental Hide-and-Seek Games," Levine's Bibliography 122247000000000316, UCLA Department of Economics.
    9. HERINGS, P. Jean-Jacques & MAULEON, Ana & VANNETELBOSCH, Vincent, 2014. "Stability of networks under level-K farsightedness," LIDAM Discussion Papers CORE 2014032, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    10. Choo, Lawrence C.Y & Kaplan, Todd R., 2014. "Explaining Behavior in the "11-20" Game," MPRA Paper 52808, University Library of Munich, Germany.
    11. Kyle Hyndman & Antoine Terracol & Jonathan Vaksmann, 2022. "Beliefs and (in)stability in normal-form games," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1146-1172, September.
    12. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    13. Bayer, Ralph C. & Renou, Ludovic, 2016. "Logical omniscience at the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 41-49.
    14. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    15. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    16. Joshua Zonca & Giorgio Coricelli & Luca Polonio, 2019. "Does exposure to alternative decision rules change gaze patterns and behavioral strategies in games?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 14-25, August.
    17. Lensberg, Terje & Schenk-Hoppé, Klaus Reiner, 2021. "Cold play: Learning across bimatrix games," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 419-441.
    18. Ernesto Dal Bó & Pedro Dal Bó & Erik Eyster, 2018. "The Demand for Bad Policy when Voters Underappreciate Equilibrium Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 964-998.
    19. Healy, Paul J. & Park, Hyoeun, 2023. "Model selection accuracy in behavioral game theory: A simulation," European Economic Review, Elsevier, vol. 152(C).
    20. Bayer, R.-C. & Renou, Ludovic, 2016. "Logical abilities and behavior in strategic-form games," Journal of Economic Psychology, Elsevier, vol. 56(C), pages 39-59.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2408.07865. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.