IDEAS home Printed from https://ideas.repec.org/a/kap/theord/v96y2024i1d10.1007_s11238-023-09941-z.html
   My bibliography  Save this article

Bounded rationality for relaxing best response and mutual consistency: the quantal hierarchy model of decision making

Author

Listed:
  • Benjamin Patrick Evans

    (University of Sydney)

  • Mikhail Prokopenko

    (University of Sydney)

Abstract

While game theory has been transformative for decision making, the assumptions made can be overly restrictive in certain instances. In this work, we investigate some of the underlying assumptions of rationality, such as mutual consistency and best response, and consider ways to relax these assumptions using concepts from level-k reasoning and quantal response equilibrium (QRE) respectively. Specifically, we propose an information-theoretic two-parameter model called the quantal hierarchy model, which can relax both mutual consistency and best response while still approximating level-k, QRE, or typical Nash equilibrium behavior in the limiting cases. The model is based on a recursive form of the variational free energy principle, representing higher-order reasoning as (pseudo) sequential decision-making in extensive-form game tree. This representation enables us to treat simultaneous games in a similar manner to sequential games, where reasoning resources deplete throughout the game-tree. Bounds in player processing abilities are captured as information costs, where future branches of reasoning are discounted, implying a hierarchy of players where lower-level players have fewer processing resources. We demonstrate the effectiveness of the quantal hierarchy model in several canonical economic games, both simultaneous and sequential, using out-of-sample modelling.

Suggested Citation

  • Benjamin Patrick Evans & Mikhail Prokopenko, 2024. "Bounded rationality for relaxing best response and mutual consistency: the quantal hierarchy model of decision making," Theory and Decision, Springer, vol. 96(1), pages 71-111, February.
  • Handle: RePEc:kap:theord:v:96:y:2024:i:1:d:10.1007_s11238-023-09941-z
    DOI: 10.1007/s11238-023-09941-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11238-023-09941-z
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11238-023-09941-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yukio Koriyama & Ali Ihsan Ozkes, 2017. "Condorcet Jury Theorem and Cognitive Hierarchies: Theory and Experiments," Working Papers halshs-01485748, HAL.
    2. Larbi Alaoui & Antonio Penta, 2016. "Endogenous Depth of Reasoning," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1297-1333.
    3. McKelvey, Richard D & Palfrey, Thomas R, 1992. "An Experimental Study of the Centipede Game," Econometrica, Econometric Society, vol. 60(4), pages 803-836, July.
    4. Ke, Shaowei, 2019. "Boundedly rational backward induction," Theoretical Economics, Econometric Society, vol. 14(1), January.
    5. Larbi Alaoui & Antonio Penta, 2022. "Cost-Benefit Analysis in Reasoning," Journal of Political Economy, University of Chicago Press, vol. 130(4), pages 881-925.
    6. Stahl Dale O. & Wilson Paul W., 1995. "On Players' Models of Other Players: Theory and Experimental Evidence," Games and Economic Behavior, Elsevier, vol. 10(1), pages 218-254, July.
    7. Binmore, Ken & McCarthy, John & Ponti, Giovanni & Samuelson, Larry & Shaked, Avner, 2002. "A Backward Induction Experiment," Journal of Economic Theory, Elsevier, vol. 104(1), pages 48-88, May.
    8. Amnon Rapoport & Darryl A. Seale & Ido Erev & James A. Sundali, 1998. "Equilibrium Play in Large Group Market Entry Games," Management Science, INFORMS, vol. 44(1), pages 119-141, January.
    9. Colin Camerer & Teck Ho & Kuan Chong, 2003. "Models of Thinking, Learning, and Teaching in Games," American Economic Review, American Economic Association, vol. 93(2), pages 192-195, May.
    10. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    11. Andrew Caplin & Mark Dean & John Leahy, 2019. "Rational Inattention, Optimal Consideration Sets, and Stochastic Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(3), pages 1061-1094.
    12. Antoni Bosch-Domènech & José G. Montalvo & Rosemarie Nagel & Albert Satorra, 2002. "One, Two, (Three), Infinity, ...: Newspaper and Lab Beauty-Contest Experiments," American Economic Review, American Economic Association, vol. 92(5), pages 1687-1701, December.
    13. Breitmoser, Yves, 2012. "Strategic reasoning in p-beauty contests," Games and Economic Behavior, Elsevier, vol. 75(2), pages 555-569.
    14. Lipman, Barton L, 1991. "How to Decide How to Decide How to. . . : Modeling Limited Rationality," Econometrica, Econometric Society, vol. 59(4), pages 1105-1125, July.
    15. Hoppe, Hans-Hermann, 1997. "On Certainty and Uncertainty, or: How Rational Can Our Expectations Be?," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 10(1), pages 49-78.
    16. J. M. Keynes, 1937. "The General Theory of Employment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 51(2), pages 209-223.
    17. Konstantinos Georgalos, 2020. "Comparing Behavioral Models Using Data From Experimental Centipede Games," Economic Inquiry, Western Economic Association International, vol. 58(1), pages 34-48, January.
    18. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1329-1340, November.
    19. Chong, Juin-Kuan & Ho, Teck-Hua & Camerer, Colin, 2016. "A generalized cognitive hierarchy model of games," Games and Economic Behavior, Elsevier, vol. 99(C), pages 257-274.
    20. Rogers, Brian W. & Palfrey, Thomas R. & Camerer, Colin F., 2009. "Heterogeneous quantal response equilibrium and cognitive hierarchies," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1440-1467, July.
    21. Xavier Gabaix & David Laibson & Guillermo Moloche & Stephen Weinberg, 2006. "Costly Information Acquisition: Experimental Analysis of a Boundedly Rational Model," American Economic Review, American Economic Association, vol. 96(4), pages 1043-1068, September.
    22. W. Brian Arthur, 1994. "Inductive Reasoning, Bounded Rationality and the Bar Problem," Working Papers 94-03-014, Santa Fe Institute.
    23. Richard Mckelvey & Thomas Palfrey, 1998. "Quantal Response Equilibria for Extensive Form Games," Experimental Economics, Springer;Economic Science Association, vol. 1(1), pages 9-41, June.
    24. John C. Harsanyi, 1967. "Games with Incomplete Information Played by "Bayesian" Players, I-III Part I. The Basic Model," Management Science, INFORMS, vol. 14(3), pages 159-182, November.
    25. Koriyama, Yukio & Ozkes, Ali I., 2021. "Inclusive cognitive hierarchy," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 458-480.
    26. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    27. David Glasner, 2022. "Hayek, Hicks, Radner and four equilibrium concepts: Perfect foresight, sequential, temporary, and rational expectations," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 35(1), pages 39-61, March.
    28. Christian Bach & Andrés Perea, 2014. "Utility proportional beliefs," International Journal of Game Theory, Springer;Game Theory Society, vol. 43(4), pages 881-902, November.
    29. Binmore, Ken, 1987. "Modeling Rational Players: Part I," Economics and Philosophy, Cambridge University Press, vol. 3(2), pages 179-214, October.
    30. MERTENS, Jean-François & ZAMIR, Shmuel, 1985. "Formulation of Bayesian analysis for games with incomplete information," LIDAM Reprints CORE 608, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    31. Friedman, Evan, 2020. "Endogenous quantal response equilibrium," Games and Economic Behavior, Elsevier, vol. 124(C), pages 620-643.
    32. Duffy, John & Hopkins, Ed, 2005. "Learning, information, and sorting in market entry games: theory and evidence," Games and Economic Behavior, Elsevier, vol. 51(1), pages 31-62, April.
    33. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    34. Stahl, D O, 1990. "Entropy Control Costs and Entropic Equilibria," International Journal of Game Theory, Springer;Game Theory Society, vol. 19(2), pages 129-138.
    35. Theodore Turocy, 2010. "Computing sequential equilibria using agent quantal response equilibria," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(1), pages 255-269, January.
    36. Krockow, Eva M. & Pulford, Briony D. & Colman, Andrew M., 2018. "Far but finite horizons promote cooperation in the Centipede game," Journal of Economic Psychology, Elsevier, vol. 67(C), pages 191-199.
    37. Jacob Goeree & Charles Holt & Thomas Palfrey, 2005. "Regular Quantal Response Equilibrium," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 347-367, December.
    38. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    39. Johnson, Eric J. & Camerer, Colin & Sen, Sankar & Rymon, Talia, 2002. "Detecting Failures of Backward Induction: Monitoring Information Search in Sequential Bargaining," Journal of Economic Theory, Elsevier, vol. 104(1), pages 16-47, May.
    40. Thomas Webster, 2013. "A Note on the Ultimatum Paradox, Bounded Rationality, and Uncertainty," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 19(1), pages 1-10, February.
    41. Avi Goldfarb & Mo Xiao, 2011. "Who Thinks about the Competition? Managerial Ability and Strategic Entry in US Local Telephone Markets," American Economic Review, American Economic Association, vol. 101(7), pages 3130-3161, December.
    42. Challet, Damien & Marsili, Matteo & Zhang, Yi-Cheng, 2013. "Minority Games: Interacting agents in financial markets," OUP Catalogue, Oxford University Press, number 9780199686698.
    43. Goeree, Jacob K. & Holt, Charles A., 2004. "A model of noisy introspection," Games and Economic Behavior, Elsevier, vol. 46(2), pages 365-382, February.
    44. Binmore, Ken, 1988. "Modeling Rational Players: Part II," Economics and Philosophy, Cambridge University Press, vol. 4(1), pages 9-55, April.
    45. Mattsson, Lars-Goran & Weibull, Jorgen W., 2002. "Probabilistic choice and procedurally bounded rationality," Games and Economic Behavior, Elsevier, vol. 41(1), pages 61-78, October.
    46. Arthur, W Brian, 1994. "Inductive Reasoning and Bounded Rationality," American Economic Review, American Economic Association, vol. 84(2), pages 406-411, May.
    47. Anufriev, Mikhail & Duffy, John & Panchenko, Valentyn, 2022. "Learning in two-dimensional beauty contest games: Theory and experimental evidence," Journal of Economic Theory, Elsevier, vol. 201(C).
    48. Jacob K. Goeree & Charles A. Holt & Thomas R. Palfrey, 2016. "Quantal Response Equilibrium:A Stochastic Theory of Games," Economics Books, Princeton University Press, edition 1, number 10743.
    49. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "A maximum entropy model of bounded rational decision-making with prior beliefs and market feedback," Papers 2102.09180, arXiv.org, revised May 2021.
    50. Goeree, Jacob K. & Holt, Charles A., 2005. "An Explanation of Anomalous Behavior in Models of Political Participation," American Political Science Review, Cambridge University Press, vol. 99(2), pages 201-213, May.
    51. Teck-Hua Ho & Xuanming Su, 2013. "A Dynamic Level-k Model in Sequential Games," Management Science, INFORMS, vol. 59(2), pages 452-469, March.
    52. Roger Koppl & J. Barkley Rosser Jr, 2002. "All That I Have to Say Has Already Crossed Your Mind," Metroeconomica, Wiley Blackwell, vol. 53(4), pages 339-360, November.
    53. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    54. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," Papers 2202.12292, arXiv.org, revised Feb 2022.
    55. Kawagoe, Toshiji & Takizawa, Hirokazu, 2012. "Level-k analysis of experimental centipede games," Journal of Economic Behavior & Organization, Elsevier, vol. 82(2), pages 548-566.
    56. Polonio, Luca & Coricelli, Giorgio, 2019. "Testing the level of consistency between choices and beliefs in games using eye-tracking," Games and Economic Behavior, Elsevier, vol. 113(C), pages 566-586.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making," Papers 2106.15844, arXiv.org, revised Mar 2023.
    2. Lin, Po-Hsuan & Palfrey, Thomas R., 2024. "Cognitive hierarchies for games in extensive form," Journal of Economic Theory, Elsevier, vol. 220(C).
    3. Alan Kirman & François Laisney & Paul Pezanis-Christou, 2023. "Relaxing the symmetry assumption in participation games: a specification test for cluster-heterogeneity," Experimental Economics, Springer;Economic Science Association, vol. 26(4), pages 850-878, September.
    4. Choo, Lawrence C.Y & Kaplan, Todd R., 2014. "Explaining Behavior in the "11-20" Game," MPRA Paper 52808, University Library of Munich, Germany.
    5. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    6. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," Papers 2202.12292, arXiv.org, revised Feb 2022.
    7. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    8. Vincent P. Crawford & Miguel A. Costa-Gomes & Nagore Iriberri, 2010. "Strategic Thinking," Levine's Working Paper Archive 661465000000001148, David K. Levine.
    9. Koriyama, Yukio & Ozkes, Ali I., 2021. "Inclusive cognitive hierarchy," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 458-480.
    10. Kirman, Alan P. & Laisney, François & Pezanis-Christou, Paul, 2018. "Exploration vs exploitation, impulse balance equilibrium, and a specification test for the El Farol bar problem," ZEW Discussion Papers 18-038, ZEW - Leibniz Centre for European Economic Research.
    11. Georganas, Sotiris & Healy, Paul J. & Weber, Roberto A., 2015. "On the persistence of strategic sophistication," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 369-400.
    12. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," Working Papers halshs-03735680, HAL.
    13. Benndorf, Volker & Kübler, Dorothea & Normann, Hans-Theo, 2015. "Privacy concerns, voluntary disclosure of information, and unraveling: An experiment," European Economic Review, Elsevier, vol. 75(C), pages 43-59.
    14. Rogers, Brian W. & Palfrey, Thomas R. & Camerer, Colin F., 2009. "Heterogeneous quantal response equilibrium and cognitive hierarchies," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1440-1467, July.
    15. repec:hum:wpaper:sfb649dp2013-040 is not listed on IDEAS
    16. Feng, Jun & Qin, Xiangdong & Wang, Xiaoyuan, 2021. "A Bayesian cognitive hierarchy model with fixed reasoning levels," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 704-723.
    17. Shuige Liu, 2024. "Level-$k$ Reasoning, Cognitive Hierarchy, and Rationalizability," Papers 2404.19623, arXiv.org, revised Sep 2024.
    18. Wright, James R. & Leyton-Brown, Kevin, 2017. "Predicting human behavior in unrepeated, simultaneous-move games," Games and Economic Behavior, Elsevier, vol. 106(C), pages 16-37.
    19. Breitmoser, Yves & Tan, Jonathan H.W. & Zizzo, Daniel John, 2014. "On the beliefs off the path: Equilibrium refinement due to quantal response and level-k," Games and Economic Behavior, Elsevier, vol. 86(C), pages 102-125.
    20. Breitmoser, Yves, 2010. "Hierarchical Reasoning versus Iterated Reasoning in p-Beauty Contest Guessing Games," MPRA Paper 19893, University Library of Munich, Germany.
    21. Willemien Kets, 2007. "The minority game: An economics perspective," Papers 0706.4432, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:theord:v:96:y:2024:i:1:d:10.1007_s11238-023-09941-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.