IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v152y2018icp224-234.html
   My bibliography  Save this article

The reinforcement heuristic in normal form games

Author

Listed:
  • Alós-Ferrer, Carlos
  • Ritschel, Alexander

Abstract

We analyze simple reinforcement-based behavioral rules in 3 × 3 games through choice data and response times. We argue that there is a large overlap between reinforcement-based heuristics (win-stay, lose-shift) and the more “rational” behavioral rule of myopic best reply. However, evidence from response times shows that choices in agreement with the common prescription of those rules are comparatively fast, and choices of the form “lose-shift” occur more frequently for larger differences with bygone payoffs. Both observations speak in favor of reinforcement processes as a cognitive shortcut for apparent myopic best reply, and advise caution when interpreting behavioral results in favor of optimizing behavior.

Suggested Citation

  • Alós-Ferrer, Carlos & Ritschel, Alexander, 2018. "The reinforcement heuristic in normal form games," Journal of Economic Behavior & Organization, Elsevier, vol. 152(C), pages 224-234.
    • Handle: RePEc:eee:jeborg:v:152:y:2018:i:c:p:224-234
    DOI: 10.1016/j.jebo.2018.06.014
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268118301732
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jebo.2018.06.014?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alos-Ferrer, Carlos & Weidenholzer, Simon, 2007. "Partial bandwagon effects and local interactions," Games and Economic Behavior, Elsevier, vol. 61(2), pages 179-197, November.
    2. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    3. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    4. Kandori Michihiro & Rob Rafael, 1995. "Evolution of Equilibria in the Long Run: A General Theory and Applications," Journal of Economic Theory, Elsevier, vol. 65(2), pages 383-414, April.
    5. Charness, Gary & Gneezy, Uri & Halladay, Brianna, 2016. "Experimental methods: Pay one or pay all," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 141-150.
    6. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    7. Alós-Ferrer, Carlos & Hügelschäfer, Sabine & Li, Jiahui, 2017. "Framing effects and the reinforcement heuristic," Economics Letters, Elsevier, vol. 156(C), pages 32-35.
    8. Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
    9. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    10. Anja Achtziger & Carlos Alós-Ferrer, 2014. "Fast or Rational? A Response-Times Study of Bayesian Updating," Management Science, INFORMS, vol. 60(4), pages 923-938, April.
    11. Fernando Vega-Redondo, 1997. "The Evolution of Walrasian Behavior," Econometrica, Econometric Society, vol. 65(2), pages 375-384, March.
    12. Gary Charness & Dan Levin, 2005. "When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect," American Economic Review, American Economic Association, vol. 95(4), pages 1300-1309, September.
    13. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    14. Lang, Frieder R. & John, Dennis & Lüdtke, Oliver & Schupp, Jürgen & Wagner, Gert G., 2011. "Short Assessment of the Big Five: Robust Across Survey Methods Except Telephone Interviewing," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 43(2), pages 548-567.
    15. Alós-Ferrer, Carlos & Strack, Fritz, 2014. "From dual processes to multiple selves: Implications for economic behavior," Journal of Economic Psychology, Elsevier, vol. 41(C), pages 1-11.
    16. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    17. Robin L. Dillon & Catherine H. Tinsley, 2008. "How Near-Misses Influence Decision Making Under Risk: A Missed Opportunity for Learning," Management Science, INFORMS, vol. 54(8), pages 1425-1440, August.
    18. Laslier, Jean-Francois & Topol, Richard & Walliser, Bernard, 2001. "A Behavioral Learning Process in Games," Games and Economic Behavior, Elsevier, vol. 37(2), pages 340-366, November.
    19. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2018. "Incentives in Experiments: A Theoretical Analysis," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1472-1503.
    20. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    21. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, April.
    22. Alós-Ferrer, Carlos & Weidenholzer, Simon, 2008. "Contagion and efficiency," Journal of Economic Theory, Elsevier, vol. 143(1), pages 251-274, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francesco Fallucchi & Jan Niederreiter & Massimo Riccaboni, 2021. "Learning and dropout in contests: an experimental approach," Theory and Decision, Springer, vol. 90(2), pages 245-278, March.
    2. repec:cup:judgdm:v:14:y:2019:i:4:p:381-394 is not listed on IDEAS
    3. Arkady Konovalov & Ian Krajbich, 2019. "Revealed strength of preference: Inference from response times," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(4), pages 381-394, July.
    4. Carlos Alós-Ferrer & Ernst Fehr & Nick Netzer, 2021. "Time Will Tell: Recovering Preferences When Choices Are Noisy," Journal of Political Economy, University of Chicago Press, vol. 129(6), pages 1828-1877.
    5. Ayşegül Engin, 2021. "The cognitive ability and working memory framework: Interpreting cognitive reflection test results in the domain of the cognitive experiential theory," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 29(1), pages 227-245, March.
    6. Carlos Alós-Ferrer & Michele Garagnani, 2022. "Strength of preference and decisions under risk," Journal of Risk and Uncertainty, Springer, vol. 64(3), pages 309-329, June.
    7. Sawa, Ryoji, 2021. "A prospect theory Nash bargaining solution and its stochastic stability," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 692-711.
    8. Carlos Alós-Ferrer & Jaume García-Segarra & Alexander Ritschel, 2018. "The Big Robber Game," ECON - Working Papers 291, Department of Economics - University of Zurich.
    9. Alós-Ferrer, Carlos & Ritschel, Alexander, 2021. "Multiple behavioral rules in Cournot oligopolies," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 250-267.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alós-Ferrer, Carlos & Ritschel, Alexander, 2021. "Multiple behavioral rules in Cournot oligopolies," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 250-267.
    2. Anja Achtziger & Carlos Alós-Ferrer & Alexander Ritschel, 2020. "Cognitive load in economic decisions," ECON - Working Papers 354, Department of Economics - University of Zurich.
    3. Jaromír Kovářík & Friederike Mengel & José Gabriel Romero, 2018. "Learning in network games," Quantitative Economics, Econometric Society, vol. 9(1), pages 85-139, March.
      • Kovarik, Jaromir & Mengel, Friederike & Romero, José Gabriel, 2012. "Learning in Network Games," IKERLANAK http://www-fae1-eao1-ehu-, Universidad del País Vasco - Departamento de Fundamentos del Análisis Económico I.
    4. Andreas Nicklisch, 2011. "Learning strategic environments: an experimental study of strategy formation and transfer," Theory and Decision, Springer, vol. 71(4), pages 539-558, October.
    5. Cominetti, Roberto & Melo, Emerson & Sorin, Sylvain, 2010. "A payoff-based learning procedure and its application to traffic games," Games and Economic Behavior, Elsevier, vol. 70(1), pages 71-83, September.
    6. DeJong, D.V. & Blume, A. & Neumann, G., 1998. "Learning in Sender-Receiver Games," Other publications TiSEM 4a8b4f46-f30b-4ad2-bb0c-1, Tilburg University, School of Economics and Management.
    7. Jean-François Laslier & Bernard Walliser, 2015. "Stubborn learning," Theory and Decision, Springer, vol. 79(1), pages 51-93, July.
    8. Apesteguia, Jose & Huck, Steffen & Oechssler, Jorg, 2007. "Imitation--theory and experimental evidence," Journal of Economic Theory, Elsevier, vol. 136(1), pages 217-235, September.
    9. Dürsch, Peter & Kolb, Albert & Oechssler, Jörg & Schipper, Burkhard C., 2005. "Rage Against the Machines: How Subjects Learn to Play Against Computers," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 63, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    10. Beggs, A.W., 2005. "On the convergence of reinforcement learning," Journal of Economic Theory, Elsevier, vol. 122(1), pages 1-36, May.
    11. Wolf Ze'ev Ehrblatt & Kyle Hyndman & Erkut Y. ÄOzbay & Andrew Schotter, 2006. "Convergence: An Experimental Study," Levine's Working Paper Archive 122247000000001148, David K. Levine.
    12. Jacques Durieu & Philippe Solal, 2012. "Models of Adaptive Learning in Game Theory," Chapters, in: Richard Arena & Agnès Festré & Nathalie Lazaric (ed.), Handbook of Knowledge and Economics, chapter 11, Edward Elgar Publishing.
    13. Jehiel, Philippe & Singh, Juni, 2021. "Multi-state choices with aggregate feedback on unfamiliar alternatives," Games and Economic Behavior, Elsevier, vol. 130(C), pages 1-24.
    14. Duffy, John & Hopkins, Ed, 2005. "Learning, information, and sorting in market entry games: theory and evidence," Games and Economic Behavior, Elsevier, vol. 51(1), pages 31-62, April.
    15. Barrafrem, Kinga & Hausfeld, Jan, 2020. "Tracing risky decisions for oneself and others: The role of intuition and deliberation," Journal of Economic Psychology, Elsevier, vol. 77(C).
    16. Mengel, Friederike, 2012. "Learning across games," Games and Economic Behavior, Elsevier, vol. 74(2), pages 601-619.
    17. Cason, Timothy N. & Friedman, Daniel & Hopkins, Ed, 2010. "Testing the TASP: An experimental investigation of learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 145(6), pages 2309-2331, November.
    18. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
    19. Waltman, Ludo & Kaymak, Uzay, 2008. "Q-learning agents in a Cournot oligopoly model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(10), pages 3275-3293, October.
    20. Simon Weidenholzer, 2010. "Coordination Games and Local Interactions: A Survey of the Game Theoretic Literature," Games, MDPI, vol. 1(4), pages 1-35, November.

    More about this item

    Keywords

    Reinforcement; Myopic best reply; Response times; Decision processes;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:152:y:2018:i:c:p:224-234. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.