IDEAS home Printed from https://ideas.repec.org/p/mtl/montde/2018-09.html
   My bibliography  Save this paper

Bandits in the Lab

Author

Listed:
  • HOELZEMANN, Johannes
  • KLEIN, Nicolas

Abstract

We test Keller, Rady, Cripps’ (2005) game of strategic experimentation with exponential bandits in the laboratory. We find strong support for the prediction of free-riding because of strategic concerns. We also find strong evidence for behavior that is characteristic of Markov perfect equilibrium: non-cutoff behavior, lonely pioneers and frequent switches of action.

Suggested Citation

  • HOELZEMANN, Johannes & KLEIN, Nicolas, 2018. "Bandits in the Lab," Cahiers de recherche 2018-09, Universite de Montreal, Departement de sciences economiques.
    • Handle: RePEc:mtl:montde:2018-09
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/1866/20921
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Nicolas Klein & Sven Rady, 2011. "Negatively Correlated Bandits," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(2), pages 693-732.
    2. Andreoni, James, 1988. "Why free ride? : Strategies and learning in public goods experiments," Journal of Public Economics, Elsevier, vol. 37(3), pages 291-304, December.
    3. Evan Calford & Ryan Oprea, 2017. "Continuity, Inertia, and Strategic Uncertainty: A Test of the Theory of Continuous Time Games," Econometrica, Econometric Society, vol. 85, pages 915-935, May.
    4. Jennifer Zelmer, 2003. "Linear Public Goods Experiments: A Meta-Analysis," Experimental Economics, Springer;Economic Science Association, vol. 6(3), pages 299-310, November.
    5. Kaustav Das & Nicolas Klein, 2020. "Do Stronger Patents Lead to Faster Innovation? The Effect of Duplicative Search," Discussion Papers in Economics 20/03, Division of Economics, School of Business, University of Leicester.
    6. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2007. "Social Learning in One-Arm Bandit Problems," Econometrica, Econometric Society, vol. 75(6), pages 1591-1611, November.
    7. Oprea, Ryan & Charness, Gary & Friedman, Daniel, 2014. "Continuous time and communication in a public-goods experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 212-223.
    8. Emanuel Vespa & Alistair J. Wilson, 2019. "Experimenting with the transition rule in dynamic games," Quantitative Economics, Econometric Society, vol. 10(4), pages 1825-1849, November.
    9. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    10. Jeffrey Banks & David Porter & Mark Olson, 1997. "An experimental analysis of the bandit problem," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 10(1), pages 55-77.
    11. Marco Battaglini & Salvatore Nunnari & Thomas R. Palfrey, 2016. "The Dynamic Free Rider Problem: A Laboratory Study," American Economic Journal: Microeconomics, American Economic Association, vol. 8(4), pages 268-308, November.
    12. Godfrey Keller & Sven Rady & Martin Cripps, 2005. "Strategic Experimentation with Exponential Bandits," Econometrica, Econometric Society, vol. 73(1), pages 39-68, January.
    13. Christopher Anderson, 2012. "Ambiguity aversion in multi-armed bandit problems," Theory and Decision, Springer, vol. 72(1), pages 15-33, January.
    14. Sven Rady & Nicolas Klein & Johannes Horner, 2013. "Strongly Symmetric Equilibria in Bandit Games," 2013 Meeting Papers 1107, Society for Economic Dynamics.
    15. Alistair J. Wilson & Emanuel Vespa, 2020. "Information Transmission under the Shadow of the Future: An Experiment," American Economic Journal: Microeconomics, American Economic Association, vol. 12(4), pages 75-98, November.
    16. Bergemann, Dirk & Valimaki, Juuso, 1996. "Learning and Strategic Pricing," Econometrica, Econometric Society, vol. 64(5), pages 1125-1149, September.
    17. Oliver Kim & Mark Walker, 1984. "The free rider problem: Experimental evidence," Public Choice, Springer, vol. 43(1), pages 3-24, January.
    18. Dirk Bergemann & Juuso Välimäki, 2000. "Experimentation in Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(2), pages 213-234.
    19. Rothschild, Michael, 1974. "A two-armed bandit theory of market pricing," Journal of Economic Theory, Elsevier, vol. 9(2), pages 185-202, October.
    20. Timothy Cason & Sau-Him Lau & Vai-Lam Mui, 2013. "Learning, teaching, and turn taking in the repeated assignment game," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 54(2), pages 335-357, October.
    21. , & ,, 2010. "Strategic experimentation with Poisson bandits," Theoretical Economics, Econometric Society, vol. 5(2), May.
    22. Drew Fudenberg & Emanuel Vespa, 2019. "Learning Theory and Heterogeneous Play in a Signaling-Game Experiment," American Economic Journal: Microeconomics, American Economic Association, vol. 11(4), pages 186-215, November.
    23. Mark Isaac, R. & McCue, Kenneth F. & Plott, Charles R., 1985. "Public goods provision in an experimental environment," Journal of Public Economics, Elsevier, vol. 26(1), pages 51-74, February.
    24. Noah Gans & George Knox & Rachel Croson, 2007. "Simple Models of Discrete Choice and Their Performance in Bandit Experiments," Manufacturing & Service Operations Management, INFORMS, vol. 9(4), pages 383-408, December.
    25. Griliches, Zvi, 1988. "Productivity Puzzles and R&D: Another Nonexplanation," Journal of Economic Perspectives, American Economic Association, vol. 2(4), pages 9-21, Fall.
    26. Romer, Paul M, 1990. "Endogenous Technological Change," Journal of Political Economy, University of Chicago Press, vol. 98(5), pages 71-102, October.
    27. Attila Ambrus & Ben Greiner, 2012. "Imperfect Public Monitoring with Costly Punishment: An Experimental Study," American Economic Review, American Economic Association, vol. 102(7), pages 3317-3332, December.
    28. Gene M. Grossman & Elhanan Helpman, 1993. "Innovation and Growth in the Global Economy," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262570971, April.
    29. Bruno Strulovici, 2010. "Learning While Voting: Determinants of Collective Experimentation," Econometrica, Econometric Society, vol. 78(3), pages 933-971, May.
    30. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    31. Simon Gachter & Ernst Fehr, 2000. "Cooperation and Punishment in Public Goods Experiments," American Economic Review, American Economic Association, vol. 90(4), pages 980-994, September.
    32. David Besanko & Jianjun Wu, 2013. "The Impact of Market Structure and Learning on the Tradeoff between R&D Competition and Cooperation," Journal of Industrial Economics, Wiley Blackwell, vol. 61(1), pages 166-201, March.
    33. Marco Battaglini & Salvatore Nunnari & Thomas R. Palfrey, 2014. "Dynamic Free Riding with Irreversible Investments," American Economic Review, American Economic Association, vol. 104(9), pages 2858-2871, September.
    34. R. Isaac & James Walker & Susan Thomas, 1984. "Divergent evidence on free riding: An experimental examination of possible explanations," Public Choice, Springer, vol. 43(2), pages 113-149, January.
    35. Ananish Chaudhuri, 2011. "Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 47-83, March.
    36. Robert J. Meyer & Yong Shi, 1995. "Sequential Choice Under Ambiguity: Intuitive Solutions to the Armed-Bandit Problem," Management Science, INFORMS, vol. 41(5), pages 817-834, May.
    37. Marwell, Gerald & Ames, Ruth E., 1981. "Economists free ride, does anyone else? : Experiments on the provision of public goods, IV," Journal of Public Economics, Elsevier, vol. 15(3), pages 295-310, June.
    38. Ufuk Akcigit & Qingmin Liu, 2016. "The Role Of Information In Innovation And Competition," Journal of the European Economic Association, European Economic Association, vol. 14(4), pages 828-870, August.
    39. Pauli Murto & Juuso Välimäki, 2011. "Learning and Information Aggregation in an Exit Game," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(4), pages 1426-1461.
    40. Guidon Fenig & Giovanni Gallipoli & Yoram Halevy, 2018. "Piercing the "Payoff Function" Veil: Tracing Beliefs and Motives," Working Papers tecipa-625, University of Toronto, Department of Economics.
    41. Klein, Nicolas, 2013. "Strategic learning in teams," Games and Economic Behavior, Elsevier, vol. 82(C), pages 636-657.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kaustav Das & Nicolas Klein & Katharina Schmid, 2020. "Strategic experimentation with asymmetric players," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 69(4), pages 1147-1175, June.
    2. Jean Paul Rabanal & Aleksei Chernulich & John Horowitz & Olga A. Rud & Manizha Sharifova, 2019. "Market timing under public and private information," Working Papers 151, Peruvian Economic Association.
    3. Lepage, Louis Pierre, 2021. "Endogenous learning, persistent employer biases, and discrimination," CLEF Working Paper Series 34, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    4. Hudja, Stanton, 2021. "Is Experimentation Invariant to Group Size? A Laboratory Analysis of Innovation Contests," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 91(C).
    5. Chernulich, Aleksei & Horowitz, John & Rabanal, Jean Paul & Rud, Olga A & Sharifova , Manizha, 2021. "Entry and exit decisions under public and private information: An experiment," UiS Working Papers in Economics and Finance 2021/3, University of Stavanger.
    6. Lepage, Louis Pierre, 2020. "Endogenous learning and the persistence of employer biases in the labor market," CLEF Working Paper Series 24, Canadian Labour Economics Forum (CLEF), University of Waterloo.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heidhues, Paul & Rady, Sven & Strack, Philipp, 2015. "Strategic experimentation with private payoffs," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 531-551.
    2. Kaustav Das & Nicolas Klein & Katharina Schmid, 2020. "Strategic experimentation with asymmetric players," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 69(4), pages 1147-1175, June.
    3. Haruvy, Ernan & Li, Sherry Xin & McCabe, Kevin & Twieg, Peter, 2017. "Communication and visibility in public goods provision," Games and Economic Behavior, Elsevier, vol. 105(C), pages 276-296.
    4. Nicolas Klein & Tymofiy Mylovanov, 2011. "Should the Flatterers be Avoided?," 2011 Meeting Papers 1273, Society for Economic Dynamics.
    5. Klein, Nicolas, 2013. "Strategic learning in teams," Games and Economic Behavior, Elsevier, vol. 82(C), pages 636-657.
    6. De Geest, Lawrence R. & Kingsley, David C., 2021. "Norm enforcement with incomplete information," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 403-430.
    7. Chaudhuri, Ananish & Maitra, Pushkar & Graziano, Sara, 2003. "A Dynamic Analysis of the Evolution of Conventions in a Public Goods Experiment with Intergenerational Advice," Working Papers 152, Department of Economics, The University of Auckland.
    8. He, Simin & Zhu, Xun, 2023. "Real-time monitoring in a public-goods game," Games and Economic Behavior, Elsevier, vol. 142(C), pages 454-479.
    9. Jasmina Arifovic & John Ledyard, 2012. "Individual Evolutionary Learning, Other-regarding Preferences, and the Voluntary Contributions Mechanism," Discussion Papers wp12-01, Department of Economics, Simon Fraser University.
    10. Arifovic, Jasmina & Ledyard, John, 2012. "Individual evolutionary learning, other-regarding preferences, and the voluntary contributions mechanism," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 808-823.
    11. Stanton Hudja & Daniel Woods, 2024. "Exploration versus exploitation: A laboratory test of the single‐agent exponential bandit model," Economic Inquiry, Western Economic Association International, vol. 62(1), pages 267-286, January.
    12. Kölle, Felix, 2015. "Heterogeneity and cooperation: The role of capability and valuation on public goods provision," Journal of Economic Behavior & Organization, Elsevier, vol. 109(C), pages 120-134.
    13. Mira Frick & Yuhta Ishii, 2015. "Innovation Adoption by Forward-Looking Social Learners," Cowles Foundation Discussion Papers 1877, Cowles Foundation for Research in Economics, Yale University.
    14. Felix Koelle, 2012. "Heterogeneity and Cooperation in Privileged Groups: The Role of Capability and Valuation on Public Goods Provision," Cologne Graduate School Working Paper Series 03-08, Cologne Graduate School in Management, Economics and Social Sciences.
    15. Boyarchenko, Svetlana, 2021. "Inefficiency of sponsored research," Journal of Mathematical Economics, Elsevier, vol. 95(C).
    16. Vincent Théroude & Adam Zylbersztejn, 2017. "Cooperation in a risky world," Working Papers halshs-01443917, HAL.
    17. Kenju Kamei & Louis Putterman & Jean-Robert Tyran, 2015. "State or nature? Endogenous formal versus informal sanctions in the voluntary provision of public goods," Experimental Economics, Springer;Economic Science Association, vol. 18(1), pages 38-65, March.
    18. Chen, Chia-Hui & Ishida, Junichiro, 2018. "Hierarchical experimentation," Journal of Economic Theory, Elsevier, vol. 177(C), pages 365-404.
    19. Vincent Théroude & Adam Zylbersztejn, 2017. "Cooperation in a risky world," Working Papers 1704, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    20. Svetlana Boyarchenko, 2020. "Super- and submodularity of stopping games with random observations," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(4), pages 983-1022, November.

    More about this item

    Keywords

    Strategic experimentation; exponential bandits; learning; dynamic games; Markov perfect equilibrium; continuous time; laboratory experiments; eye tracking;
    All these keywords.

    JEL classification:

    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mtl:montde:2018-09. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sharon BREWER (email available below). General contact details of provider: https://edirc.repec.org/data/demtlca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.