IDEAS home Printed from https://ideas.repec.org/a/eee/dyncon/v111y2020ics0165188918302690.html
   My bibliography  Save this article

Choosing a good toolkit, I: Prior-free heuristics

Author

Listed:
  • Francetich, Alejandro
  • Kreps, David

Abstract

The dynamic problem of choosing subsets of objects or “toolkits” when their value distribution is unknown is a multi-armed bandit problem with non-independent arms. Accordingly, except for very simple specifications, this problem cannot (practically) be solved, either analytically or numerically. Decision makers facing this problem must resort to decision heuristics, employing past experience and, perhaps, what they know about the problem. This paper focuses on prior-free heuristics, the simpler and more naive end of the spectrum of heuristics where the decision maker is guided entirely by past experience. Prior-free heuristics can take a variety of forms, depending on the decision maker’s unit of analysis: tools or toolkits. We examine and compare different prior-free heuristics using both analytical methods and simulations. In a companion paper, Francetich and Kreps (2019), we examine heuristics in which the decision maker engages in Bayesian updating of her prior beliefs about the environment.

Suggested Citation

  • Francetich, Alejandro & Kreps, David, 2020. "Choosing a good toolkit, I: Prior-free heuristics," Journal of Economic Dynamics and Control, Elsevier, vol. 111(C).
    • Handle: RePEc:eee:dyncon:v:111:y:2020:i:c:s0165188918302690
    DOI: 10.1016/j.jedc.2019.103813
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165188918302690
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jedc.2019.103813?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Milgrom, Paul & Roberts, John, 1991. "Adaptive and sophisticated learning in normal form games," Games and Economic Behavior, Elsevier, vol. 3(1), pages 82-100, February.
    2. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    3. Rustichini, Aldo, 1999. "Optimal Properties of Stimulus--Response Learning Models," Games and Economic Behavior, Elsevier, vol. 29(1-2), pages 244-273, October.
    4. Easley, David & Rustichini, Aldo, 2005. "Optimal guessing: Choice in complex environments," Journal of Economic Theory, Elsevier, vol. 124(1), pages 1-21, September.
    5. Gigerenzer, Gerd & Todd, Peter M. & ABC Research Group,, 2000. "Simple Heuristics That Make Us Smart," OUP Catalogue, Oxford University Press, number 9780195143812.
    6. Harald Uhlig & Martin Lettau, 1999. "Rules of Thumb versus Dynamic Programming," American Economic Review, American Economic Association, vol. 89(1), pages 148-174, March.
    7. Franklin M. Fisher, 1989. "Games Economists Play: A Noncooperative View," RAND Journal of Economics, The RAND Corporation, vol. 20(1), pages 113-124, Spring.
    8. Simon, Herbert A, 1979. "Rational Decision Making in Business Organizations," American Economic Review, American Economic Association, vol. 69(4), pages 493-513, September.
    9. David Easley & Aldo Rustichini, 1999. "Choice without Beliefs," Econometrica, Econometric Society, vol. 67(5), pages 1157-1184, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fudenberg, Drew & He, Kevin, 2021. "Player-compatible learning and player-compatible equilibrium," Journal of Economic Theory, Elsevier, vol. 194(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arthur Charpentier & Romuald Élie & Carl Remlinger, 2023. "Reinforcement Learning in Economics and Finance," Computational Economics, Springer;Society for Computational Economics, vol. 62(1), pages 425-462, June.
    2. Oyarzun, Carlos & Sarin, Rajiv, 2013. "Learning and risk aversion," Journal of Economic Theory, Elsevier, vol. 148(1), pages 196-225.
    3. Tilman Börgers & Antonio J. Morales & Rajiv Sarin, 2004. "Expedient and Monotone Learning Rules," Econometrica, Econometric Society, vol. 72(2), pages 383-405, March.
    4. Dana Heller, 2000. "Parametric Adaptive Learning," Econometric Society World Congress 2000 Contributed Papers 1496, Econometric Society.
    5. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    6. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
    7. Arifovic, Jasmina & Karaivanov, Alexander, 2010. "Learning by doing vs. learning from others in a principal-agent model," Journal of Economic Dynamics and Control, Elsevier, vol. 34(10), pages 1967-1992, October.
    8. Funai, Naoki, 2022. "Reinforcement learning with foregone payoff information in normal form games," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 638-660.
    9. Beggs, A.W., 2005. "On the convergence of reinforcement learning," Journal of Economic Theory, Elsevier, vol. 122(1), pages 1-36, May.
    10. Hopkins, Ed, 2007. "Adaptive learning models of consumer behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 64(3-4), pages 348-368.
    11. Naoki Funai, 2019. "Convergence results on stochastic adaptive learning," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 68(4), pages 907-934, November.
    12. Salle, Isabelle & Seppecher, Pascal, 2016. "Social Learning About Consumption," Macroeconomic Dynamics, Cambridge University Press, vol. 20(7), pages 1795-1825, October.
    13. Alanyali, Murat, 2010. "A note on adjusted replicator dynamics in iterated games," Journal of Mathematical Economics, Elsevier, vol. 46(1), pages 86-98, January.
    14. Bernergård, Axel & Mohlin, Erik, 2019. "Evolutionary selection against iteratively weakly dominated strategies," Games and Economic Behavior, Elsevier, vol. 117(C), pages 82-97.
    15. Iriberri, Nagore & García-Pola, Bernardo, 2019. "Naivete and Sophistication in Initial and Repeated Play in Games," CEPR Discussion Papers 14088, C.E.P.R. Discussion Papers.
    16. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    17. Flores-Szwagrzak, Karol, 2022. "Learning by Convex Combination," Working Papers 16-2022, Copenhagen Business School, Department of Economics.
    18. Agastya, Murali & Slinko, Arkadii, 2015. "Dynamic choice in a complex world," Journal of Economic Theory, Elsevier, vol. 158(PA), pages 232-258.
    19. Mengel, Friederike & Orlandi, Ludovica & Weidenholzer, Simon, 2022. "Match length realization and cooperation in indefinitely repeated games," Journal of Economic Theory, Elsevier, vol. 200(C).
    20. Hopkins, Ed & Posch, Martin, 2005. "Attainability of boundary points under reinforcement learning," Games and Economic Behavior, Elsevier, vol. 53(1), pages 110-125, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:dyncon:v:111:y:2020:i:c:s0165188918302690. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jedc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.