IDEAS home Printed from https://ideas.repec.org/a/eee/dyncon/v111y2020ics0165188918302689.html
   My bibliography  Save this article

Choosing a good toolkit, II: Bayes-rule based heuristics

Author

Listed:
  • Francetich, Alejandro
  • Kreps, David

Abstract

We study heuristics for a class of complex multi-armed bandit problems, the period-by-period choice of a set of objects or “toolkit” where the decision maker learns about the value of tools within the chosen toolkit. This paper studies heuristics that involve a decision maker who employs Bayesian inference. Analytical results are combined with simulations to gain insights into the relative performance of these heuristics. We depart from the extensive bandit-learning literature in computer science and operations research by employing the discounted-expected-reward formulation that stresses the importance of the classic exploration–exploitation tradeoff. A companion paper, Francetich and Kreps (2019), studies a variety of prior-free heuristics.

Suggested Citation

  • Francetich, Alejandro & Kreps, David, 2020. "Choosing a good toolkit, II: Bayes-rule based heuristics," Journal of Economic Dynamics and Control, Elsevier, vol. 111(C).
    • Handle: RePEc:eee:dyncon:v:111:y:2020:i:c:s0165188918302689
    DOI: 10.1016/j.jedc.2019.103814
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165188918302689
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jedc.2019.103814?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gigerenzer, Gerd & Todd, Peter M. & ABC Research Group,, 2000. "Simple Heuristics That Make Us Smart," OUP Catalogue, Oxford University Press, number 9780195143812.
    2. Kreps, David M. & Francetich, Alejandro, 2014. "Bayesian Inference Does Not Lead You Astray . . . On Average," Research Papers 3059, Stanford University, Graduate School of Business.
    3. Francetich, Alejandro & Kreps, David, 2014. "Bayesian inference does not lead you astray…on average," Economics Letters, Elsevier, vol. 125(3), pages 444-446.
    4. Denis Sauré & Assaf Zeevi, 2013. "Optimal Dynamic Assortment Planning with Demand Learning," Manufacturing & Service Operations Management, INFORMS, vol. 15(3), pages 387-404, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fudenberg, Drew & He, Kevin, 2021. "Player-compatible learning and player-compatible equilibrium," Journal of Economic Theory, Elsevier, vol. 194(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hart, Sergiu & Rinott, Yosef, 2020. "Posterior probabilities: Dominance and optimism," Economics Letters, Elsevier, vol. 194(C).
    2. Kreps, David M. & Francetich, Alejandro, 2014. "Choosing a Good Toolkit: An Essay in Behavioral Economics," Research Papers 3060, Stanford University, Graduate School of Business.
    3. Sergiu Hart & Yosef Rinott, 2022. "Posterior Probabilities: Nonmonotonicity, Asymptotic Rates, Log-Concavity, and Tur\'an's Inequality," Papers 2209.11728, arXiv.org.
    4. Stephen A. Hillegeist & James P. Kavourakis & Matthew Pinnuck, 2023. "The association between quarter length, forecast errors, and firms’ voluntary disclosures," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(2), pages 1885-1918, June.
    5. Andrea Polonioli, 2013. "Re-assessing the Heuristics debate," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 12(2), pages 263-271, November.
    6. Magni, Carlo Alberto, 2007. "Investment decisions, equivalent risk and bounded rationality," MPRA Paper 6073, University Library of Munich, Germany.
    7. Francetich, Alejandro & Kreps, David, 2020. "Choosing a good toolkit, I: Prior-free heuristics," Journal of Economic Dynamics and Control, Elsevier, vol. 111(C).
    8. Mou, Shandong & Robb, David J. & DeHoratius, Nicole, 2018. "Retail store operations: Literature review and research directions," European Journal of Operational Research, Elsevier, vol. 265(2), pages 399-422.
    9. Joanna Bryson, 2008. "Embodiment versus memetics," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 7(1), pages 77-94, June.
    10. Maroussia Favre & Didier Sornette, 2015. "A Generic Model of Dyadic Social Relationships," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-16, March.
    11. Robin Hogarth & Natalia Karelaia, 2003. "Take-the-best and other simple strategies: Why and when they work 'well' in binary choice," Economics Working Papers 709, Department of Economics and Business, Universitat Pompeu Fabra.
    12. Marc Jekel & Susann Fiedler & Andreas Glockner, 2011. "Diagnostic task selection for strategy classification in judgment and decision making," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 6(8), pages 782-799, December.
    13. Karla Hoff, 2016. "Behavioral Economics and Social Exclusion: Can Interventions Overcome Prejudice?," International Economic Association Series, in: Kaushik Basu & Joseph E. Stiglitz (ed.), Inequality and Growth: Patterns and Policy, chapter 6, pages 172-200, Palgrave Macmillan.
    14. Christopher B. Bingham & Kathleen M. Eisenhardt, 2014. "Response to Vuori and Vuori's commentary on “Heuristics in the strategy context”," Strategic Management Journal, Wiley Blackwell, vol. 35(11), pages 1698-1702, November.
    15. Agrawal, Priyank & Tulabandhula, Theja & Avadhanula, Vashist, 2023. "A tractable online learning algorithm for the multinomial logit contextual bandit," European Journal of Operational Research, Elsevier, vol. 310(2), pages 737-750.
    16. Hüsler, A. & Sornette, D. & Hommes, C.H., 2013. "Super-exponential bubbles in lab experiments: Evidence for anchoring over-optimistic expectations on price," Journal of Economic Behavior & Organization, Elsevier, vol. 92(C), pages 304-316.
    17. Gel, Esma S. & Salman, F. Sibel, 2022. "Dynamic ordering decisions with approximate learning of supply yield uncertainty," International Journal of Production Economics, Elsevier, vol. 243(C).
    18. Roberto Casarin & Flaminio Squazzoni, 2012. "Financial press and stock markets in times of crisis," Working Papers 2012_04, Department of Economics, University of Venice "Ca' Foscari".
    19. Dipankar Das, 2023. "A Model of Competitive Assortment Planning Algorithm," Papers 2307.09479, arXiv.org.
    20. Brundin, Ethel & Gustavsson, Veronica, 2008. "Escalation of Commitment in Investment Decisions: The Role of Emotions under Uncertainty," CISEG Working Papers Series 3, Jönköping International Business School, Centre for Innovation Systems, Entrepreneurship and Growth.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:dyncon:v:111:y:2020:i:c:s0165188918302689. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jedc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.