IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-00528414.html
   My bibliography  Save this paper

On the optimal amount of experimentation in sequential decision problems

Author

Listed:
  • Nicolas Vieille

    (GREGH - Groupement de Recherche et d'Etudes en Gestion à HEC - HEC Paris - Ecole des Hautes Etudes Commerciales - CNRS - Centre National de la Recherche Scientifique)

  • Dinah Rosenberg

    (GREGH - Groupement de Recherche et d'Etudes en Gestion à HEC - HEC Paris - Ecole des Hautes Etudes Commerciales - CNRS - Centre National de la Recherche Scientifique)

  • Eilon Solan

    (TAU - School of Mathematical Sciences [Tel Aviv] - TAU - Raymond and Beverly Sackler Faculty of Exact Sciences [Tel Aviv] - TAU - Tel Aviv University)

Abstract

We provide a tight bound on the amount of experimentation under the optimal strategy in sequential decision problems. We show the applicability of the result by providing a bound on the cut-off in a one-arm bandit problem.

Suggested Citation

  • Nicolas Vieille & Dinah Rosenberg & Eilon Solan, 2010. "On the optimal amount of experimentation in sequential decision problems," Post-Print hal-00528414, HAL.
    • Handle: RePEc:hal:journl:hal-00528414
    DOI: 10.1016/j.spl.2009.11.014
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2007. "Social Learning in One-Arm Bandit Problems," Econometrica, Econometric Society, vol. 75(6), pages 1591-1611, November.
    2. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.
    3. Godfrey Keller & Sven Rady & Martin Cripps, 2005. "Strategic Experimentation with Exponential Bandits," Econometrica, Econometric Society, vol. 73(1), pages 39-68, January.
    4. Patrick Bolton & Christopher Harris, 1999. "Strategic Experimentation," Econometrica, Econometric Society, vol. 67(2), pages 349-374, March.
    5. Dirk Bergemann & Juuso Välimäki, 2000. "Experimentation in Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(2), pages 213-234.
    6. Avinash K. Dixit & Robert S. Pindyck, 1994. "Investment under Uncertainty," Economics Books, Princeton University Press, edition 1, number 5474.
    7. Monica Brezzi & Tze Leung Lai, 2000. "Incomplete Learning from Endogenous Data in Dynamic Allocation," Econometrica, Econometric Society, vol. 68(6), pages 1511-1516, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Camargo, Braz, 2014. "Learning in society," Games and Economic Behavior, Elsevier, vol. 87(C), pages 381-396.
    2. Doruk Cetemen & Can Urgun & Leeat Yariv, 2023. "Collective Progress: Dynamics of Exit Waves," Journal of Political Economy, University of Chicago Press, vol. 131(9), pages 2402-2450.
    3. Amador, Manuel & Weill, Pierre-Olivier, 2012. "Learning from private and public observations of othersʼ actions," Journal of Economic Theory, Elsevier, vol. 147(3), pages 910-940.
    4. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2007. "Social Learning in One-Arm Bandit Problems," Econometrica, Econometric Society, vol. 75(6), pages 1591-1611, November.
    5. Nicolas Klein & Sven Rady, 2011. "Negatively Correlated Bandits," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(2), pages 693-732.
    6. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2004. "Timing Games with Informational Externalities," Levine's Working Paper Archive 122247000000000704, David K. Levine.
    7. Bonatti, Alessandro & Hörner, Johannes, 2017. "Learning to disagree in a game of experimentation," Journal of Economic Theory, Elsevier, vol. 169(C), pages 234-269.
    8. Kohei Kawaguchi, 2021. "When Will Workers Follow an Algorithm? A Field Experiment with a Retail Business," Management Science, INFORMS, vol. 67(3), pages 1670-1695, March.
    9. Décamps, Jean-Paul & Mariotti, Thomas & Villeneuve, Stéphane, 2000. "Investment Timing under Incomplete Information," IDEI Working Papers 115, Institut d'Économie Industrielle (IDEI), Toulouse, revised Apr 2004.
    10. Heidhues, Paul & Rady, Sven & Strack, Philipp, 2015. "Strategic experimentation with private payoffs," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 531-551.
    11. Ahlvik, Lassi & Iho, Antti, 2018. "Optimal geoengineering experiments," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 148-168.
    12. Dirk Bergemann & Juuso Välimäki, 2000. "Experimentation in Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(2), pages 213-234.
    13. Rosenberg, Dinah & Salomon, Antoine & Vieille, Nicolas, 2013. "On games of strategic experimentation," Games and Economic Behavior, Elsevier, vol. 82(C), pages 31-51.
    14. Rauch, James E. & Watson, Joel, 2003. "Starting small in an unfamiliar environment," International Journal of Industrial Organization, Elsevier, vol. 21(7), pages 1021-1042, September.
    15. Boyarchenko, Svetlana & Levendorskiĭ, Sergei, 2014. "Preemption games under Lévy uncertainty," Games and Economic Behavior, Elsevier, vol. 88(C), pages 354-380.
    16. Kaustav Das & Nicolas Klein & Katharina Schmid, 2020. "Strategic experimentation with asymmetric players," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 69(4), pages 1147-1175, June.
    17. Osnat Zohar, 2019. "Boom-Bust Cycles of Learning, Investment and Disagreement," Bank of Israel Working Papers 2019.06, Bank of Israel.
    18. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.
    19. Klein, Nicolas, 2013. "Strategic learning in teams," Games and Economic Behavior, Elsevier, vol. 82(C), pages 636-657.
    20. Wagner, Peter A., 2018. "Who goes first? Strategic delay under information asymmetry," Theoretical Economics, Econometric Society, vol. 13(1), January.

    More about this item

    Keywords

    sequential decision problem;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-00528414. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.