IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v80y2010i5-6p381-385.html
   My bibliography  Save this article

On the optimal amount of experimentation in sequential decision problems

Author

Listed:
  • Rosenberg, Dinah
  • Solan, Eilon
  • Vieille, Nicolas

Abstract

We provide a tight bound on the amount of experimentation under the optimal strategy in sequential decision problems. We show the applicability of the result by providing a bound on the cut-off in a one-arm bandit problem.

Suggested Citation

  • Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2010. "On the optimal amount of experimentation in sequential decision problems," Statistics & Probability Letters, Elsevier, vol. 80(5-6), pages 381-385, March.
    • Handle: RePEc:eee:stapro:v:80:y:2010:i:5-6:p:381-385
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-7152(09)00438-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Dirk Bergemann & Juuso Välimäki, 2000. "Experimentation in Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(2), pages 213-234.
    2. Godfrey Keller & Sven Rady & Martin Cripps, 2005. "Strategic Experimentation with Exponential Bandits," Econometrica, Econometric Society, vol. 73(1), pages 39-68, January.
    3. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2007. "Social Learning in One-Arm Bandit Problems," Econometrica, Econometric Society, vol. 75(6), pages 1591-1611, November.
    4. Avinash K. Dixit & Robert S. Pindyck, 1994. "Investment under Uncertainty," Economics Books, Princeton University Press, edition 1, number 5474.
    5. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.
    6. Monica Brezzi & Tze Leung Lai, 2000. "Incomplete Learning from Endogenous Data in Dynamic Allocation," Econometrica, Econometric Society, vol. 68(6), pages 1511-1516, November.
    7. Patrick Bolton & Christopher Harris, 1999. "Strategic Experimentation," Econometrica, Econometric Society, vol. 67(2), pages 349-374, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Camargo, Braz, 2014. "Learning in society," Games and Economic Behavior, Elsevier, vol. 87(C), pages 381-396.
    2. Doruk Cetemen & Can Urgun & Leeat Yariv, 2023. "Collective Progress: Dynamics of Exit Waves," Journal of Political Economy, University of Chicago Press, vol. 131(9), pages 2402-2450.
    3. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2007. "Social Learning in One-Arm Bandit Problems," Econometrica, Econometric Society, vol. 75(6), pages 1591-1611, November.
    4. Amador, Manuel & Weill, Pierre-Olivier, 2012. "Learning from private and public observations of othersʼ actions," Journal of Economic Theory, Elsevier, vol. 147(3), pages 910-940.
    5. Nicolas Klein & Sven Rady, 2011. "Negatively Correlated Bandits," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(2), pages 693-732.
    6. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2004. "Timing Games with Informational Externalities," Levine's Working Paper Archive 122247000000000704, David K. Levine.
    7. Bonatti, Alessandro & Hörner, Johannes, 2017. "Learning to disagree in a game of experimentation," Journal of Economic Theory, Elsevier, vol. 169(C), pages 234-269.
    8. Wuggenig, Mirjam, 2015. "Learning faster or more precisely? Strategic experimentation in networks," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 113196, Verein für Socialpolitik / German Economic Association.
    9. Sergey Kovbasyuk & Giancarlo Spagnolo, 2024. "Memory and Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(3), pages 1775-1806.
    10. Heidhues, Paul & Rady, Sven & Strack, Philipp, 2015. "Strategic experimentation with private payoffs," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 531-551.
    11. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.
    12. Johannes Hoelzemann & Nicolas Klein, 2021. "Bandits in the lab," Quantitative Economics, Econometric Society, vol. 12(3), pages 1021-1051, July.
    13. Kohei Kawaguchi, 2021. "When Will Workers Follow an Algorithm? A Field Experiment with a Retail Business," Management Science, INFORMS, vol. 67(3), pages 1670-1695, March.
    14. Décamps, Jean-Paul & Mariotti, Thomas & Villeneuve, Stéphane, 2000. "Investment Timing under Incomplete Information," IDEI Working Papers 115, Institut d'Économie Industrielle (IDEI), Toulouse, revised Apr 2004.
    15. Rauch, James E. & Watson, Joel, 2003. "Starting small in an unfamiliar environment," International Journal of Industrial Organization, Elsevier, vol. 21(7), pages 1021-1042, September.
    16. Boyarchenko, Svetlana, 2021. "Inefficiency of sponsored research," Journal of Mathematical Economics, Elsevier, vol. 95(C).
    17. Ahlvik, Lassi & Iho, Antti, 2018. "Optimal geoengineering experiments," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 148-168.
    18. Wagner, Peter A. & Klein, Nicolas, 2022. "Strategic investment and learning with private information," Journal of Economic Theory, Elsevier, vol. 204(C).
    19. Simina Br^anzei & Yuval Peres, 2019. "Multiplayer Bandit Learning, from Competition to Cooperation," Papers 1908.01135, arXiv.org, revised Jan 2024.
    20. Chen, Chia-Hui & Ishida, Junichiro, 2018. "Hierarchical experimentation," Journal of Economic Theory, Elsevier, vol. 177(C), pages 365-404.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:80:y:2010:i:5-6:p:381-385. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.