IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-00359318.html
   My bibliography  Save this paper

Dynamic stochastic dominance in bandit decision problems

Author

Listed:
  • Thierry Magnac

    (LEA - Laboratoire d'Economie Appliquée - INRA - Institut National de la Recherche Agronomique)

  • Jean-Marc Robin

    (LEA - Laboratoire d'Economie Appliquée - INRA - Institut National de la Recherche Agronomique, CREST - Centre de Recherche en Économie et Statistique - ENSAI - Ecole Nationale de la Statistique et de l'Analyse de l'Information [Bruz] - X - École polytechnique - IP Paris - Institut Polytechnique de Paris - ENSAE Paris - École Nationale de la Statistique et de l'Administration Économique - CNRS - Centre National de la Recherche Scientifique)

Abstract

The aim of this paper is to study the monotonicity properties with respect to the probability distribution of the state processes, of optimal decisions in bandit decision problems. Orderings of dynamic discrete projects are provided by extending the notion of stochastic dominance to stochastic processes.

Suggested Citation

  • Thierry Magnac & Jean-Marc Robin, 1999. "Dynamic stochastic dominance in bandit decision problems," Post-Print hal-00359318, HAL.
    • Handle: RePEc:hal:journl:hal-00359318
    DOI: 10.1023/A:1005142630173
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bikhchandani, Sushil & Segal, Uzi & Sharma, Sunil, 1992. "Stochastic dominance under Bayesian learning," Journal of Economic Theory, Elsevier, vol. 56(2), pages 352-377, April.
    2. Bikhchandani, Sushil & Sharma, Sunil, 1996. "Optimal search with learning," Journal of Economic Dynamics and Control, Elsevier, vol. 20(1-3), pages 333-359.
    3. Rothschild, Michael, 1974. "A two-armed bandit theory of market pricing," Journal of Economic Theory, Elsevier, vol. 9(2), pages 185-202, October.
    4. Fishman, Arthur, 1990. "Stochastic dominance in multi sampling environments," Journal of Economic Theory, Elsevier, vol. 51(1), pages 77-91, June.
    5. Miller, Robert A, 1984. "Job Matching and Occupational Choice," Journal of Political Economy, University of Chicago Press, vol. 92(6), pages 1086-1120, December.
    6. Flinn, Christopher J, 1986. "Wages and Job Mobility of Young Workers," Journal of Political Economy, University of Chicago Press, vol. 94(3), pages 88-110, June.
    7. Jovanovic, Boyan, 1979. "Job Matching and the Theory of Turnover," Journal of Political Economy, University of Chicago Press, vol. 87(5), pages 972-990, October.
    8. Milgrom, Paul R & Weber, Robert J, 1982. "A Theory of Auctions and Competitive Bidding," Econometrica, Econometric Society, vol. 50(5), pages 1089-1122, September.
    9. Rothschild, Michael & Stiglitz, Joseph E., 1970. "Increasing risk: I. A definition," Journal of Economic Theory, Elsevier, vol. 2(3), pages 225-243, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jean-Philippe Chancelier & Michel De Lara & André de Palma, 2007. "Risk Aversion, Road Choice, and the One-Armed Bandit Problem," Transportation Science, INFORMS, vol. 41(1), pages 1-14, February.
    2. Jean-Philippe Chancelier & Michel Lara & André Palma, 2009. "Risk aversion in expected intertemporal discounted utilities bandit problems," Theory and Decision, Springer, vol. 67(4), pages 433-440, October.
    3. Alfred Müller & Marco Scarsini, 2002. "Even Risk-Averters may Love Risk," Theory and Decision, Springer, vol. 52(1), pages 81-99, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hu, Yingyao & Kayaba, Yutaka & Shum, Matthew, 2013. "Nonparametric learning rules from bandit experiments: The eyes have it!," Games and Economic Behavior, Elsevier, vol. 81(C), pages 215-231.
    2. Fatih Guvenen & Burhan Kuruscu & Satoshi Tanaka & David Wiczer, 2020. "Multidimensional Skill Mismatch," American Economic Journal: Macroeconomics, American Economic Association, vol. 12(1), pages 210-244, January.
    3. Uta Schoenberg & Christina Gathmann, 2006. "How General is Specific Human Capital? Using Mobility Patterns to Study Skill Transferability in the Labor Market," 2006 Meeting Papers 598, Society for Economic Dynamics.
    4. Aspen Gorry, 2016. "Experience and worker flows," Quantitative Economics, Econometric Society, vol. 7(1), pages 225-255, March.
    5. Elena Pastorino, 2015. "Job Matching Within And Across Firms," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 647-671, May.
    6. Alessandro Lizzeri & Eran Shmaya & Leeat Yariv, 2024. "Disentangling Exploration from Exploitation," Papers 2404.19116, arXiv.org.
    7. Zsolt Csáfordi & László Lőrincz & Balázs Lengyel & Károly Miklós Kiss, 2020. "Productivity spillovers through labor flows: productivity gap, multinational experience and industry relatedness," The Journal of Technology Transfer, Springer, vol. 45(1), pages 86-121, February.
    8. Bergemann, Dirk & Valimaki, Juuso, 1996. "Learning and Strategic Pricing," Econometrica, Econometric Society, vol. 64(5), pages 1125-1149, September.
    9. Fahn, Matthias, 2011. "Three Essays on Commitment and Information Problems," Munich Dissertations in Economics 13750, University of Munich, Department of Economics.
    10. Cici, Gjergji & Hendriock, Mario & Kempf, Alexander, 2022. "Finding your calling: Matching skills with jobs in the mutual fund industry," CFR Working Papers 19-05, University of Cologne, Centre for Financial Research (CFR), revised 2022.
    11. Gathmann, Christina & Schönberg, Uta, 2006. "How General Is Specific Human Capital?," IZA Discussion Papers 2485, Institute of Labor Economics (IZA).
    12. Michele Cincera & Lydia Greunz & Jean-Luc Guyot & Olivier Lohest, 2006. "Capital humain et processus de création d'entreprise: le cas des primo-créateurs wallons," Brussels Economic Review, ULB -- Universite Libre de Bruxelles, vol. 49(2).
    13. Martin Peitz & Sven Rady & Piers Trepper, 2017. "Experimentation in Two-Sided Markets," Journal of the European Economic Association, European Economic Association, vol. 15(1), pages 128-172.
    14. Pedros Silos & Eric Smith, 2015. "Human Capital Portfolios," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 18(3), pages 635-652, July.
    15. Yamauchi, Futoshi, 2003. "Are experience and schooling complementary?," FCND briefs 166, International Food Policy Research Institute (IFPRI).
    16. Theodore Papageorgiou, 2022. "Occupational Matching and Cities," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(3), pages 82-132, July.
    17. Jaime Ortega, 2001. "Job Rotation as a Learning Mechanism," Management Science, INFORMS, vol. 47(10), pages 1361-1370, October.
    18. Jovanovic, Boyan & Moffitt, Robert, 1990. "An Estimate of a Sectoral Model of Labor Mobility," Journal of Political Economy, University of Chicago Press, vol. 98(4), pages 827-852, August.
    19. Pagano, Marco & Picariello, Luca, 2023. "Talent discovery, layoff risk and unemployment insurance," European Economic Review, Elsevier, vol. 154(C).
    20. Carlos Iglesias-Fernández & Raquel Llorente-Heras, 2007. "Sectoral Structure, Qualification Characteristics and Patterns of Labour Mobility," The Service Industries Journal, Taylor & Francis Journals, vol. 27(4), pages 411-434, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-00359318. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.