IDEAS home Printed from https://ideas.repec.org/h/eee/gamchp/3-48.html
   My bibliography  Save this book chapter

Stochastic games: Recent results

In: Handbook of Game Theory with Economic Applications

Author

Listed:
  • Vieille, Nicolas

Abstract

This chapter presents developments in the theory of stochastic games that have taken place in recent years. It complements the contribution by Mertens. Major emphasis is put on stochastic games with finite state and action sets. In the zero-sum case, a classical result of Mertens and Neyman states that given [epsilon] > 0, each player has a strategy that is [epsilon]-optimal for all discount factors close to zero. Extensions to non-zero-sum games are dealt with here. In particular, the proof of existence of uniform equilibrium payoffs for two-player games is discussed, as well as the results available for more-than-two-player games. Important open problems related to N-player games are introduced by means of a class of simple stochastic games, called quitting, or stopping, games. Finally, recent results on zero-sum games with imperfect monitoring and on zero-sum games with incomplete information are surveyed.

Suggested Citation

  • Vieille, Nicolas, 2002. "Stochastic games: Recent results," Handbook of Game Theory with Economic Applications, in: R.J. Aumann & S. Hart (ed.), Handbook of Game Theory with Economic Applications, edition 1, volume 3, chapter 48, pages 1833-1850, Elsevier.
    • Handle: RePEc:eee:gamchp:3-48
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/B7P5P-4FD79WM-C/2/652c29256e143fb1599845172ff8a614
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Robert J. Aumann, 1995. "Repeated Games with Incomplete Information," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262011476, April.
    2. R.J. Aumann & S. Hart (ed.), 2002. "Handbook of Game Theory with Economic Applications," Handbook of Game Theory with Economic Applications, Elsevier, edition 1, volume 3, number 3.
    3. Frank Thuijsman & Thirukkannamangai E. S. Raghavan, 1997. "Perfect Information Stochastic Games and Related Classes," International Journal of Game Theory, Springer;Game Theory Society, vol. 26(3), pages 403-408.
    4. SORIN, Sylvain, 1984. "'Big match' with lack of information on one side (part 1)," LIDAM Reprints CORE 601, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    5. Sorin, Sylvain, 1992. "Repeated games with complete information," Handbook of Game Theory with Economic Applications, in: R.J. Aumann & S. Hart (ed.), Handbook of Game Theory with Economic Applications, edition 1, volume 1, chapter 4, pages 71-107, Elsevier.
    6. Solan, Eilon & Vieille, Nicolas, 2002. "Correlated Equilibrium in Stochastic Games," Games and Economic Behavior, Elsevier, vol. 38(2), pages 362-399, February.
    7. Aumann, Robert J. & Heifetz, Aviad, 2002. "Incomplete information," Handbook of Game Theory with Economic Applications, in: R.J. Aumann & S. Hart (ed.), Handbook of Game Theory with Economic Applications, edition 1, volume 3, chapter 43, pages 1665-1686, Elsevier.
    8. Mertens, Jean-Francois, 2002. "Stochastic games," Handbook of Game Theory with Economic Applications, in: R.J. Aumann & S. Hart (ed.), Handbook of Game Theory with Economic Applications, edition 1, volume 3, chapter 47, pages 1809-1832, Elsevier.
    9. Eilon Solan & Nicolas Vieille, 1998. "Quitting Games," Discussion Papers 1227, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    10. repec:dau:papers:123456789/6231 is not listed on IDEAS
    11. Nicolas Vieille & Dinah Rosenberg, 2000. "The Maxmin of Recursive Games with Incomplete Information on one Side," Post-Print hal-00481429, HAL.
    12. Sergiu Hart, 1985. "Nonzero-Sum Two-Person Repeated Games with Incomplete Information," Mathematics of Operations Research, INFORMS, vol. 10(1), pages 117-153, February.
    13. Mertens,Jean-François & Sorin,Sylvain & Zamir,Shmuel, 2015. "Repeated Games," Cambridge Books, Cambridge University Press, number 9781107030206, October.
      • Mertens,Jean-François & Sorin,Sylvain & Zamir,Shmuel, 2015. "Repeated Games," Cambridge Books, Cambridge University Press, number 9781107662636, October.
    14. Eilon Solan, 1999. "Three-Player Absorbing Games," Mathematics of Operations Research, INFORMS, vol. 24(3), pages 669-698, August.
    15. Zamir, Shmuel, 1992. "Repeated games of incomplete information: Zero-sum," Handbook of Game Theory with Economic Applications, in: R.J. Aumann & S. Hart (ed.), Handbook of Game Theory with Economic Applications, edition 1, volume 1, chapter 5, pages 109-154, Elsevier.
    16. Dinah Rosenberg & Nicolas Vieille, 2000. "The Maxmin of Recursive Games with Incomplete Information on one Side," Mathematics of Operations Research, INFORMS, vol. 25(1), pages 23-35, February.
    17. Donald A. Walker (ed.), 2000. "Equilibrium," Books, Edward Elgar Publishing, volume 0, number 1585.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Laraki, Rida & Sorin, Sylvain, 2015. "Advances in Zero-Sum Dynamic Games," Handbook of Game Theory with Economic Applications,, Elsevier.
    2. Burhaneddin Sandıkçı & Lisa M. Maillart & Andrew J. Schaefer & Oguzhan Alagoz & Mark S. Roberts, 2008. "Estimating the Patient's Price of Privacy in Liver Transplantation," Operations Research, INFORMS, vol. 56(6), pages 1393-1410, December.
    3. Boyarchenko, Svetlana & Levendorskiĭ, Sergei, 2014. "Preemption games under Lévy uncertainty," Games and Economic Behavior, Elsevier, vol. 88(C), pages 354-380.
    4. Andrzej Nowak & Eilon Solan & Sylvain Sorin, 2013. "Preface: Special Issue on Stochastic Games," Dynamic Games and Applications, Springer, vol. 3(2), pages 125-127, June.
    5. Walker, Mark & Wooders, John & Amir, Rabah, 2011. "Equilibrium play in matches: Binary Markov games," Games and Economic Behavior, Elsevier, vol. 71(2), pages 487-502, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. VIEILLE, Nicolas & ROSENBERG, Dinah & SOLAN, Eilon, 2002. "Stochastic games with a single controller and incomplete information," HEC Research Papers Series 754, HEC Paris.
    2. Eilon Solan, 2002. "Subgame-Perfection in Quitting Games with Perfect Information and Differential Equations," Discussion Papers 1356, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    3. Abraham Neyman & Sylvain Sorin, 2010. "Repeated games with public uncertain duration process," International Journal of Game Theory, Springer;Game Theory Society, vol. 39(1), pages 29-52, March.
    4. Eilon Solan & Nicolas Vieille, 2010. "Computing uniformly optimal strategies in two-player stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(1), pages 237-253, January.
    5. Rida Laraki, 2010. "Explicit formulas for repeated games with absorbing states," International Journal of Game Theory, Springer;Game Theory Society, vol. 39(1), pages 53-69, March.
    6. Eilon Solan & Rakesh V. Vohra, 1999. "Correlated Equilibrium, Public Signaling and Absorbing Games," Discussion Papers 1272, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    7. Jérôme Renault, 2006. "The Value of Markov Chain Games with Lack of Information on One Side," Mathematics of Operations Research, INFORMS, vol. 31(3), pages 490-512, August.
    8. Sylvain Sorin, 2011. "Zero-Sum Repeated Games: Recent Advances and New Links with Differential Games," Dynamic Games and Applications, Springer, vol. 1(1), pages 172-207, March.
    9. M. K. Ghosh & D. McDonald & S. Sinha, 2004. "Zero-Sum Stochastic Games with Partial Information," Journal of Optimization Theory and Applications, Springer, vol. 121(1), pages 99-118, April.
    10. Abraham Neyman, 2012. "The value of two-person zero-sum repeated games with incomplete information and uncertain duration," International Journal of Game Theory, Springer;Game Theory Society, vol. 41(1), pages 195-207, February.
    11. Eilon Solan, 2000. "The Dynamics of the Nash Equilibrium Correspondence and n-Player Stochastic Games," Discussion Papers 1311, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    12. Eilon Solan, 2005. "Subgame-Perfection in Quitting Games with Perfect Information and Differential Equations," Mathematics of Operations Research, INFORMS, vol. 30(1), pages 51-72, February.
    13. Fabien Gensbittel & Jérôme Renault, 2015. "The Value of Markov Chain Games with Incomplete Information on Both Sides," Mathematics of Operations Research, INFORMS, vol. 40(4), pages 820-841, October.
    14. Eilon Solan & Nicolas Vieille, 2000. "Uniform Value in Recursive Games," Discussion Papers 1293, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    15. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2003. "The MaxMin value of stochastic games with imperfect monitoring," International Journal of Game Theory, Springer;Game Theory Society, vol. 32(1), pages 133-150, December.
    16. János Flesch & Gijs Schoenmakers & Koos Vrieze, 2009. "Stochastic games on a product state space: the periodic case," International Journal of Game Theory, Springer;Game Theory Society, vol. 38(2), pages 263-289, June.
    17. Salomon, Antoine & Forges, Françoise, 2015. "Bayesian repeated games and reputation," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 70-104.
    18. Fudenberg, Drew & Yamamoto, Yuichi, 2011. "Learning from private information in noisy repeated games," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1733-1769, September.
    19. Miklós Pintér, 2005. "A game theoretic application of inverse limit," Game Theory and Information 0503006, University Library of Munich, Germany, revised 21 Oct 2005.
    20. Shmuel Zamir, 2008. "Bayesian games: Games with incomplete information," Discussion Paper Series dp486, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.

    More about this item

    JEL classification:

    • C - Mathematical and Quantitative Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:gamchp:3-48. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/bookseriesdescription.cws_home/BS_HE/description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.