IDEAS home Printed from https://ideas.repec.org/a/spr/dyngam/v3y2013i2p279-312.html
   My bibliography  Save this article

Continuous-Time Stochastic Games of Fixed Duration

Author

Listed:
  • Yehuda Levy

Abstract

We study nonzero-sum continuous-time stochastic games, also known as continuous-time Markov games, of fixed duration. We concentrate on Markovian strategies. We show by way of example that equilibria need not exist in Markovian strategies, but they always exist in Markovian public-signal correlated strategies. To do so, we develop criteria for a strategy profile to be an equilibrium via differential inclusions, both directly and also by modeling continuous-time stochastic as differential games and using the Hamilton–Jacobi–Bellman equations. We also give an interpretation of equilibria in mixed strategies in continuous time and show that approximate equilibria always exist. Copyright Springer Science+Business Media New York 2013

Suggested Citation

  • Yehuda Levy, 2013. "Continuous-Time Stochastic Games of Fixed Duration," Dynamic Games and Applications, Springer, vol. 3(2), pages 279-312, June.
    • Handle: RePEc:spr:dyngam:v:3:y:2013:i:2:p:279-312
    DOI: 10.1007/s13235-012-0067-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s13235-012-0067-2
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s13235-012-0067-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. John C. Harsanyi & Reinhard Selten, 1988. "A General Theory of Equilibrium Selection in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262582384, April.
    2. Judd, Kenneth L., 1985. "The law of large numbers with a continuum of IID random variables," Journal of Economic Theory, Elsevier, vol. 35(1), pages 19-25, February.
    3. Yehuda (John) Levy, 2012. "A Discounted Stochastic Game with No Stationary Equilibria: The Case of Absolutely Continuous Transitions," Discussion Paper Series dp612, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    4. Neyman, Abraham, 2017. "Continuous-time stochastic games," Games and Economic Behavior, Elsevier, vol. 104(C), pages 92-130.
    5. Maskin, Eric & Tirole, Jean, 2001. "Markov Perfect Equilibrium: I. Observable Actions," Journal of Economic Theory, Elsevier, vol. 100(2), pages 191-219, October.
    6. Kohlberg, Elon & Mertens, Jean-Francois, 1986. "On the Strategic Stability of Equilibria," Econometrica, Econometric Society, vol. 54(5), pages 1003-1037, September.
    7. Yehuda (John) Levy, 2012. "A Discounted Stochastic Game with No Stationary Nash Equilibrium," Discussion Paper Series dp596r, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem, revised May 2012.
    8. A. S. Nowak & T. E. S. Raghavan, 1992. "Existence of Stationary Correlated Equilibria with Symmetric Information for Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 17(3), pages 519-526, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abraham Neyman, 2013. "Stochastic Games with Short-Stage Duration," Dynamic Games and Applications, Springer, vol. 3(2), pages 236-278, June.
    2. Neyman, Abraham, 2017. "Continuous-time stochastic games," Games and Economic Behavior, Elsevier, vol. 104(C), pages 92-130.
    3. Yurii Averboukh, 2017. "Extremal Shift Rule for Continuous-Time Zero-Sum Markov Games," Dynamic Games and Applications, Springer, vol. 7(1), pages 1-20, March.
    4. Leslie, David S. & Perkins, Steven & Xu, Zibo, 2020. "Best-response dynamics in zero-sum stochastic games," Journal of Economic Theory, Elsevier, vol. 189(C).
    5. Yehuda John Levy, 2021. "An Update on Continuous-Time Stochastic Games of Fixed Duration," Dynamic Games and Applications, Springer, vol. 11(2), pages 418-432, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yehuda (John) Levy, 2012. "A Discounted Stochastic Game with No Stationary Equilibria: The Case of Absolutely Continuous Transitions," Discussion Paper Series dp612, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    2. Matsui Akihiko & Matsuyama Kiminori, 1995. "An Approach to Equilibrium Selection," Journal of Economic Theory, Elsevier, vol. 65(2), pages 415-434, April.
    3. Yehuda (John) Levy, 2012. "A Discounted Stochastic Game with No Stationary Nash Equilibrium," Discussion Paper Series dp596r, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem, revised May 2012.
    4. He, Wei & Sun, Yeneng, 2013. "Stationary Markov Perfect Equilibria in Discounted Stochastic Games," MPRA Paper 51274, University Library of Munich, Germany.
    5. Dieter Balkenborg & Rosemarie Nagel, 2016. "An Experiment on Forward vs. Backward Induction: How Fairness and Level k Reasoning Matter," German Economic Review, Verein für Socialpolitik, vol. 17(3), pages 378-408, August.
    6. Herings, P. J. J. & Polemarchakis, H., 2002. "Equilibrium and arbitrage in incomplete asset markets with fixed prices," Journal of Mathematical Economics, Elsevier, vol. 37(2), pages 133-155, April.
    7. Keser Claudia & Gaudeul Alexia, 2016. "Foreword: Special Issue in Honor of Reinhard Selten’s 85th Birthday," German Economic Review, De Gruyter, vol. 17(3), pages 277-283, August.
    8. van Damme, E.E.C., 1995. "Game theory : The next stage," Other publications TiSEM 7779b0f9-bef5-45c7-ae6b-7, Tilburg University, School of Economics and Management.
    9. Philippe Bich, 2016. "Prudent Equilibria and Strategic Uncertainty in Discontinuous Games," Working Papers halshs-01337293, HAL.
    10. Houba, Harold & Wen, Quan, 2014. "Backward induction and unacceptable offers," Journal of Mathematical Economics, Elsevier, vol. 54(C), pages 151-156.
    11. Oyama, Daisuke & Tercieux, Olivier, 2009. "Iterated potential and robustness of equilibria," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1726-1769, July.
    12. Thijssen, J.J.J., 2003. "Investment under uncertainty, market evolution and coalition spillovers in a game theoretic perspective," Other publications TiSEM 672073a6-492e-4621-8d4a-0, Tilburg University, School of Economics and Management.
    13. Daniele Condorelli & Massimiliano Furlan, 2024. "Deep Learning to Play Games," Papers 2409.15197, arXiv.org.
    14. Rossella Argenziano & Itzhak Gilboa, 2012. "History as a coordination device," Theory and Decision, Springer, vol. 73(4), pages 501-512, October.
    15. P. Jean-Jacques Herings & Harold Houba, 2010. "The Condorcet Paradox Revisited," Tinbergen Institute Discussion Papers 10-026/1, Tinbergen Institute.
    16. Francesco Caruso & Maria Carmela Ceparano & Jacqueline Morgan, 2024. "Asymptotic behavior of subgame perfect Nash equilibria in Stackelberg games," Annals of Operations Research, Springer, vol. 336(3), pages 1573-1590, May.
    17. Okada, Akira, 2010. "The Nash bargaining solution in general n-person cooperative games," Journal of Economic Theory, Elsevier, vol. 145(6), pages 2356-2379, November.
    18. Hadi Charkhgard & Martin Savelsbergh & Masoud Talebian, 2018. "Nondominated Nash points: application of biobjective mixed integer programming," 4OR, Springer, vol. 16(2), pages 151-171, June.
    19. Govindan, Srihari & Laraki, Rida & Pahl, Lucas, 2023. "On sustainable equilibria," Journal of Economic Theory, Elsevier, vol. 213(C).
    20. Christoph Kuzmics & Daniel Rodenburger, 2020. "A case of evolutionarily stable attainable equilibrium in the laboratory," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(3), pages 685-721, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:dyngam:v:3:y:2013:i:2:p:279-312. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.