IDEAS home Printed from https://ideas.repec.org/a/spr/dyngam/v6y2016i3d10.1007_s13235-015-0151-5.html
   My bibliography  Save this article

Elementary Subpaths in Discounted Stochastic Games

Author

Listed:
  • Kimmo Berg

    (Aalto University School of Science)

Abstract

This paper examines the subgame-perfect equilibria in discounted stochastic games with finite state and action spaces. The fixed-point characterization of equilibria is generalized to unobservable mixed strategies. It is also shown that the pure-strategy equilibria consist of elementary subpaths, which are repeating fragments that give the acceptable action plans in the game. The developed methodology offers a novel way of computing and analyzing equilibrium strategies that need not be stationary nor Markovian.

Suggested Citation

  • Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    • Handle: RePEc:spr:dyngam:v:6:y:2016:i:3:d:10.1007_s13235-015-0151-5
    DOI: 10.1007/s13235-015-0151-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13235-015-0151-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s13235-015-0151-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cole, Harold L. & Kocherlakota, Narayana, 2001. "Dynamic Games with Hidden Actions and Hidden States," Journal of Economic Theory, Elsevier, vol. 98(1), pages 114-126, May.
    2. Fudenberg, Drew & Yamamoto, Yuichi, 2011. "The folk theorem for irreducible stochastic games with imperfect public monitoring," Journal of Economic Theory, Elsevier, vol. 146(4), pages 1664-1683, July.
    3. Mertens, J.-F. & Parthasarathy, T., 1987. "Equilibria for discounted stochastic games," LIDAM Discussion Papers CORE 1987050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Herings, P. Jean-Jacques & Peeters, Ronald J. A. P., 2004. "Stationary equilibria in stochastic games: structure, selection, and computation," Journal of Economic Theory, Elsevier, vol. 118(1), pages 32-60, September.
    5. Doraszelski, Ulrich & Pakes, Ariel, 2007. "A Framework for Applied Dynamic Analysis in IO," Handbook of Industrial Organization, in: Mark Armstrong & Robert Porter (ed.), Handbook of Industrial Organization, edition 1, volume 3, chapter 30, pages 1887-1966, Elsevier.
    6. Cronshaw, Mark B, 1997. "Algorithms for Finding Repeated Game Equilibria," Computational Economics, Springer;Society for Computational Economics, vol. 10(2), pages 139-168, May.
    7. repec:dau:papers:123456789/6017 is not listed on IDEAS
    8. Abreu, Dilip, 1988. "On the Theory of Infinitely Repeated Games with Discounting," Econometrica, Econometric Society, vol. 56(2), pages 383-396, March.
    9. Doraszelski, Ulrich & Escobar, Juan F., 2012. "Restricted feedback in long term relationships," Journal of Economic Theory, Elsevier, vol. 147(1), pages 142-161.
    10. Atkeson, Andrew, 1991. "International Lending with Moral Hazard and Risk of Repudiation," Econometrica, Econometric Society, vol. 59(4), pages 1069-1089, July.
    11. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2013. "Markov Stationary Equilibria in Stochastic Supermodular Games with Imperfect Private and Public Information," Dynamic Games and Applications, Springer, vol. 3(2), pages 187-206, June.
    12. Yehuda John Levy & Andrew McLennan, 2015. "Corrigendum to “Discounted Stochastic Games With No Stationary Nash Equilibrium: Two Examples”," Econometrica, Econometric Society, vol. 83(3), pages 1237-1252, May.
    13. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    14. Eilon Solan & Nicolas Vieille, 1998. "Quitting Games," Discussion Papers 1227, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    15. Kenneth L. Judd & Sevin Yeltekin & James Conklin, 2003. "Computing Supergame Equilibria," Econometrica, Econometric Society, vol. 71(4), pages 1239-1254, July.
    16. Kimmo Berg & Mitri Kitti, 2013. "Computing Equilibria in Discounted 2 × 2 Supergames," Computational Economics, Springer;Society for Computational Economics, vol. 41(1), pages 71-88, January.
    17. Zhigang Feng & Jianjun Miao & Adrian Peralta‐Alva & Manuel S. Santos, 2014. "Numerical Simulation Of Nonoptimal Dynamic Equilibrium Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55, pages 83-110, February.
    18. Eilon Solan & Nicholas Vieille, 2001. "Quitting Games - An Example," Discussion Papers 1314, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    19. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    20. Christopher Phelan & Ennio Stacchetti, 2001. "Sequential Equilibria in a Ramsey Tax Model," Econometrica, Econometric Society, vol. 69(6), pages 1491-1518, November.
    21. AMIR, Rabah, 2001. "Stochastic games in economics and related fields: an overview," LIDAM Discussion Papers CORE 2001060, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    22. Pakes, Ariel & Ericson, Richard, 1998. "Empirical Implications of Alternative Models of Firm Dynamics," Journal of Economic Theory, Elsevier, vol. 79(1), pages 1-45, March.
    23. Yehuda Levy, 2013. "Discounted Stochastic Games With No Stationary Nash Equilibrium: Two Examples," Econometrica, Econometric Society, vol. 81(5), pages 1973-2007, September.
    24. Govindan, Srihari & Wilson, Robert, 2009. "Global Newton Method for stochastic games," Journal of Economic Theory, Elsevier, vol. 144(1), pages 414-421, January.
    25. Abreu, Dilip & Pearce, David & Stacchetti, Ennio, 1986. "Optimal cartel equilibria with imperfect monitoring," Journal of Economic Theory, Elsevier, vol. 39(1), pages 251-269, June.
    26. Abreu, Dilip, 1986. "Extremal equilibria of oligopolistic supergames," Journal of Economic Theory, Elsevier, vol. 39(1), pages 191-225, June.
    27. Johannes Hörner & Takuo Sugaya & Satoru Takahashi & Nicolas Vieille, 2011. "Recursive Methods in Discounted Stochastic Games: An Algorithm for δ→ 1 and a Folk Theorem," Econometrica, Econometric Society, vol. 79(4), pages 1277-1318, July.
    28. Yuichi Yamamoto, 2015. "Stochastic Games with Hidden States," PIER Working Paper Archive 15-007, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    29. Mailath, George J. & Samuelson, Larry, 2006. "Repeated Games and Reputations: Long-Run Relationships," OUP Catalogue, Oxford University Press, number 9780195300796.
    30. Mitri Kitti, 2013. "Subgame Perfect Equilibria in Discounted Stochastic Games," Discussion Papers 87, Aboa Centre for Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kimmo Berg & Gijs Schoenmakers, 2017. "Construction of Subgame-Perfect Mixed-Strategy Equilibria in Repeated Games," Games, MDPI, vol. 8(4), pages 1-14, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mitri Kitti, 2013. "Conditional Markov equilibria in discounted dynamic games," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 78(1), pages 77-100, August.
    2. Kimmo Berg & Gijs Schoenmakers, 2017. "Construction of Subgame-Perfect Mixed-Strategy Equilibria in Repeated Games," Games, MDPI, vol. 8(4), pages 1-14, November.
    3. Mitri Kitti, 2013. "Subgame Perfect Equilibria in Discounted Stochastic Games," Discussion Papers 87, Aboa Centre for Economics.
    4. Wei He, 2022. "Discontinuous stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(4), pages 827-858, June.
    5. Doraszelski, Ulrich & Escobar, Juan F., 2012. "Restricted feedback in long term relationships," Journal of Economic Theory, Elsevier, vol. 147(1), pages 142-161.
    6. Kimmo Berg & Mitri Kitti, 2014. "Equilibrium Paths in Discounted Supergames," Discussion Papers 96, Aboa Centre for Economics.
    7. Kam, Timothy & Stauber, Ronald, 2016. "Solving dynamic public insurance games with endogenous agent distributions: Theory and computational approximation," Journal of Mathematical Economics, Elsevier, vol. 64(C), pages 77-98.
    8. Dilip Abreu & Benjamin Brooks & Yuliy Sannikov, 2016. "A "Pencil Sharpening" Algorithm for Two Player Stochastic Games with Perfect Monitoring," Working Papers 78_2016, Princeton University, Department of Economics, Econometric Research Program..
    9. Kimmo Berg & Markus Kärki, 2018. "Critical Discount Factor Values in Discounted Supergames," Games, MDPI, vol. 9(3), pages 1-17, July.
    10. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    11. Kimmo Berg, 2017. "Extremal Pure Strategies and Monotonicity in Repeated Games," Computational Economics, Springer;Society for Computational Economics, vol. 49(3), pages 387-404, March.
    12. Susanne Goldlücke & Sebastian Kranz, 2018. "Discounted stochastic games with voluntary transfers," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(1), pages 235-263, July.
    13. Arpad Abraham & Nicola Pavoni, 2008. "Efficient Allocations with Moral Hazard and Hidden Borrowing and Lending: A Recursive Formulation," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 11(4), pages 781-803, October.
    14. Gary Gorton & Ping He, 2023. "Optimal monetary policy in a collateralized economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 75(1), pages 55-89, January.
    15. Peixuan Li & Chuangyin Dang & P. Jean-Jacques Herings, 2024. "Computing perfect stationary equilibria in stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 78(2), pages 347-387, September.
    16. Abraham Arpad & Nicola Pavoni, 2004. "Efficient Allocations, with Moral Hazard and Hidden Borrowing and Lending," Levine's Bibliography 122247000000000138, UCLA Department of Economics.
    17. Johannes Horner & Takuo Sugaya & Satoru Takahashi & Nicolas Vieille, 2009. "Recursive Methods in Discounted Stochastic Games: An Algorithm for delta Approaching 1 and a Folk Theorem," Cowles Foundation Discussion Papers 1742, Cowles Foundation for Research in Economics, Yale University, revised Aug 2010.
    18. Dilip Abreu & Benjamin Brooks & Yuliy Sannikov, 2020. "Algorithms for Stochastic Games With Perfect Monitoring," Econometrica, Econometric Society, vol. 88(4), pages 1661-1695, July.
    19. , & ,, 2015. "A folk theorem for stochastic games with infrequent state changes," Theoretical Economics, Econometric Society, vol. 10(1), January.
    20. Nicolas Vieille, 2010. "Recursive Methods in Discounted Stochastic Games: An Algorithm for - 1 and a Folk Theorem," Post-Print hal-00543616, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:dyngam:v:6:y:2016:i:3:d:10.1007_s13235-015-0151-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.