IDEAS home Printed from https://ideas.repec.org/a/eee/jetheo/v150y2014icp815-840.html
   My bibliography  Save this article

A constructive study of Markov equilibria in stochastic games with strategic complementarities

Author

Listed:
  • Balbus, Łukasz
  • Reffett, Kevin
  • Woźny, Łukasz

Abstract

We study a class of infinite horizon, discounted stochastic games with strategic complementarities. In our class of games, we prove the existence of a stationary Markov Nash equilibrium, as well as provide methods for constructing this least and greatest equilibrium via a simple successive approximation schemes. We also provide results on computable equilibrium comparative statics relative to ordered perturbations of the space of games. Under stronger assumptions, we prove the stationary Markov Nash equilibrium values form a complete lattice, with least and greatest equilibrium value functions being the uniform limit of approximations starting from pointwise lower and upper bounds.

Suggested Citation

  • Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    • Handle: RePEc:eee:jetheo:v:150:y:2014:i:c:p:815-840
    DOI: 10.1016/j.jet.2013.09.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0022053113001506
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jet.2013.09.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mark Huggett, 2003. "When Are Comparative Dynamics Monotone?," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 6(1), pages 1-11, January.
    2. , & ,, 2014. "Stochastic stability in monotone economies," Theoretical Economics, Econometric Society, vol. 9(2), May.
    3. Chakrabarti, Subir K., 1999. "Markov Equilibria in Discounted Stochastic Games," Journal of Economic Theory, Elsevier, vol. 85(2), pages 294-327, April.
    4. Mertens, J.-F. & Parthasarathy, T., 1987. "Equilibria for discounted stochastic games," LIDAM Discussion Papers CORE 1987050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    5. Herings, P. Jean-Jacques & Peeters, Ronald J. A. P., 2004. "Stationary equilibria in stochastic games: structure, selection, and computation," Journal of Economic Theory, Elsevier, vol. 118(1), pages 32-60, September.
    6. Lagunoff, Roger, 2009. "Dynamic stability and reform of political institutions," Games and Economic Behavior, Elsevier, vol. 67(2), pages 569-583, November.
    7. Echenique, Federico, 2004. "Extensive-form games and strategic complementarities," Games and Economic Behavior, Elsevier, vol. 46(2), pages 348-364, February.
    8. John Duggan, 2012. "Noisy Stochastic Games," Econometrica, Econometric Society, vol. 80(5), pages 2017-2045, September.
    9. Duggan, John & Kalandrakis, Tasos, 2012. "Dynamic legislative policy making," Journal of Economic Theory, Elsevier, vol. 147(5), pages 1653-1688.
    10. Yehuda (John) Levy, 2012. "A Discounted Stochastic Game with No Stationary Equilibria: The Case of Absolutely Continuous Transitions," Discussion Paper Series dp612, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    11. Atkeson, Andrew, 1991. "International Lending with Moral Hazard and Risk of Repudiation," Econometrica, Econometric Society, vol. 59(4), pages 1069-1089, July.
    12. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    13. Amir, Rabah, 1996. "Sensitivity analysis of multisector optimal economic dynamics," Journal of Mathematical Economics, Elsevier, vol. 25(1), pages 123-141.
    14. Amir, Rabah, 1996. "Continuous Stochastic Games of Capital Accumulation with Convex Transitions," Games and Economic Behavior, Elsevier, vol. 15(2), pages 111-131, August.
    15. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2012. "Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment," Journal of Mathematical Economics, Elsevier, vol. 48(2), pages 115-132.
    16. Stokey, Nancy L., 1991. "Credible public policy," Journal of Economic Dynamics and Control, Elsevier, vol. 15(4), pages 627-656, October.
    17. Milgrom, Paul & Roberts, John, 1994. "Comparing Equilibria," American Economic Review, American Economic Association, vol. 84(3), pages 441-459, June.
    18. Łukasz Balbus & Andrzej S. Nowak, 2004. "Construction of Nash equilibria in symmetric stochastic games of capital accumulation," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 60(2), pages 267-277, October.
    19. Ariel Pakes & Michael Ostrovsky & Steven Berry, 2007. "Simple estimators for the parameters of discrete dynamic games (with entry/exit examples)," RAND Journal of Economics, RAND Corporation, vol. 38(2), pages 373-399, June.
    20. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    21. Christopher Phelan & Ennio Stacchetti, 2001. "Sequential Equilibria in a Ramsey Tax Model," Econometrica, Econometric Society, vol. 69(6), pages 1491-1518, November.
    22. Cabral, Luis M B & Riordan, Michael H, 1994. "The Learning Curve, Market Dominance, and Predatory Pricing," Econometrica, Econometric Society, vol. 62(5), pages 1115-1140, September.
    23. Rabah Amir, 2002. "Complementarity and Diagonal Dominance in Discounted Stochastic Games," Annals of Operations Research, Springer, vol. 114(1), pages 39-56, August.
    24. Vives, Xavier, 1990. "Nash equilibrium with strategic complementarities," Journal of Mathematical Economics, Elsevier, vol. 19(3), pages 305-321.
    25. Abreu, Dilip & Pearce, David & Stacchetti, Ennio, 1990. "Toward a Theory of Discounted Repeated Games with Imperfect Monitoring," Econometrica, Econometric Society, vol. 58(5), pages 1041-1063, September.
    26. Milgrom, Paul & Roberts, John, 1990. "Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities," Econometrica, Econometric Society, vol. 58(6), pages 1255-1277, November.
    27. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, vol. 75(1), pages 1-53, January.
    28. Curtat, Laurent O., 1996. "Markov Equilibria of Stochastic Games with Complementarities," Games and Economic Behavior, Elsevier, vol. 17(2), pages 177-199, December.
    29. Andrzej Nowak, 2007. "On stochastic games in economics," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 66(3), pages 513-530, December.
    30. A. S. Nowak & T. E. S. Raghavan, 1992. "Existence of Stationary Correlated Equilibria with Symmetric Information for Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 17(3), pages 519-526, August.
    31. Donald M. Topkis, 1978. "Minimizing a Submodular Function on a Lattice," Operations Research, INFORMS, vol. 26(2), pages 305-321, April.
    32. Martin Pesendorfer & Philipp Schmidt-Dengler, 2008. "Asymptotic Least Squares Estimators for Dynamic Games -super-1," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 901-928.
    33. Frieda Granot & Arthur F. Veinott, 1985. "Substitutes, Complements and Ripples in Network Flows," Mathematics of Operations Research, INFORMS, vol. 10(3), pages 471-497, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria Arvaniti & Chandra K. Krishnamurthy & Anne-Sophie Crépin, 2019. "Time-consistent resource management with regime shifts," CER-ETH Economics working paper series 19/329, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    2. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2018. "On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty," Journal of Economic Theory, Elsevier, vol. 176(C), pages 293-310.
    3. Vives, Xavier & Vravosinos, Orestis, 2024. "Strategic complementarity in games," Journal of Mathematical Economics, Elsevier, vol. 113(C).
    4. Takashi Kamihigashi & Kevin Reffett & Masayuki Yao, 2014. "An Application of Kleene's Fixed Point Theorem to Dynamic Programming: A Note," Working Papers 2014-398, Department of Research, Ipag Business School.
    5. Feng, Yue & Sabarwal, Tarun, 2020. "Strategic complements in two stage, 2 × 2 games," Journal of Economic Theory, Elsevier, vol. 190(C).
    6. Anne-Christine Barthel & Tarun Sabarwal, 2018. "Directional monotone comparative statics," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(3), pages 557-591, October.
    7. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
    8. Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    9. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    10. repec:kan:wpaper:201502 is not listed on IDEAS
    11. Yue Feng & Tarun Sabarwal, 2018. "Strategic Complements in Two Stage, 2 × 2 Games," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201801, University of Kansas, Department of Economics.
    12. Svetlana Boyarchenko, 2020. "Super- and submodularity of stopping games with random observations," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(4), pages 983-1022, November.
    13. Dianetti, Jodi & Ferrari, Giorgio, 2019. "Nonzero-Sum Submodular Monotone-Follower Games. Existence and Approximation of Nash Equilibria," Center for Mathematical Economics Working Papers 605, Center for Mathematical Economics, Bielefeld University.
    14. John Quah, 2016. "Supermodular Correspondences," Economics Series Working Papers 795, University of Oxford, Department of Economics.
    15. Tarun Sabarwal, 2023. "Universal Theory of Equilibrium in Models with Complementarities," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202312, University of Kansas, Department of Economics, revised Nov 2023.
    16. Ricardo Josa-Fombellida & Juan Rincón-Zapatero, 2015. "Euler–Lagrange equations of stochastic differential games: application to a game of a productive asset," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 59(1), pages 61-108, May.
    17. Thomas J. Sargent & John Stachurski, 2024. "Dynamic Programming: Finite States," Papers 2401.10473, arXiv.org.
    18. Wei He, 2022. "Discontinuous stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(4), pages 827-858, June.
    19. Piotr Więcek, 2017. "Total Reward Semi-Markov Mean-Field Games with Complementarity Properties," Dynamic Games and Applications, Springer, vol. 7(3), pages 507-529, September.
    20. Yue Feng & Tarun Sabarwal, 2020. "Dynamic strategic complements in two stage, 2x2 games," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202006, University of Kansas, Department of Economics.
    21. Pawel Dziewulski & John K. H. Quah, 2019. "Supermodular correspondences and comparison of multi-prior beliefs," Working Paper Series 0619, Department of Economics, University of Sussex Business School.
    22. Arvaniti, Maria & Krishnamurthy, Chandra Kiran B. & Crépin, Anne-Sophie, 2023. "Time-consistent renewable resource management with present bias and regime shifts," Journal of Economic Behavior & Organization, Elsevier, vol. 207(C), pages 479-495.
    23. Shadmehr, Mehdi & Bernhardt, Dan, 2017. "Monotone and bounded interval equilibria in a coordination game with information aggregation," Mathematical Social Sciences, Elsevier, vol. 89(C), pages 61-69.
    24. Bar Light, 2019. "Stochastic Comparative Statics in Markov Decision Processes," Papers 1904.05481, arXiv.org, revised Jan 2020.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2013. "Markov Stationary Equilibria in Stochastic Supermodular Games with Imperfect Private and Public Information," Dynamic Games and Applications, Springer, vol. 3(2), pages 187-206, June.
    2. Jaśkiewicz, Anna & Nowak, Andrzej S., 2014. "Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models," Journal of Economic Theory, Elsevier, vol. 151(C), pages 411-447.
    3. Duggan, John & Kalandrakis, Tasos, 2012. "Dynamic legislative policy making," Journal of Economic Theory, Elsevier, vol. 147(5), pages 1653-1688.
    4. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
    5. Amir, Rabah & De Castro, Luciano, 2017. "Nash equilibrium in games with quasi-monotonic best-responses," Journal of Economic Theory, Elsevier, vol. 172(C), pages 220-246.
    6. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    7. Anna Jaśkiewicz & Andrzej S. Nowak, 2016. "Stationary Almost Markov Perfect Equilibria in Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 41(2), pages 430-441, May.
    8. John Duggan, 2011. "Noisy Stochastic Games," RCER Working Papers 562, University of Rochester - Center for Economic Research (RCER).
    9. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    10. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov‐perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243, June.
    11. Page, Frank, 2016. "Stationary Markov equilibria for approximable discounted stochastic games," LSE Research Online Documents on Economics 67808, London School of Economics and Political Science, LSE Library.
    12. Frank H. Page & Myrna H. Wooders, 2009. "Endogenous Network Dynamics," Working Papers 2009.28, Fondazione Eni Enrico Mattei.
    13. Barelli, Paulo & Duggan, John, 2014. "A note on semi-Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 151(C), pages 596-604.
    14. A. S. Nowak, 2010. "On a Noncooperative Stochastic Game Played by Internally Cooperating Generations," Journal of Optimization Theory and Applications, Springer, vol. 144(1), pages 88-106, January.
    15. Wei He, 2022. "Discontinuous stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(4), pages 827-858, June.
    16. AMIR, Rabah, 2001. "Stochastic games in economics: the lattice-theoretic approach," LIDAM Discussion Papers CORE 2001059, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    17. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2012. "Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment," Journal of Mathematical Economics, Elsevier, vol. 48(2), pages 115-132.
    18. Amir, Rabah & Bloch, Francis, 2009. "Comparative statics in a simple class of strategic market games," Games and Economic Behavior, Elsevier, vol. 65(1), pages 7-24, January.
    19. Mitsukuni Nishida, 2015. "Estimating a Model of Strategic Network Choice: The Convenience-Store Industry in Okinawa," Marketing Science, INFORMS, vol. 34(1), pages 20-38, January.
    20. Mirman, Leonard J. & Morand, Olivier F. & Reffett, Kevin L., 2008. "A qualitative approach to Markovian equilibrium in infinite horizon economies with capital," Journal of Economic Theory, Elsevier, vol. 139(1), pages 75-98, March.

    More about this item

    Keywords

    Markov equilibria; Stochastic games; Constructive methods;
    All these keywords.

    JEL classification:

    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jetheo:v:150:y:2014:i:c:p:815-840. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622869 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.