IDEAS home Printed from https://ideas.repec.org/a/spr/mathme/v78y2013i1p77-100.html
   My bibliography  Save this article

Conditional Markov equilibria in discounted dynamic games

Author

Listed:
  • Mitri Kitti

Abstract

This paper introduces conditional Markov strategies in discrete-time discounted dynamic games with perfect monitoring. These are strategies in which players follow Markov policies after all histories. Policies induced by conditional Markov equilibria can be supported with the threat of reverting to the policy that yields the smallest expected equilibrium payoff for the deviator. This leads to a set-valued fixed-point characterization of equilibrium payoff functions. The result can be used for the computation of equilibria and for showing the existence in behavior strategies. Copyright Springer-Verlag Berlin Heidelberg 2013

Suggested Citation

  • Mitri Kitti, 2013. "Conditional Markov equilibria in discounted dynamic games," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 78(1), pages 77-100, August.
    • Handle: RePEc:spr:mathme:v:78:y:2013:i:1:p:77-100
    DOI: 10.1007/s00186-013-0433-x
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00186-013-0433-x
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s00186-013-0433-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cole, Harold L. & Kocherlakota, Narayana, 2001. "Dynamic Games with Hidden Actions and Hidden States," Journal of Economic Theory, Elsevier, vol. 98(1), pages 114-126, May.
    2. Duffie, Darrell, et al, 1994. "Stationary Markov Equilibria," Econometrica, Econometric Society, vol. 62(4), pages 745-781, July.
    3. Sleet, Christopher & Yeltekin, Sevin, 2007. "Recursive monetary policy games with incomplete information," Journal of Economic Dynamics and Control, Elsevier, vol. 31(5), pages 1557-1583, May.
    4. Doraszelski, Ulrich & Pakes, Ariel, 2007. "A Framework for Applied Dynamic Analysis in IO," Handbook of Industrial Organization, in: Mark Armstrong & Robert Porter (ed.), Handbook of Industrial Organization, edition 1, volume 3, chapter 30, pages 1887-1966, Elsevier.
    5. Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, September.
    6. Cronshaw, Mark B, 1997. "Algorithms for Finding Repeated Game Equilibria," Computational Economics, Springer;Society for Computational Economics, vol. 10(2), pages 139-168, May.
    7. Ashok P. Maitra & William D. Sudderth, 2007. "Subgame-Perfect Equilibria for Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 32(3), pages 711-722, August.
    8. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov‐perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243, June.
    9. Michihiro Kandori, 2011. "Weakly Belief‐Free Equilibria in Repeated Games With Private Monitoring," Econometrica, Econometric Society, vol. 79(3), pages 877-892, May.
    10. Abreu, Dilip, 1988. "On the Theory of Infinitely Repeated Games with Discounting," Econometrica, Econometric Society, vol. 56(2), pages 383-396, March.
    11. Doraszelski, Ulrich & Escobar, Juan F., 2012. "Restricted feedback in long term relationships," Journal of Economic Theory, Elsevier, vol. 147(1), pages 142-161.
    12. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    13. Kenneth L. Judd & Sevin Yeltekin & James Conklin, 2003. "Computing Supergame Equilibria," Econometrica, Econometric Society, vol. 71(4), pages 1239-1254, July.
    14. Kimmo Berg & Mitri Kitti, 2013. "Computing Equilibria in Discounted 2 × 2 Supergames," Computational Economics, Springer;Society for Computational Economics, vol. 41(1), pages 71-88, January.
    15. Jeffrey C. Ely & Johannes Hörner & Wojciech Olszewski, 2005. "Belief-Free Equilibria in Repeated Games," Econometrica, Econometric Society, vol. 73(2), pages 377-415, March.
    16. Drew Fudenberg & David Levine, 2008. "Subgame–Perfect Equilibria of Finite– and Infinite–Horizon Games," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 1, pages 3-20, World Scientific Publishing Co. Pte. Ltd..
    17. Christopher Phelan & Ennio Stacchetti, 2001. "Sequential Equilibria in a Ramsey Tax Model," Econometrica, Econometric Society, vol. 69(6), pages 1491-1518, November.
    18. Mitri Kitti, 2011. "Conditionally Stationary Equilibria in Discounted Dynamic Games," Dynamic Games and Applications, Springer, vol. 1(4), pages 514-533, December.
    19. Sleet, Christopher & Yeltekin, Sevin, 2006. "Optimal taxation with endogenously incomplete debt markets," Journal of Economic Theory, Elsevier, vol. 127(1), pages 36-73, March.
    20. Eilon Solan, 1998. "Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 23(4), pages 1010-1021, November.
    21. Abreu, Dilip & Pearce, David & Stacchetti, Ennio, 1986. "Optimal cartel equilibria with imperfect monitoring," Journal of Economic Theory, Elsevier, vol. 39(1), pages 251-269, June.
    22. Abreu, Dilip, 1986. "Extremal equilibria of oligopolistic supergames," Journal of Economic Theory, Elsevier, vol. 39(1), pages 191-225, June.
    23. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, vol. 75(1), pages 1-53, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mitri Kitti, 2013. "Subgame Perfect Equilibria in Discounted Stochastic Games," Discussion Papers 87, Aboa Centre for Economics.
    2. Mitri Kitti, 2018. "Subgame Perfect Equilibria in Continuous-Time Repeated Games," Discussion Papers 120, Aboa Centre for Economics.
    3. Mitri Kitti, 2014. "Equilibrium Payoffs for Pure Strategies in Repeated Games," Discussion Papers 98, Aboa Centre for Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    2. Mitri Kitti, 2013. "Subgame Perfect Equilibria in Discounted Stochastic Games," Discussion Papers 87, Aboa Centre for Economics.
    3. Kimmo Berg & Gijs Schoenmakers, 2017. "Construction of Subgame-Perfect Mixed-Strategy Equilibria in Repeated Games," Games, MDPI, vol. 8(4), pages 1-14, November.
    4. Kimmo Berg & Mitri Kitti, 2014. "Equilibrium Paths in Discounted Supergames," Discussion Papers 96, Aboa Centre for Economics.
    5. Doraszelski, Ulrich & Escobar, Juan F., 2012. "Restricted feedback in long term relationships," Journal of Economic Theory, Elsevier, vol. 147(1), pages 142-161.
    6. C. Lanier Benkard & Przemyslaw Jeziorski & Gabriel Y. Weintraub, 2013. "Oblivious Equilibrium for Concentrated Industries," NBER Working Papers 19307, National Bureau of Economic Research, Inc.
    7. Kimmo Berg & Markus Kärki, 2018. "Critical Discount Factor Values in Discounted Supergames," Games, MDPI, vol. 9(3), pages 1-17, July.
    8. Kimmo Berg & Mitri Kitti, 2013. "Computing Equilibria in Discounted 2 × 2 Supergames," Computational Economics, Springer;Society for Computational Economics, vol. 41(1), pages 71-88, January.
    9. Jenkins, Mark & Liu, Paul & Matzkin, Rosa L. & McFadden, Daniel L., 2021. "The browser war — Analysis of Markov Perfect Equilibrium in markets with dynamic demand effects," Journal of Econometrics, Elsevier, vol. 222(1), pages 244-260.
    10. Gaynor, Martin & Town, Robert J., 2011. "Competition in Health Care Markets," Handbook of Health Economics, in: Mark V. Pauly & Thomas G. Mcguire & Pedro P. Barros (ed.), Handbook of Health Economics, volume 2, chapter 0, pages 499-637, Elsevier.
    11. Linli Xu & Jorge M. Silva-Risso & Kenneth C. Wilbur, 2018. "Dynamic Quality Ladder Model Predictions in Nonrandom Holdout Samples," Management Science, INFORMS, vol. 64(7), pages 3187-3207, July.
    12. Macieira, João, 2015. "Introducing consumer heterogeneity in dynamic games with multi-product firms and differentiated product demand," Economics Letters, Elsevier, vol. 129(C), pages 62-65.
    13. Kimmo Berg, 2017. "Extremal Pure Strategies and Monotonicity in Repeated Games," Computational Economics, Springer;Society for Computational Economics, vol. 49(3), pages 387-404, March.
    14. Otsu, Taisuke & Pesendorfer, Martin & Takahashi, Yuya, 2013. "Testing for Equilibrium Multiplicity in Dynamic Markov Games," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 423, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    15. Pesendorfer, Martin & Takahashi, Yuya & Otsu, Taisuke, 2014. "Testing Equilibrium Multiplicity in Dynamic Games," CEPR Discussion Papers 10111, C.E.P.R. Discussion Papers.
    16. Aguirregabiria, Victor & Ho, Chun-Yu, 2012. "A dynamic oligopoly game of the US airline industry: Estimation and policy experiments," Journal of Econometrics, Elsevier, vol. 168(1), pages 156-173.
    17. Arpad Abraham & Nicola Pavoni, 2008. "Efficient Allocations with Moral Hazard and Hidden Borrowing and Lending: A Recursive Formulation," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 11(4), pages 781-803, October.
    18. Maican, Florin G., 2012. "From Boom to Bust and Back Again: A dynamic analysis of IT services," Working Papers in Economics 543, University of Gothenburg, Department of Economics.
    19. Yongyang Cai & Yongyang Cai & Kenneth L. Judd, 2017. "Computing Equilibria of Dynamic Games," Operations Research, INFORMS, vol. 65(2), pages 337-356, April.
    20. Gary Gorton & Ping He, 2023. "Optimal monetary policy in a collateralized economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 75(1), pages 55-89, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:mathme:v:78:y:2013:i:1:p:77-100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.