IDEAS home Printed from https://ideas.repec.org/p/zbw/vfsc19/203603.html
   My bibliography  Save this paper

Markov Quantal Response Equilibrium and a Homotopy Method for Computing and Selecting Markov Perfect Equilibria of Dynamic Stochastic Games

Author

Listed:
  • Eibelshäuser, Steffen
  • Poensgen, David

Abstract

We formally define Markov quantal response equilibrium (QRE) and prove existence for all finite discounted dynamic stochastic games. The special case of logit Markov QRE constitutes a mapping from precision parameter ... to sets of logit Markov QRE. The limiting points of this correspondence are shown to be Markov perfect equilibria. Furthermore, the logit Markov QRE correspondence can be given a homotopy interpretation. We prove that for all games, this homotopy contains a branch connecting the unique solution at ...to a unique limiting Markov perfect equilibrium. This result can be leveraged both for the computation of Markov perfect equilibria, and also as a selection criterion.

Suggested Citation

  • Eibelshäuser, Steffen & Poensgen, David, 2019. "Markov Quantal Response Equilibrium and a Homotopy Method for Computing and Selecting Markov Perfect Equilibria of Dynamic Stochastic Games," VfS Annual Conference 2019 (Leipzig): 30 Years after the Fall of the Berlin Wall - Democracy and Market Economy 203603, Verein für Socialpolitik / German Economic Association.
    • Handle: RePEc:zbw:vfsc19:203603
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/203603/1/VfS-2019-pid-27973.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John C. Harsanyi & Reinhard Selten, 1988. "A General Theory of Equilibrium Selection in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262582384, December.
    2. Herings, P. Jean-Jacques & Peeters, Ronald J. A. P., 2004. "Stationary equilibria in stochastic games: structure, selection, and computation," Journal of Economic Theory, Elsevier, vol. 118(1), pages 32-60, September.
    3. Ariel Pakes & Paul McGuire, 1994. "Computing Markov-Perfect Nash Equilibria: Numerical Implications of a Dynamic Differentiated Product Model," RAND Journal of Economics, The RAND Corporation, vol. 25(4), pages 555-589, Winter.
    4. , & ,, 2010. "A theory of regular Markov perfect equilibria in dynamic stochastic games: genericity, stability, and purification," Theoretical Economics, Econometric Society, vol. 5(3), September.
    5. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    6. Zhang, Boyu, 2016. "Quantal response methods for equilibrium selection in normal form games," Journal of Mathematical Economics, Elsevier, vol. 64(C), pages 113-123.
    7. Yves Breitmoser & Jonathan H. W. Tan & Daniel John Zizzo, 2008. "Understanding Perpetual R and D Races," Working Paper series, University of East Anglia, Centre for Competition Policy (CCP) 2008-22, Centre for Competition Policy, University of East Anglia, Norwich, UK..
    8. Yves Breitmoser & Jonathan Tan & Daniel Zizzo, 2010. "Understanding perpetual R&D races," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 44(3), pages 445-467, September.
    9. Turocy, Theodore L., 2005. "A dynamic homotopy interpretation of the logistic quantal response equilibrium correspondence," Games and Economic Behavior, Elsevier, vol. 51(2), pages 243-263, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Peixuan Li & Chuangyin Dang & P. Jean-Jacques Herings, 2024. "Computing perfect stationary equilibria in stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 78(2), pages 347-387, September.
    2. Chuangyin Dang & P. Jean-Jacques Herings & Peixuan Li, 2022. "An Interior-Point Differentiable Path-Following Method to Compute Stationary Equilibria in Stochastic Games," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1403-1418, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steffen Eibelshäuser & Victor Klockmann & David Poensgen & Alicia von Schenk, 2023. "The Logarithmic Stochastic Tracing Procedure: A Homotopy Method to Compute Stationary Equilibria of Stochastic Games," INFORMS Journal on Computing, INFORMS, vol. 35(6), pages 1511-1526, November.
    2. P. Herings & Ronald Peeters, 2010. "Homotopy methods to compute equilibria in game theory," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(1), pages 119-156, January.
    3. Cao, Yiyin & Dang, Chuangyin, 2022. "A variant of Harsanyi's tracing procedures to select a perfect equilibrium in normal form games," Games and Economic Behavior, Elsevier, vol. 134(C), pages 127-150.
    4. Zhang, Boyu & Hofbauer, Josef, 2016. "Quantal response methods for equilibrium selection in 2×2 coordination games," Games and Economic Behavior, Elsevier, vol. 97(C), pages 19-31.
    5. Kets, W. & Voorneveld, M., 2007. "Congestion, Equilibrium and Learning : The Minority Game," Other publications TiSEM 49539a1f-2921-4dd9-83a0-4, Tilburg University, School of Economics and Management.
    6. Yves Breitmoser, 2012. "Proto-coalition bargaining and the core," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 51(3), pages 581-599, November.
    7. Peixuan Li & Chuangyin Dang & P. Jean-Jacques Herings, 2024. "Computing perfect stationary equilibria in stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 78(2), pages 347-387, September.
    8. Govindan, Srihari & Wilson, Robert, 2009. "Global Newton Method for stochastic games," Journal of Economic Theory, Elsevier, vol. 144(1), pages 414-421, January.
    9. Cason, Timothy N. & Lau, Sau-Him Paul & Mui, Vai-Lam, 2019. "Prior interaction, identity, and cooperation in the Inter-group Prisoner's Dilemma," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 613-629.
    10. Yves Breitmoser, 2015. "Cooperation, but No Reciprocity: Individual Strategies in the Repeated Prisoner's Dilemma," American Economic Review, American Economic Association, vol. 105(9), pages 2882-2910, September.
    11. Friedel Bolle & Jörg Spiller, 2021. "Cooperation against all predictions," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 904-924, July.
    12. He, Simin & Wu, Jiabin, 2020. "Compromise and coordination: An experimental study," Games and Economic Behavior, Elsevier, vol. 119(C), pages 216-233.
    13. Zhang, Boyu, 2016. "Quantal response methods for equilibrium selection in normal form games," Journal of Mathematical Economics, Elsevier, vol. 64(C), pages 113-123.
    14. repec:wsi:jeapmx:v:20:y:2018:i:04:n:s0219198918500081 is not listed on IDEAS
    15. Kendall, Ryan, 2021. "Sequential competitions with a middle-mover advantage," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 91(C).
    16. Kets, W., 2008. "Networks and learning in game theory," Other publications TiSEM 7713fce1-3131-498c-8c6f-3, Tilburg University, School of Economics and Management.
    17. Bosch-Domènech, Antoni & Vriend, Nicolaas J., 2013. "On the role of non-equilibrium focal points as coordination devices," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 52-67.
    18. Dieter Balkenborg & Rosemarie Nagel, 2016. "An Experiment on Forward vs. Backward Induction: How Fairness and Level k Reasoning Matter," German Economic Review, Verein für Socialpolitik, vol. 17(3), pages 378-408, August.
    19. Haruvy, Ernan & Stahl, Dale O., 2007. "Equilibrium selection and bounded rationality in symmetric normal-form games," Journal of Economic Behavior & Organization, Elsevier, vol. 62(1), pages 98-119, January.
    20. Philippe Bich, 2016. "Prudent Equilibria and Strategic Uncertainty in Discontinuous Games," Working Papers halshs-01337293, HAL.
    21. Jayakumar Subramanian & Amit Sinha & Aditya Mahajan, 2023. "Robustness and Sample Complexity of Model-Based MARL for General-Sum Markov Games," Dynamic Games and Applications, Springer, vol. 13(1), pages 56-88, March.

    More about this item

    Keywords

    Homotopy continuation; Stationary equilibrium; Logit choice;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:vfsc19:203603. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.