IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v61y2013i4p971-989.html
   My bibliography  Save this article

Mean Field Equilibrium in Dynamic Games with Strategic Complementarities

Author

Listed:
  • Sachin Adlakha

    (Center for Mathematics of Information, California Institute of Technology, Pasadena, California 91125)

  • Ramesh Johari

    (Department of Management Science and Engineering, Stanford University, Stanford, California 94305)

Abstract

We study a class of stochastic dynamic games that exhibit strategic complementarities between players; formally, in the games we consider, the payoff of a player has increasing differences between her own state and the empirical distribution of the states of other players. Such games can be used to model a diverse set of applications, including network security models, recommender systems, and dynamic search in markets. Stochastic games are generally difficult to analyze, and these difficulties are only exacerbated when the number of players is large (as might be the case in the preceding examples).We consider an approximation methodology called mean field equilibrium to study these games. In such an equilibrium, each player reacts to only the long-run average state of other players. We find necessary conditions for the existence of a mean field equilibrium in such games. Furthermore, as a simple consequence of this existence theorem, we obtain several natural monotonicity properties. We show that there exist a “largest” and a “smallest” equilibrium among all those where the equilibrium strategy used by a player is nondecreasing, and we also show that players converge to each of these equilibria via natural myopic learning dynamics ; as we argue, these dynamics are more reasonable than the standard best-response dynamics. We also provide sensitivity results, where we quantify how the equilibria of such games move in response to changes in parameters of the game (for example, the introduction of incentives to players).

Suggested Citation

  • Sachin Adlakha & Ramesh Johari, 2013. "Mean Field Equilibrium in Dynamic Games with Strategic Complementarities," Operations Research, INFORMS, vol. 61(4), pages 971-989, August.
  • Handle: RePEc:inm:oropre:v:61:y:2013:i:4:p:971-989
    DOI: 10.1287/opre.2013.1192
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.2013.1192
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.2013.1192?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Doraszelski, Ulrich & Pakes, Ariel, 2007. "A Framework for Applied Dynamic Analysis in IO," Handbook of Industrial Organization, in: Mark Armstrong & Robert Porter (ed.), Handbook of Industrial Organization, edition 1, volume 3, chapter 30, pages 1887-1966, Elsevier.
    2. Bergin, J & Bernhardt, D, 1995. "Anonymous Sequential Games: Existence and Characterization of Equilibria," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 5(3), pages 461-489, May.
    3. Gabriel Y. Weintraub & C. Lanier Benkard & Benjamin Van Roy, 2008. "Markov Perfect Industry Dynamics With Many Firms," Econometrica, Econometric Society, vol. 76(6), pages 1375-1411, November.
    4. Jovanovic, Boyan & Rosenthal, Robert W., 1988. "Anonymous sequential games," Journal of Mathematical Economics, Elsevier, vol. 17(1), pages 77-87, February.
    5. Darrell Duffie & Semyon Malamud & Gustavo Manso, 2009. "Information Percolation With Equilibrium Search Dynamics," Econometrica, Econometric Society, vol. 77(5), pages 1513-1574, September.
    6. Zhou Lin, 1994. "The Set of Nash Equilibria of a Supermodular Game Is a Complete Lattice," Games and Economic Behavior, Elsevier, vol. 7(2), pages 295-300, September.
    7. Pakes, Ariel & McGuire, Paul, 2001. "Stochastic Algorithms, Symmetric Markov Perfect Equilibrium, and the 'Curse' of Dimensionality," Econometrica, Econometric Society, vol. 69(5), pages 1261-1281, September.
    8. Diamond, Peter A, 1982. "Aggregate Demand Management in Search Equilibrium," Journal of Political Economy, University of Chicago Press, vol. 90(5), pages 881-894, October.
    9. Dutta, Prajit K. & Majumdar, Mukul K. & Sundaram, Rangarajan K., 1994. "Parametric continuity in dynamic programming problems," Journal of Economic Dynamics and Control, Elsevier, vol. 18(6), pages 1069-1092, November.
    10. Terry L. Friesz & David Bernstein & Tony E. Smith & Roger L. Tobin & B. W. Wie, 1993. "A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem," Operations Research, INFORMS, vol. 41(1), pages 179-191, February.
    11. Federico Echenique, 2003. "Mixed equilibria in games of strategic complementarities," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 22(1), pages 33-44, August.
    12. Acemoglu, Daron & Jensen, Martin Kaae, 2013. "Aggregate comparative statics," Games and Economic Behavior, Elsevier, vol. 81(C), pages 27-49.
    13. Chakrabarti, Subir K., 2003. "Pure strategy Markov equilibrium in stochastic games with a continuum of players," Journal of Mathematical Economics, Elsevier, vol. 39(7), pages 693-724, September.
    14. Hopenhayn, Hugo A & Prescott, Edward C, 1992. "Stochastic Monotonicity and Stationary Distributions for Dynamic Economies," Econometrica, Econometric Society, vol. 60(6), pages 1387-1406, November.
    15. Rabah Amir, 2002. "Complementarity and Diagonal Dominance in Discounted Stochastic Games," Annals of Operations Research, Springer, vol. 114(1), pages 39-56, August.
    16. Federico Echenique & Aaron Edlin, 2001. "Mixed Equilibria in Games of Strategic Complements are Unstable," Levine's Working Paper Archive 563824000000000161, David K. Levine.
    17. James E. Smith & Kevin F. McCardle, 2002. "Structural Properties of Stochastic Dynamic Programs," Operations Research, INFORMS, vol. 50(5), pages 796-809, October.
    18. Vives, Xavier, 1990. "Nash equilibrium with strategic complementarities," Journal of Mathematical Economics, Elsevier, vol. 19(3), pages 305-321.
    19. Kunreuther, Howard & Heal, Geoffrey, 2003. "Interdependent Security," Journal of Risk and Uncertainty, Springer, vol. 26(2-3), pages 231-249, March-May.
    20. Xavier Vives, 2009. "Strategic complementarity in multi-stage games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 40(1), pages 151-171, July.
    21. Minyi Huang & Roland P. Malhamé & Peter E. Caines, 2005. "Nash Equilibria for Large-Population Linear Stochastic Systems of Weakly Coupled Agents," Springer Books, in: El Kébir Boukas & Roland P. Malhamé (ed.), Analysis, Control and Optimization of Complex Dynamic Systems, chapter 0, pages 215-252, Springer.
    22. Horst, Ulrich, 2005. "Stationary equilibria in discounted stochastic games with weakly interacting players," Games and Economic Behavior, Elsevier, vol. 51(1), pages 83-108, April.
    23. Milgrom, Paul & Roberts, John, 1990. "Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities," Econometrica, Econometric Society, vol. 58(6), pages 1255-1277, November.
    24. Curtat, Laurent O., 1996. "Markov Equilibria of Stochastic Games with Complementarities," Games and Economic Behavior, Elsevier, vol. 17(2), pages 177-199, December.
    25. Hopenhayn, Hugo A, 1992. "Entry, Exit, and Firm Dynamics in Long Run Equilibrium," Econometrica, Econometric Society, vol. 60(5), pages 1127-1150, September.
    26. Andrzej Nowak, 2007. "On stochastic games in economics," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 66(3), pages 513-530, December.
    27. Weintraub, Gabriel Y. & Benkard, C. Lanier & Van Roy, Benjamin, 2011. "Industry dynamics: Foundations for models with an infinite number of firms," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1965-1994, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adlakha, Sachin & Johari, Ramesh & Weintraub, Gabriel Y., 2015. "Equilibria of dynamic games with many players: Existence, approximation, and market structure," Journal of Economic Theory, Elsevier, vol. 156(C), pages 269-316.
    2. Piotr Więcek, 2017. "Total Reward Semi-Markov Mean-Field Games with Complementarity Properties," Dynamic Games and Applications, Springer, vol. 7(3), pages 507-529, September.
    3. Light, Bar & Weintraub, Gabriel, 2018. "Mean Field Equilibrium: Uniqueness, Existence, and Comparative Statics," Research Papers 3731, Stanford University, Graduate School of Business.
    4. Piotr Więcek & Eitan Altman, 2015. "Stationary Anonymous Sequential Games with Undiscounted Rewards," Journal of Optimization Theory and Applications, Springer, vol. 166(2), pages 686-710, August.
    5. Vives, Xavier & Vravosinos, Orestis, 2024. "Strategic complementarity in games," Journal of Mathematical Economics, Elsevier, vol. 113(C).
    6. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    7. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    8. John Duggan, 2011. "Noisy Stochastic Games," RCER Working Papers 562, University of Rochester - Center for Economic Research (RCER).
    9. Mirman, Leonard J. & Morand, Olivier F. & Reffett, Kevin L., 2008. "A qualitative approach to Markovian equilibrium in infinite horizon economies with capital," Journal of Economic Theory, Elsevier, vol. 139(1), pages 75-98, March.
    10. Rabah Amir, 2005. "Supermodularity and Complementarity in Economics: An Elementary Survey," Southern Economic Journal, John Wiley & Sons, vol. 71(3), pages 636-660, January.
    11. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov‐perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243, June.
    12. Cao, Zhigang & Chen, Xujin & Qin, Cheng-Zhong & Wang, Changjun & Yang, Xiaoguang, 2018. "Embedding games with strategic complements into games with strategic substitutes," Journal of Mathematical Economics, Elsevier, vol. 78(C), pages 45-51.
    13. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2013. "Markov Stationary Equilibria in Stochastic Supermodular Games with Imperfect Private and Public Information," Dynamic Games and Applications, Springer, vol. 3(2), pages 187-206, June.
    14. Rabah Amir, 2018. "Special issue: supermodularity and monotone methods in economics," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(3), pages 547-556, October.
    15. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    16. Krishnamurthy Iyer & Ramesh Johari & Mukund Sundararajan, 2014. "Mean Field Equilibria of Dynamic Auctions with Learning," Management Science, INFORMS, vol. 60(12), pages 2949-2970, December.
    17. Anna Jaśkiewicz & Andrzej S. Nowak, 2016. "Stationary Almost Markov Perfect Equilibria in Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 41(2), pages 430-441, May.
    18. Jian Yang, 2017. "A link between sequential semi-anonymous nonatomic games and their large finite counterparts," International Journal of Game Theory, Springer;Game Theory Society, vol. 46(2), pages 383-433, May.
    19. Lu Yu, 2024. "Nash equilibria of quasisupermodular games," Papers 2406.13783, arXiv.org.
    20. Ulrich Doraszelski & Mark Satterthwaite, 2003. "Foundations of Markov-Perfect Industry Dynamics. Existence, Purification, and Multiplicity," Discussion Papers 1383, Northwestern University, Center for Mathematical Studies in Economics and Management Science.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:61:y:2013:i:4:p:971-989. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.