IDEAS home Printed from https://ideas.repec.org/a/eee/jetheo/v144y2009i1p414-421.html
   My bibliography  Save this article

Global Newton Method for stochastic games

Author

Listed:
  • Govindan, Srihari
  • Wilson, Robert

Abstract

The Global Newton Method for games in normal form and in extensive form is shown to have a natural extension to computing Markov-perfect equilibria of stochastic games.

Suggested Citation

  • Govindan, Srihari & Wilson, Robert, 2009. "Global Newton Method for stochastic games," Journal of Economic Theory, Elsevier, vol. 144(1), pages 414-421, January.
    • Handle: RePEc:eee:jetheo:v:144:y:2009:i:1:p:414-421
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0022-0531(08)00081-1
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Herings, P. Jean-Jacques & Peeters, Ronald J. A. P., 2004. "Stationary equilibria in stochastic games: structure, selection, and computation," Journal of Economic Theory, Elsevier, vol. 118(1), pages 32-60, September.
    2. Ariel Pakes & Paul McGuire, 1994. "Computing Markov-Perfect Nash Equilibria: Numerical Implications of a Dynamic Differentiated Product Model," RAND Journal of Economics, The RAND Corporation, vol. 25(4), pages 555-589, Winter.
    3. Doraszelski, Ulrich & Pakes, Ariel, 2007. "A Framework for Applied Dynamic Analysis in IO," Handbook of Industrial Organization, in: Mark Armstrong & Robert Porter (ed.), Handbook of Industrial Organization, edition 1, volume 3, chapter 30, pages 1887-1966, Elsevier.
    4. Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, September.
    5. Gabriel Y. Weintraub & C. Lanier Benkard & Benjamin Van Roy, 2008. "Markov Perfect Industry Dynamics With Many Firms," Econometrica, Econometric Society, vol. 76(6), pages 1375-1411, November.
    6. , & ,, 2010. "A theory of regular Markov perfect equilibria in dynamic stochastic games: genericity, stability, and purification," Theoretical Economics, Econometric Society, vol. 5(3), September.
    7. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, April.
    8. Pakes, Ariel & McGuire, Paul, 2001. "Stochastic Algorithms, Symmetric Markov Perfect Equilibrium, and the 'Curse' of Dimensionality," Econometrica, Econometric Society, vol. 69(5), pages 1261-1281, September.
    9. Govindan, Srihari & Wilson, Robert, 2003. "A global Newton method to compute Nash equilibria," Journal of Economic Theory, Elsevier, vol. 110(1), pages 65-86, May.
    10. P. Jean-Jacques Herings & Ronald J. A. P. Peeters, 2003. "Equilibrium Selection In Stochastic Games," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 5(04), pages 307-326.
    11. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, vol. 75(1), pages 1-53, January.
    12. Hans Haller & Roger Lagunoff, 2000. "Genericity and Markovian Behavior in Stochastic Games," Econometrica, Econometric Society, vol. 68(5), pages 1231-1248, September.
    13. Ulrich Doraszelski & Mark Satterthwaite, 2007. "Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity," Levine's Bibliography 321307000000000912, UCLA Department of Economics.
    14. Kohlberg, Elon & Mertens, Jean-Francois, 1986. "On the Strategic Stability of Equilibria," Econometrica, Econometric Society, vol. 54(5), pages 1003-1037, September.
    15. Doraszelski, Ulrich & Satterthwaite, Mark, 2007. "Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity," CEPR Discussion Papers 6212, C.E.P.R. Discussion Papers.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Peixuan Li & Chuangyin Dang & P. Jean-Jacques Herings, 2024. "Computing perfect stationary equilibria in stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 78(2), pages 347-387, September.
    2. Sun, Lan, 2016. "Hypothesis testing equilibrium in signaling games," Center for Mathematical Economics Working Papers 557, Center for Mathematical Economics, Bielefeld University.
    3. Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    4. Herings, P. Jean-Jacques & Zhan, Yang, 2021. "The computation of pairwise stable networks," Research Memorandum 004, Maastricht University, Graduate School of Business and Economics (GSBE).
    5. Eilon Solan & Omri N. Solan, 2021. "Sunspot equilibrium in positive recursive general quitting games," International Journal of Game Theory, Springer;Game Theory Society, vol. 50(4), pages 891-909, December.
    6. Chuangyin Dang & P. Jean-Jacques Herings & Peixuan Li, 2022. "An Interior-Point Differentiable Path-Following Method to Compute Stationary Equilibria in Stochastic Games," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1403-1418, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ulrich Doraszelski & Mark Satterthwaite, 2007. "Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity," Levine's Bibliography 321307000000000912, UCLA Department of Economics.
    2. , & ,, 2010. "A theory of regular Markov perfect equilibria in dynamic stochastic games: genericity, stability, and purification," Theoretical Economics, Econometric Society, vol. 5(3), September.
    3. Doraszelski, Ulrich & Satterthwaite, Mark, 2007. "Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity," CEPR Discussion Papers 6212, C.E.P.R. Discussion Papers.
    4. Doraszelski, Ulrich & Kryukov, Yaroslav & Borkovsky, Ron N., 2008. "A User's Guide to Solving Dynamic Stochastic Games Using the Homotopy Method," CEPR Discussion Papers 6733, C.E.P.R. Discussion Papers.
    5. Ron N. Borkovsky & Ulrich Doraszelski & Yaroslav Kryukov, "undated". "A User''s Guide to Solving Dynamic Stochastic Games Using the Homotopy Method," GSIA Working Papers 2009-E23, Carnegie Mellon University, Tepper School of Business.
    6. C. Lanier Benkard & Przemyslaw Jeziorski & Gabriel Y. Weintraub, 2013. "Oblivious Equilibrium for Concentrated Industries," NBER Working Papers 19307, National Bureau of Economic Research, Inc.
    7. Vivek Farias & Bar Ifrach & Gabriel Weintraub, 2012. "A Framework for Dynamic Oligopoly in Concentrated Industries," 2012 Meeting Papers 505, Society for Economic Dynamics.
    8. Ron Borkovsky & Ulrich Doraszelski & Yaroslav Kryukov, 2012. "A dynamic quality ladder model with entry and exit: Exploring the equilibrium correspondence using the homotopy method," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 197-229, June.
    9. Ulrich Doraszelski & Kenneth L. Judd, 2012. "Avoiding the curse of dimensionality in dynamic stochastic games," Quantitative Economics, Econometric Society, vol. 3(1), pages 53-93, March.
    10. Aamir Rafique Hashmi & Johannes Van Biesebroeck, 2016. "The Relationship between Market Structure and Innovation in Industry Equilibrium: A Case Study of the Global Automobile Industry," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 192-208, March.
    11. Jiawei Chen & Ulrich Doraszelski & Joseph E. Harrington, Jr., 2009. "Avoiding market dominance: product compatibility in markets with network effects," RAND Journal of Economics, RAND Corporation, vol. 40(3), pages 455-485, September.
    12. Doraszelski, Ulrich & Escobar, Juan F., 2019. "Protocol invariance and the timing of decisions in dynamic games," Theoretical Economics, Econometric Society, vol. 14(2), May.
    13. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov‐perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243, June.
    14. Victor Aguirregabiria & Gustavo Vicentini, 2006. "Dynamic Spatial Competition Between Multi-Store Firms," Working Papers tecipa-253, University of Toronto, Department of Economics.
    15. C. Lanier Benkard & Przemyslaw Jeziorski & Gabriel Y. Weintraub, 2015. "Oblivious equilibrium for concentrated industries," RAND Journal of Economics, RAND Corporation, vol. 46(4), pages 671-708, October.
    16. Weintraub, Gabriel Y. & Benkard, C. Lanier & Van Roy, Benjamin, 2007. "Computational Methods for Oblivious Equilibrium," Research Papers 1969, Stanford University, Graduate School of Business.
    17. Linli Xu & Jorge M. Silva-Risso & Kenneth C. Wilbur, 2018. "Dynamic Quality Ladder Model Predictions in Nonrandom Holdout Samples," Management Science, INFORMS, vol. 64(7), pages 3187-3207, July.
    18. Weintraub, Gabriel Y. & Benkard, C. Lanier & Van Roy, Benjamin, 2007. "Markov Perfect Industry Dynamics with Many Firms," Research Papers 1919r, Stanford University, Graduate School of Business.
    19. Ulrich Doraszelski & Mark Satterthwaite, 2003. "Foundations of Markov-Perfect Industry Dynamics. Existence, Purification, and Multiplicity," Discussion Papers 1383, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    20. Pakes, Ariel, 2017. "Empirical tools and competition analysis: Past progress and current problems," International Journal of Industrial Organization, Elsevier, vol. 53(C), pages 241-266.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jetheo:v:144:y:2009:i:1:p:414-421. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622869 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.