IDEAS home Printed from https://ideas.repec.org/a/kap/qmktec/v17y2019i1d10.1007_s11129-018-9200-x.html
   My bibliography  Save this article

Dynamic stochastic games with random moves

Author

Listed:
  • Ulrich Doraszelski

    (University of Pennsylvania)

  • Kenneth L. Judd

    (Stanford University)

Abstract

We reformulate the quality ladder model of Pakes and McGuire, Rand Journal of Economics, 25(4), 555–589 (1994) as a dynamic stochastic game with random moves in which each period one firm is picked at random to make an investment decision. Contrasting this model to the standard version with simultaneous moves illustrates the computational advantages of random moves. In particular, the quality ladder model with random moves avoids the curse of dimensionality in computing firms’ expectations over all possible future states and is therefore orders of magnitude faster to solve than its counterpart with simultaneous moves when there are more than just a few firms. Perhaps unexpectedly, the equilibria of the quality ladder model with random moves are practically indistinguishable from those of the model with simultaneous moves.

Suggested Citation

  • Ulrich Doraszelski & Kenneth L. Judd, 2019. "Dynamic stochastic games with random moves," Quantitative Marketing and Economics (QME), Springer, vol. 17(1), pages 59-79, March.
    • Handle: RePEc:kap:qmktec:v:17:y:2019:i:1:d:10.1007_s11129-018-9200-x
    DOI: 10.1007/s11129-018-9200-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11129-018-9200-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11129-018-9200-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Maskin, Eric & Tirole, Jean, 1987. "A theory of dynamic oligopoly, III : Cournot competition," European Economic Review, Elsevier, vol. 31(4), pages 947-968, June.
    2. Sridhar Narayanan & Puneet Manchanda, 2009. "Heterogeneous Learning and the Targeting of Marketing Communication for New Products," Marketing Science, INFORMS, vol. 28(3), pages 424-441, 05-06.
    3. David Besanko & Ulrich Doraszelski, 2004. "Capacity Dynamics and Endogenous Asymmetries in Firm Size," RAND Journal of Economics, The RAND Corporation, vol. 35(1), pages 23-49, Spring.
    4. Jiawei Chen & Ulrich Doraszelski & Joseph E. Harrington, Jr., 2009. "Avoiding market dominance: product compatibility in markets with network effects," RAND Journal of Economics, RAND Corporation, vol. 40(3), pages 455-485, September.
    5. Ariel Pakes & Paul McGuire, 1994. "Computing Markov-Perfect Nash Equilibria: Numerical Implications of a Dynamic Differentiated Product Model," RAND Journal of Economics, The RAND Corporation, vol. 25(4), pages 555-589, Winter.
    6. Ronald L. Goettler & Brett R. Gordon, 2011. "Does AMD Spur Intel to Innovate More?," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1141-1200.
    7. Caplin, Andrew & Nalebuff, Barry, 1991. "Aggregation and Imperfect Competition: On the Existence of Equilibrium," Econometrica, Econometric Society, vol. 59(1), pages 25-59, January.
    8. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov‐perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243, June.
    9. Ben Mermelstein & Volker Nocke & Mark A. Satterthwaite & Michael D. Whinston, 2020. "Internal versus External Growth in Industries with Scale Economies: A Computational Model of Optimal Merger Policy," Journal of Political Economy, University of Chicago Press, vol. 128(1), pages 301-341.
    10. Markovich, Sarit & Moenius, Johannes, 2009. "Winning while losing: Competition dynamics in the presence of indirect network effects," International Journal of Industrial Organization, Elsevier, vol. 27(3), pages 346-357, May.
    11. Pakes, Ariel & McGuire, Paul, 2001. "Stochastic Algorithms, Symmetric Markov Perfect Equilibrium, and the 'Curse' of Dimensionality," Econometrica, Econometric Society, vol. 69(5), pages 1261-1281, September.
    12. Mitsuru Igami, 2017. "Estimating the Innovator’s Dilemma: Structural Analysis of Creative Destruction in the Hard Disk Drive Industry, 1981–1998," Journal of Political Economy, University of Chicago Press, vol. 125(3), pages 798-847.
    13. Ulrich Doraszelski & Sarit Markovich, 2007. "Advertising dynamics and competitive advantage," RAND Journal of Economics, RAND Corporation, vol. 38(3), pages 557-592, September.
    14. Peter Arcidiacono & Patrick Bayer & Jason R. Blevins & Paul B. Ellickson, 2016. "Estimation of Dynamic Discrete Choice Models in Continuous Time with an Application to Retail Competition," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(3), pages 889-931.
    15. Mitsuru Igami, 2018. "Industry Dynamics of Offshoring: The Case of Hard Disk Drives," American Economic Journal: Microeconomics, American Economic Association, vol. 10(1), pages 67-101, February.
    16. Ron Borkovsky & Ulrich Doraszelski & Yaroslav Kryukov, 2012. "A dynamic quality ladder model with entry and exit: Exploring the equilibrium correspondence using the homotopy method," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 197-229, June.
    17. Christopher Harris & John Vickers, 1987. "Racing with Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 54(1), pages 1-21.
    18. Fudenberg, Drew & Gilbert, Richard & Stiglitz, Joseph & Tirole, Jean, 1983. "Preemption, leapfrogging and competition in patent races," European Economic Review, Elsevier, vol. 22(1), pages 3-31, June.
    19. Fedor Iskhakov & John Rust & Bertel Schjerning, 2018. "The Dynamics Of Bertrand Price Competition With Cost‐Reducing Investments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(4), pages 1681-1731, November.
    20. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    21. Ron N. Borkovsky, 2017. "The timing of version releases: A dynamic duopoly model," Quantitative Marketing and Economics (QME), Springer, vol. 15(3), pages 187-239, September.
    22. Maskin, Eric & Tirole, Jean, 1988. "A Theory of Dynamic Oligopoly, II: Price Competition, Kinked Demand Curves, and Edgeworth Cycles," Econometrica, Econometric Society, vol. 56(3), pages 571-599, May.
    23. Minjae Song, 2011. "A Dynamic Analysis Of Cooperative Research In The Semiconductor Industry," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 52(4), pages 1157-1177, November.
    24. David Besanko & Ulrich Doraszelski & Lauren Xiaoyuan Lu & Mark Satterthwaite, 2010. "Lumpy Capacity Investment and Disinvestment Dynamics," Operations Research, INFORMS, vol. 58(4-part-2), pages 1178-1193, August.
    25. Jean-Pierre Dubé & Günter Hitsch & Puneet Manchanda, 2005. "An Empirical Model of Advertising Dynamics," Quantitative Marketing and Economics (QME), Springer, vol. 3(2), pages 107-144, June.
    26. Maskin, Eric & Tirole, Jean, 1988. "A Theory of Dynamic Oligopoly, I: Overview and Quantity Competition with Large Fixed Costs," Econometrica, Econometric Society, vol. 56(3), pages 549-569, May.
    27. Gautam Gowrisankaran & Thomas J. Holmes, 2004. "Mergers and the Evolution of Industry Concentration: Results from the Dominant-Firm Model," RAND Journal of Economics, The RAND Corporation, vol. 35(3), pages 561-582, Autumn.
    28. Markovich, Sarit, 2008. "Snowball: A dynamic oligopoly model with indirect network effects," Journal of Economic Dynamics and Control, Elsevier, vol. 32(3), pages 909-938, March.
    29. C. Lanier Benkard, 2004. "A Dynamic Analysis of the Market for Wide-Bodied Commercial Aircraft," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 71(3), pages 581-611.
    30. R. M. Cyert & M. H. DeGroot, 1970. "Multiperiod Decision Models with Alternating Choice as a Solution to the Duopoly Problem," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 84(3), pages 410-429.
    31. Gautam Gowrisankaran, 1999. "A Dynamic Model of Endogenous Horizonal Mergers," RAND Journal of Economics, The RAND Corporation, vol. 30(1), pages 56-83, Spring.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Linli Xu & Jorge M. Silva-Risso & Kenneth C. Wilbur, 2018. "Dynamic Quality Ladder Model Predictions in Nonrandom Holdout Samples," Management Science, INFORMS, vol. 64(7), pages 3187-3207, July.
    2. Ron Borkovsky & Ulrich Doraszelski & Yaroslav Kryukov, 2012. "A dynamic quality ladder model with entry and exit: Exploring the equilibrium correspondence using the homotopy method," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 197-229, June.
    3. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov‐perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243, June.
    4. Doraszelski, Ulrich & Escobar, Juan F., 2019. "Protocol invariance and the timing of decisions in dynamic games," Theoretical Economics, Econometric Society, vol. 14(2), May.
    5. Ron N. Borkovsky, 2017. "The timing of version releases: A dynamic duopoly model," Quantitative Marketing and Economics (QME), Springer, vol. 15(3), pages 187-239, September.
    6. Ronald Goettler & Brett Gordon, 2014. "Competition and product innovation in dynamic oligopoly," Quantitative Marketing and Economics (QME), Springer, vol. 12(1), pages 1-42, March.
    7. Gabriel Y. Weintraub & C. Lanier Benkard & Benjamin Van Roy, 2010. "Computational Methods for Oblivious Equilibrium," Operations Research, INFORMS, vol. 58(4-part-2), pages 1247-1265, August.
    8. Ron N. Borkovsky & Avi Goldfarb & Avery M. Haviv & Sridhar Moorthy, 2017. "Measuring and Understanding Brand Value in a Dynamic Model of Brand Management," Marketing Science, INFORMS, vol. 36(4), pages 471-499, July.
    9. Brett Hollenbeck, 2020. "Horizontal mergers and innovation in concentrated industries," Quantitative Marketing and Economics (QME), Springer, vol. 18(1), pages 1-37, March.
    10. Victor Aguirregabiria & Victor Aguirregabiria & Aviv Nevo & Aviv Nevo, 2010. "Recent Developments in Empirical IO: Dynamic Demand and Dynamic Games," Working Papers tecipa-419, University of Toronto, Department of Economics.
    11. Samano, Mario & Santugini, Marc, 2020. "Long-run market configurations in a dynamic quality-ladder model with externalities," Journal of Economic Dynamics and Control, Elsevier, vol. 117(C).
    12. C. Lanier Benkard & Przemyslaw Jeziorski & Gabriel Y. Weintraub, 2013. "Oblivious Equilibrium for Concentrated Industries," NBER Working Papers 19307, National Bureau of Economic Research, Inc.
    13. Victor Aguirregabiria & Allan Collard-Wexler & Stephen P. Ryan, 2021. "Dynamic Games in Empirical Industrial Organization," NBER Working Papers 29291, National Bureau of Economic Research, Inc.
    14. Doraszelski, Ulrich & Satterthwaite, Mark, 2007. "Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity," CEPR Discussion Papers 6212, C.E.P.R. Discussion Papers.
    15. Ulrich Doraszelski & Mark Satterthwaite, 2007. "Computable Markov-Perfect Industry Dynamics: Existence, Purification, and Multiplicity," Levine's Bibliography 321307000000000912, UCLA Department of Economics.
    16. C. Lanier Benkard & Przemyslaw Jeziorski & Gabriel Y. Weintraub, 2015. "Oblivious equilibrium for concentrated industries," RAND Journal of Economics, RAND Corporation, vol. 46(4), pages 671-708, October.
    17. Mario Samano & Marc Santugini, 2015. "Long-Run Market Configurations in a Dynamic Quality-Ladder Model with Heterogeneity," Cahiers de recherche 1503, CIRPEE.
    18. Pakes, Ariel, 2017. "Empirical tools and competition analysis: Past progress and current problems," International Journal of Industrial Organization, Elsevier, vol. 53(C), pages 241-266.
    19. Narajabad, Borghan & Watson, Randal, 2011. "The dynamics of innovation and horizontal differentiation," Journal of Economic Dynamics and Control, Elsevier, vol. 35(6), pages 825-842, June.
    20. Joao Macieira, 2010. "Oblivious Equilibrium in Dynamic Discrete Games," 2010 Meeting Papers 680, Society for Economic Dynamics.

    More about this item

    Keywords

    Dynamic stochastic games; Markov perfect equilibrium; Curse of dimensionality; Protocol of moves;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • L13 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Oligopoly and Other Imperfect Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:qmktec:v:17:y:2019:i:1:d:10.1007_s11129-018-9200-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.