IDEAS home Printed from https://ideas.repec.org/p/cor/louvco/2001060.html
   My bibliography  Save this paper

Stochastic games in economics and related fields: an overview

Author

Listed:
  • AMIR, Rabah

Abstract

This survey provides an extensive account of research in economics based on the stochastic games paradigm. Its area-by-area coverage is in the form of an overview, and includes applications in resource economics, industrial organization, macroeconomics, market games, experimental and empirical economics. For methodologically defined frameworks, the coverage is somewhat more detailed (to the extent that the material is not covered elsewhere in this volume), and includes the open-loop concept, the linear-quadratic model, myopic equilibrium, games of perfect information, and stochastic games with a continuum of players.

Suggested Citation

  • AMIR, Rabah, 2001. "Stochastic games in economics and related fields: an overview," LIDAM Discussion Papers CORE 2001060, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    • Handle: RePEc:cor:louvco:2001060
    as

    Download full text from publisher

    File URL: https://sites.uclouvain.be/core/publications/coredp/coredp2001.html
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bergin, James & Bernhardt, Dan, 1992. "Anonymous sequential games with aggregate uncertainty," Journal of Mathematical Economics, Elsevier, vol. 21(6), pages 543-562.
    2. Claudia Keser & Roy Gardner, 1999. "Strategic behavior of experienced subjects in a common pool resource game," International Journal of Game Theory, Springer;Game Theory Society, vol. 28(2), pages 241-252.
    3. Walker, Mark & Wooders, John & Amir, Rabah, 2011. "Equilibrium play in matches: Binary Markov games," Games and Economic Behavior, Elsevier, vol. 71(2), pages 487-502, March.
    4. Hellwig, Martin & Leininger, Wolfgang, 1987. "On the existence of subgame-perfect equilibrium in infinite-action games of perfect information," Journal of Economic Theory, Elsevier, vol. 43(1), pages 55-75, October.
    5. A. Michael Spence, 1979. "Investment Strategy and Growth in a New Market," Bell Journal of Economics, The RAND Corporation, vol. 10(1), pages 1-19, Spring.
    6. Pakes, Ariel & Ericson, Richard, 1998. "Empirical Implications of Alternative Models of Firm Dynamics," Journal of Economic Theory, Elsevier, vol. 79(1), pages 1-45, March.
    7. Barro, Robert J & Gordon, David B, 1983. "A Positive Theory of Monetary Policy in a Natural Rate Model," Journal of Political Economy, University of Chicago Press, vol. 91(4), pages 589-610, August.
    8. Joseph Farrell & Carl Shapiro, 1988. "Dynamic Competition with Switching Costs," RAND Journal of Economics, The RAND Corporation, vol. 19(1), pages 123-137, Spring.
    9. Bergin, J & Bernhardt, D, 1995. "Anonymous Sequential Games: Existence and Characterization of Equilibria," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 5(3), pages 461-489, May.
    10. Karatzas, Ioannis & Shubik, Martin & Sudderth, William D., 1997. "A strategic market game with secured lending," Journal of Mathematical Economics, Elsevier, vol. 28(2), pages 207-247, September.
    11. Rabah Amir & Niels Nannerup, 2006. "Information Structure and the Tragedy of the Commons in Resource Extraction," Journal of Bioeconomics, Springer, vol. 8(2), pages 147-165, August.
    12. Kirman, Alan P & Sobel, Matthew J, 1974. "Dynamic Oligopoly with Inventories," Econometrica, Econometric Society, vol. 42(2), pages 279-287, March.
    13. Fershtman, Chaim & Kamien, Morton I, 1987. "Dynamic Duopolistic Competition with Sticky Prices," Econometrica, Econometric Society, vol. 55(5), pages 1151-1164, September.
    14. Dutta, Prajit K & Sundaram, Rangarajan K, 1993. "The Tragedy of the Commons?," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 3(3), pages 413-426, July.
    15. Reinganum, Jennifer F., 1981. "Dynamic games of innovation," Journal of Economic Theory, Elsevier, vol. 25(1), pages 21-41, August.
    16. Amir, Rabah & Wooders, John, 2000. "One-Way Spillovers, Endogenous Innovator/Imitator Roles, and Research Joint Ventures," Games and Economic Behavior, Elsevier, vol. 31(1), pages 1-25, April.
    17. Therese Flaherty, M., 1980. "Dynamic limit pricing, barriers to entry, and rational firms," Journal of Economic Theory, Elsevier, vol. 23(2), pages 160-182, October.
    18. Jensen, Henrik & Lockwood, Ben, 1998. "A note on discontinuous value functions and strategies in affine-quadratic differential games," Economics Letters, Elsevier, vol. 61(3), pages 301-306, December.
    19. Val Eugene Lambson, 1992. "Competitive Profits in the Long Run," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 59(1), pages 125-142.
    20. Salant, Stephen W, 1976. "Exhaustible Resources and Industrial Structure: A Nash-Cournot Approach to the World Oil Market," Journal of Political Economy, University of Chicago Press, vol. 84(5), pages 1079-1093, October.
    21. Robin Lindsey, 1989. "Import Disruptions, Exhaustible Resources, and Intertemporal Security of Supply," Canadian Journal of Economics, Canadian Economics Association, vol. 22(2), pages 340-363, May.
    22. AMIR, Rabah, 2001. "Stochastic games in economics: the lattice-theoretic approach," LIDAM Discussion Papers CORE 2001059, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    23. Reinganum, Jennifer F, 1982. "A Dynamic Game of R and D: Patent Protection and Competitive Behavior," Econometrica, Econometric Society, vol. 50(3), pages 671-688, May.
    24. Herr, Andrew & Gardner, Roy & Walker, James M., 1997. "An Experimental Study of Time-Independent and Time-Dependent Externalities in the Commons," Games and Economic Behavior, Elsevier, vol. 19(1), pages 77-96, April.
    25. James A. Brander & Barbara J. Spencer, 1983. "Strategic Commitment with R&D: The Symmetric Case," Bell Journal of Economics, The RAND Corporation, vol. 14(1), pages 225-235, Spring.
    26. Ioannis Karatzas & Martin Shubik & William D. Sudderth, 1994. "Construction of Stationary Markov Equilibria in a Strategic Market Game," Mathematics of Operations Research, INFORMS, vol. 19(4), pages 975-1006, November.
    27. Athey, Susan & Schmutzler, Armin, 2001. "Investment and Market Dominance," RAND Journal of Economics, The RAND Corporation, vol. 32(1), pages 1-26, Spring.
    28. Christopher Harris & John Vickers, 1987. "Racing with Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 54(1), pages 1-21.
    29. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    30. Margaret E. Slade, 1995. "Empirical Games: The Oligopoly Case," Canadian Journal of Economics, Canadian Economics Association, vol. 28(2), pages 368-402, May.
    31. Blonski, Matthias, 1999. "When is rational behavior consistent with rules of thumb? a link between evolutionary terminology and neoclassical methodology," Journal of Mathematical Economics, Elsevier, vol. 32(1), pages 131-144, August.
    32. Chen, Yongmin & Rosenthal, Robert W., 1996. "Dynamic duopoly with slowly changing customer loyalties," International Journal of Industrial Organization, Elsevier, vol. 14(3), pages 269-296, May.
    33. Tom Lee & Louis L. Wilde, 1980. "Market Structure and Innovation: A Reformulation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 94(2), pages 429-436.
    34. Dutta, Prajit K & Sundaram, Rangarajan, 1992. "Markovian Equilibrium in a Class of Stochastic Games: Existence Theorems for Discounted and Undiscounted Models," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 2(2), pages 197-214, April.
    35. Beggs, Alan W & Klemperer, Paul, 1992. "Multi-period Competition with Switching Costs," Econometrica, Econometric Society, vol. 60(3), pages 651-666, May.
    36. Monahan George E. & Sobel Matthew J., 1994. "Stochastic Dynamic Market Share Attraction Games," Games and Economic Behavior, Elsevier, vol. 6(1), pages 130-149, January.
    37. Fischer, Ronald D. & Mirman, Leonard J., 1996. "The Compleat Fish Wars: Biological and Dynamic Interactions," Journal of Environmental Economics and Management, Elsevier, vol. 30(1), pages 34-42, January.
    38. Reinganum, Jennifer F & Stokey, Nancy L, 1985. "Oligopoly Extraction of a Common Property Natural Resource: The Importance of the Period of Commitment in Dynamic Games," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 26(1), pages 161-173, February.
    39. Jonathan Cave, 1987. "Long-Term Competition in a Dynamic Game: The Cold Fish War," RAND Journal of Economics, The RAND Corporation, vol. 18(4), pages 596-610, Winter.
    40. Cabral, Luis M B & Riordan, Michael H, 1994. "The Learning Curve, Market Dominance, and Predatory Pricing," Econometrica, Econometric Society, vol. 62(5), pages 1115-1140, September.
    41. Jovanovic, Boyan, 1982. "Selection and the Evolution of Industry," Econometrica, Econometric Society, vol. 50(3), pages 649-670, May.
    42. Spence, Michael, 1984. "Cost Reduction, Competition, and Industry Performance," Econometrica, Econometric Society, vol. 52(1), pages 101-121, January.
    43. Mark Walker & John Wooders, 2001. "Minimax Play at Wimbledon," American Economic Review, American Economic Association, vol. 91(5), pages 1521-1538, December.
    44. Keser, Claudia, 1993. "Some Results of Experimental Duopoly Markets with Demand Intertia," Journal of Industrial Economics, Wiley Blackwell, vol. 41(2), pages 133-151, June.
    45. Tracy R. Lewis & Richard Schmalensee, 1980. "On Oligopolistic Markets for Nonrenewable Natural Resources," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 95(3), pages 475-491.
    46. Hopenhayn, Hugo A, 1992. "Entry, Exit, and Firm Dynamics in Long Run Equilibrium," Econometrica, Econometric Society, vol. 60(5), pages 1127-1150, September.
    47. Margaret E. Slade & G.R.E.Q.A.M., 1998. "Optimal Pricing with Costly Adjustment: Evidence from Retail-Grocery Prices," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(1), pages 87-107.
    48. Christopher Harris & John Vickers, 1985. "Perfect Equilibrium in a Model of a Race," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 52(2), pages 193-209.
    49. R. M. Cyert & M. H. DeGroot, 1970. "Multiperiod Decision Models with Alternating Choice as a Solution to the Duopoly Problem," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 84(3), pages 410-429.
    50. Glenn C. Loury, 1979. "Market Structure and Innovation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 93(3), pages 395-410.
    51. Padilla A. Jorge, 1995. "Revisiting Dynamic Duopoly with Consumer Switching Costs," Journal of Economic Theory, Elsevier, vol. 67(2), pages 520-530, December.
    52. Pindyck, Robert S., 1975. "Optimal stabilization policies under decentralized control and conflicting objectives," Working papers 765-75., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    53. A. M. Spence, 1981. "The Learning Curve and Competition," Bell Journal of Economics, The RAND Corporation, vol. 12(1), pages 49-70, Spring.
    54. Daniel Cohen & Philippe Michel, 1988. "How Should Control Theory Be Used to Calculate a Time-Consistent Government Policy?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 55(2), pages 263-274.
    55. Drew Fudenberg & Jean Tirole, 1983. "Learning-by-Doing and Market Performance," Bell Journal of Economics, The RAND Corporation, vol. 14(2), pages 522-530, Autumn.
    56. Harris, Christopher J, 1985. "Existence and Characterization of Perfect Equilibrium in Games of Perfect Information," Econometrica, Econometric Society, vol. 53(3), pages 613-628, May.
    57. Kydland, Finn E & Prescott, Edward C, 1977. "Rules Rather Than Discretion: The Inconsistency of Optimal Plans," Journal of Political Economy, University of Chicago Press, vol. 85(3), pages 473-491, June.
    58. Schwalbe, Ulrich & Walker, Paul, 2001. "Zermelo and the Early History of Game Theory," Games and Economic Behavior, Elsevier, vol. 34(1), pages 123-137, January.
    59. repec:ubc:bricol:96-02 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Peixuan Li & Chuangyin Dang & P. Jean-Jacques Herings, 2024. "Computing perfect stationary equilibria in stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 78(2), pages 347-387, September.
    2. Reinoud Joosten & Robin Meijboom, 2010. "Stochastic games with endogenous transitions," Papers on Economics and Evolution 2010-24, Philipps University Marburg, Department of Geography.
    3. Boucekkine, Raouf & Fabbri, Giorgio & Federico, Salvatore & Gozzi, Fausto, 2022. "A dynamic theory of spatial externalities," Games and Economic Behavior, Elsevier, vol. 132(C), pages 133-165.
    4. Elena M. Parilina & Alessandro Tampieri, 2018. "Stability and cooperative solution in stochastic games," Theory and Decision, Springer, vol. 84(4), pages 601-625, June.
    5. Wei He, 2022. "Discontinuous stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(4), pages 827-858, June.
    6. R. Joosten, 2005. "A small Fish War: an example with frequency-dependent stage payoffs," Papers on Economics and Evolution 2005-06, Philipps University Marburg, Department of Geography.
    7. Yehuda (John) Levy, 2012. "A Discounted Stochastic Game with No Stationary Nash Equilibrium," Discussion Paper Series dp596r, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem, revised May 2012.
    8. Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    9. Mandel, Antoine & Venel, Xavier, 2020. "Dynamic competition over social networks," European Journal of Operational Research, Elsevier, vol. 280(2), pages 597-608.
    10. Antoine Mandel & Xavier Venel, 2017. "Dynamic competition over social networks Dynamic competition over social networks," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01524453, HAL.
    11. Amir, Rabah & Machowska, Dominika & Troege, Michael, 2021. "Advertising patterns in a dynamic oligopolistic growing market with decay," Journal of Economic Dynamics and Control, Elsevier, vol. 131(C).
    12. Charles Figuières, 2009. "Markov interactions in a class of dynamic games," Theory and Decision, Springer, vol. 66(1), pages 39-68, January.
    13. Reinoud Joosten, 2007. "Patience, Fish Wars, rarity value & Allee effects," Papers on Economics and Evolution 2007-24, Philipps University Marburg, Department of Geography.
    14. Piotr Szajowski, 2006. "Constructions of Nash Equilibria in Stochastic Games of Resource Extraction with Additive Transition Structure," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 63(2), pages 239-260, May.
    15. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    16. Antoine Mandel & Xavier Venel, 2017. "Dynamic competition over social networks Dynamic competition over social networks," Post-Print halshs-01524453, HAL.
    17. Gianluigi Vernasca, 2003. "Dynamic Price Competition with Price Adjustment Costs and Product Differentiation," Working Papers 2003.120, Fondazione Eni Enrico Mattei.
    18. Vernasca, Gianluigi, 2003. "Dynamic Price Competition With Price Adjustment Costs And Product Differentiation," The Warwick Economics Research Paper Series (TWERPS) 681, University of Warwick, Department of Economics.
    19. repec:pri:metric:wp053_2013_abreu_pearce_implementing-the-nash-program-in-stochastic-games is not listed on IDEAS
    20. İzgi, Burhaneddin & Özkaya, Murat & Üre, Nazım Kemal & Perc, Matjaž, 2024. "Matrix norm based hybrid Shapley and iterative methods for the solution of stochastic matrix games," Applied Mathematics and Computation, Elsevier, vol. 473(C).
    21. Reinoud Joosten, 2016. "Strong and Weak Rarity Value: Resource Games with Complex Price–Scarcity Relationships," Dynamic Games and Applications, Springer, vol. 6(1), pages 97-111, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amir, Rabah & Halmenschlager, Christine & Jin, Jim, 2011. "R&D-induced industry polarization and shake-outs," International Journal of Industrial Organization, Elsevier, vol. 29(4), pages 386-398, July.
    2. David Greenstreet, 2007. "Exploiting Sequential Learning to Estimate Establishment-Level Productivity Dynamics and Decision Rules," Economics Series Working Papers 345, University of Oxford, Department of Economics.
    3. Mehrez, Abraham & Justman, Moshe, 2001. "On the efficiency of the parallel path R&D approach: a stochastic game analysis," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 57(1), pages 19-28.
    4. Nguyen, Thang, 2004. "Technological Progress in Races for Product Supremacy," MPRA Paper 235, University Library of Munich, Germany, revised 18 Jul 2006.
    5. Philip Auerswald, 2010. "Entry and Schumpeterian profits," Journal of Evolutionary Economics, Springer, vol. 20(4), pages 553-582, August.
    6. Vives, Xavier & Jun, Byoung, 2001. "Incentives in Dynamic Duopoly," CEPR Discussion Papers 2899, C.E.P.R. Discussion Papers.
    7. Aldieri, Luigi & Aprile, Maria Carmela & Vinci, Concetto Paolo, 2015. "R&D Spillovers Effects on strategic behaviour of Large International Firms," MPRA Paper 63402, University Library of Munich, Germany.
    8. James Bergin & Dan Bernhardt, 2008. "Industry dynamics with stochastic demand," RAND Journal of Economics, RAND Corporation, vol. 39(1), pages 41-68, March.
    9. Roger Guesnerie & Jean Tirole, 1985. "L'économie de la recherche-développement : introduction à certains travaux théoriques," Revue Économique, Programme National Persée, vol. 36(5), pages 843-872.
    10. Richard Gilbert, 2006. "Looking for Mr. Schumpeter: Where Are We in the Competition-Innovation Debate?," NBER Chapters, in: Innovation Policy and the Economy, Volume 6, pages 159-215, National Bureau of Economic Research, Inc.
    11. Thompson, Peter, 2010. "Learning by Doing," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 429-476, Elsevier.
    12. Petrakis, Emmanuel & Roy, Santanu, 1999. "Cost-Reducing Investment, Competition, and Industry Dynamics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(2), pages 381-401, May.
    13. Matros, Alexander & Smirnov, Vladimir, 2016. "Duplicative search," Games and Economic Behavior, Elsevier, vol. 99(C), pages 1-22.
    14. Matthew Mitchell & Andrzej Skrzypacz, 2006. "Network externalities and long-run market shares," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 29(3), pages 621-648, November.
    15. Doraszelski, Ulrich & Escobar, Juan F., 2019. "Protocol invariance and the timing of decisions in dynamic games," Theoretical Economics, Econometric Society, vol. 14(2), May.
    16. Ronald Goettler & Brett Gordon, 2014. "Competition and product innovation in dynamic oligopoly," Quantitative Marketing and Economics (QME), Springer, vol. 12(1), pages 1-42, March.
    17. By Kenneth L. Judd & Karl Schmedders & Şevin Yeltekin, 2012. "Optimal Rules For Patent Races," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(1), pages 23-52, February.
    18. L. Lambertini, 2002. "Stackelberg Leadership in a Dynamic Duopoly with Capital Accumulation," Working Papers 442, Dipartimento Scienze Economiche, Universita' di Bologna.
    19. Fouad Ouardighi & Matan Shnaiderman & Federico Pasin, 2014. "Research and Development with Stock-Dependent Spillovers and Price Competition in a Duopoly," Journal of Optimization Theory and Applications, Springer, vol. 161(2), pages 626-647, May.
    20. Colombo, Luca & Labrecciosa, Paola, 2019. "Stackelberg versus Cournot: A differential game approach," Journal of Economic Dynamics and Control, Elsevier, vol. 101(C), pages 239-261.

    More about this item

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • L13 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Oligopoly and Other Imperfect Markets
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cor:louvco:2001060. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alain GILLIS (email available below). General contact details of provider: https://edirc.repec.org/data/coreebe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.