IDEAS home Printed from https://ideas.repec.org/a/spr/jogath/v44y2015i1p83-112.html
   My bibliography  Save this article

Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers

Author

Listed:
  • Łukasz Balbus
  • Kevin Reffett
  • Łukasz Woźny

Abstract

We study the question of existence and computation of time-consistent Markov policies of quasi-hyperbolic consumers under a stochastic transition technology in a general class of economies with multidimensional action spaces and uncountable state spaces. Under standard complementarity assumptions on preferences, as well as a mild geometric condition on transition probabilities, we prove existence of time-consistent solutions in Markovian policies, and provide conditions for the existence of continuous and monotone equilibria. We present applications of our methods to habit formation models, environmental policies, and models of consumption under borrowing constraints, and hence show how our methods extend the results obtained by Harris and Laibson (Econometrica 69:935–957, 2001 ) to a broad class of dynamic economies. We also present a simple successive approximation scheme for computing extremal equilibrium, and provide some results on the existence of monotone equilibrium comparative statics in the model’s deep parameters. Copyright Springer-Verlag Berlin Heidelberg 2015

Suggested Citation

  • Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
  • Handle: RePEc:spr:jogath:v:44:y:2015:i:1:p:83-112
    DOI: 10.1007/s00182-014-0420-3
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00182-014-0420-3
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s00182-014-0420-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Per Krusell & Anthony A. Smith, Jr., 2003. "Consumption--Savings Decisions with Quasi--Geometric Discounting," Econometrica, Econometric Society, vol. 71(1), pages 365-375, January.
    2. Daron Acemoglu & Philippe Aghion & Leonardo Bursztyn & David Hemous, 2012. "The Environment and Directed Technical Change," American Economic Review, American Economic Association, vol. 102(1), pages 131-166, February.
    3. Brock, William A. & Taylor, M. Scott, 2005. "Economic Growth and the Environment: A Review of Theory and Empirics," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 1, chapter 28, pages 1749-1821, Elsevier.
    4. Lemoine, Derek M. & Traeger, Christian P., 2010. "Tipping Points and Ambiguity in the Economics of Climate Change," CUDARE Working Papers 98127, University of California, Berkeley, Department of Agricultural and Resource Economics.
    5. Duffie, Darrell, et al, 1994. "Stationary Markov Equilibria," Econometrica, Econometric Society, vol. 62(4), pages 745-781, July.
    6. Matthias Messner & Nicola Pavoni & Christopher Sleet, 2012. "Recursive Methods for Incentive Problems," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 501-525, October.
    7. Wolfgang Leininger, 1986. "The Existence of Perfect Equilibria in a Model of Growth with Altruism between Generations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(3), pages 349-367.
    8. Peter Kall, 1986. "Approximation to Optimization Problems: An Elementary Review," Mathematics of Operations Research, INFORMS, vol. 11(1), pages 9-18, February.
    9. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
    10. O'Donoghue, Ted & Rabin, Matthew, 1997. "Doing It Now or Later," Department of Economics, Working Paper Series qt7t44m5b0, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    11. David K. Levine & Drew Fudenberg, 2006. "A Dual-Self Model of Impulse Control," American Economic Review, American Economic Association, vol. 96(5), pages 1449-1476, December.
    12. Matthew Rabin & Ted O'Donoghue, 1999. "Doing It Now or Later," American Economic Review, American Economic Association, vol. 89(1), pages 103-124, March.
    13. Albert Marcet & Ramon Marimon, 2019. "Recursive Contracts," Econometrica, Econometric Society, vol. 87(5), pages 1589-1631, September.
    14. Gong, Liutang & Smith, William & Zou, Heng-fu, 2007. "Consumption and Risk with hyperbolic discounting," Economics Letters, Elsevier, vol. 96(2), pages 153-160, August.
    15. Faruk Gul & Wolfgang Pesendorfer, 2001. "Temptation and Self-Control," Econometrica, Econometric Society, vol. 69(6), pages 1403-1435, November.
    16. Bezalel Peleg & Menahem E. Yaari, 1973. "On the Existence of a Consistent Course of Action when Tastes are Changing," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 40(3), pages 391-401.
    17. Karp, Larry & Tsur, Yacov, 2011. "Time perspective and climate change policy," Journal of Environmental Economics and Management, Elsevier, vol. 62(1), pages 1-14, July.
    18. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    19. Hirtle, Beverly, 2009. "Credit derivatives and bank credit supply," Journal of Financial Intermediation, Elsevier, vol. 18(2), pages 125-150, April.
    20. Jones, L.E., 1995. "A Positive Model of Growth and Pollution Controls," Working papers 9513, Wisconsin Madison - Social Systems.
    21. Joseph Eisenhauer & Luigi Ventura, 2006. "The prevalence of hyperbolic discounting: some European evidence," Applied Economics, Taylor & Francis Journals, vol. 38(11), pages 1223-1234.
    22. Steven M. Goldman, 1980. "Consistent Plans," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(3), pages 533-537.
    23. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
    24. Sorger, Gerhard, 2004. "Consistent planning under quasi-geometric discounting," Journal of Economic Theory, Elsevier, vol. 118(1), pages 118-129, September.
    25. Eddie Dekel & Barton L. Lipman, 2012. "Costly Self‐Control and Random Self‐Indulgence," Econometrica, Econometric Society, vol. 80(3), pages 1271-1302, May.
    26. Janusz Matkowski & Andrzej Nowak, 2011. "On discounted dynamic programming with unbounded returns," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 46(3), pages 455-474, April.
    27. Chade, Hector & Prokopovych, Pavlo & Smith, Lones, 2008. "Repeated games with present-biased preferences," Journal of Economic Theory, Elsevier, vol. 139(1), pages 157-175, March.
    28. Matthias Messner & Nicola Pavoni, 2004. "On the Recursive Saddle Point Method," Working Papers 255, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    29. Ted O'Donoghue & Matthew Rabin, 1999. "Incentives for Procrastinators," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 769-816.
    30. Caplin, Andrew & Leahy, John, 2006. "The recursive approach to time inconsistency," Journal of Economic Theory, Elsevier, vol. 131(1), pages 134-156, November.
    31. Amir, Rabah, 1996. "Strategic Intergenerational Bequests with Stochastic Convex Production," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 8(2), pages 367-376, August.
    32. Maskin, Eric & Tirole, Jean, 2001. "Markov Perfect Equilibrium: I. Observable Actions," Journal of Economic Theory, Elsevier, vol. 100(2), pages 191-219, October.
    33. Dekel, Eddie & Lipman, Barton L & Rustichini, Aldo, 2001. "Representing Preferences with a Unique Subjective State Space," Econometrica, Econometric Society, vol. 69(4), pages 891-934, July.
    34. B. Douglas Bernheim & Debraj Ray, 1986. "On the Existence of Markov-Consistent Plans under Production Uncertainty," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(5), pages 877-882.
    35. Kydland, Finn E. & Prescott, Edward C., 1980. "Dynamic optimal taxation, rational expectations and optimal control," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 79-91, May.
    36. Rabah Amir, 2002. "Complementarity and Diagonal Dominance in Discounted Stochastic Games," Annals of Operations Research, Springer, vol. 114(1), pages 39-56, August.
    37. Faruk Gul & Wolfgang Pesendorfer, 2004. "Self-Control and the Theory of Consumption," Econometrica, Econometric Society, vol. 72(1), pages 119-158, January.
    38. Marinacci, Massimo & Montrucchio, Luigi, 2010. "Unique solutions for stochastic recursive utilities," Journal of Economic Theory, Elsevier, vol. 145(5), pages 1776-1804, September.
    39. George-Marios Angeletos & David Laibson & Andrea Repetto & Jeremy Tobacman & Stephen Weinberg, 2001. "The Hyberbolic Consumption Model: Calibration, Simulation, and Empirical Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 47-68, Summer.
    40. Benabou, Roland & Pycia, Marek, 2002. "Dynamic inconsistency and self-control: a planner-doer interpretation," Economics Letters, Elsevier, vol. 77(3), pages 419-424, November.
    41. V. Filipe Martins-da-Rocha & Yiannis Vailakis, 2010. "Existence and Uniqueness of a Fixed Point for Local Contractions," Econometrica, Econometric Society, vol. 78(3), pages 1127-1141, May.
    42. Larry E. Jones & Rodolfo E. Manuelli, 2001. "Endogenous Policy Choice: The Case of Pollution and Growth," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 4(2), pages 369-405, July.
    43. Becker, Gary S & Murphy, Kevin M, 1988. "A Theory of Rational Addiction," Journal of Political Economy, University of Chicago Press, vol. 96(4), pages 675-700, August.
    44. Eugene A. Feinberg & Adam Shwartz, 1995. "Constrained Markov Decision Models with Weighted Discounted Rewards," Mathematics of Operations Research, INFORMS, vol. 20(2), pages 302-320, May.
    45. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    46. Andrzej Nowak, 2006. "On perfect equilibria in stochastic models of growth with intergenerational altruism," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 28(1), pages 73-83, May.
    47. Harris, Christopher J, 1985. "Existence and Characterization of Perfect Equilibrium in Games of Perfect Information," Econometrica, Econometric Society, vol. 53(3), pages 613-628, May.
    48. Kydland, Finn E & Prescott, Edward C, 1977. "Rules Rather Than Discretion: The Inconsistency of Optimal Plans," Journal of Political Economy, University of Chicago Press, vol. 85(3), pages 473-491, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert A. Becker & Juan Pablo Rincón-Zapatero, 2017. "Arbitration and Renegotiation in Trade Agreements," CAEPR Working Papers 2017-007, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    2. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2022. "Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting," Journal of Economic Theory, Elsevier, vol. 204(C).
    3. Becker, Robert A. & Rincón-Zapatero, Juan Pablo, 2021. "Thompson aggregators, Scott continuous Koopmans operators, and Least Fixed Point theory," Mathematical Social Sciences, Elsevier, vol. 112(C), pages 84-97.
    4. Maria Arvaniti & Chandra K. Krishnamurthy & Anne-Sophie Crépin, 2019. "Time-consistent resource management with regime shifts," CER-ETH Economics working paper series 19/329, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    5. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2018. "On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty," Journal of Economic Theory, Elsevier, vol. 176(C), pages 293-310.
    6. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    7. Balbus, Łukasz & Jaśkiewicz, Anna & Nowak, Andrzej S., 2016. "Non-paternalistic intergenerational altruism revisited," Journal of Mathematical Economics, Elsevier, vol. 63(C), pages 27-33.
    8. Manjira Datta & Kevin Reffett & Łukasz Woźny, 2018. "Comparing recursive equilibrium in economies with dynamic complementarities and indeterminacy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(3), pages 593-626, October.
    9. Robert Becker & Juan Pablo Rincon-Zapatero, 2018. "Recursive Utility and Thompson Aggregators, I: Constructive Existence Theory for the Koopmans Equation," CAEPR Working Papers 2018-006, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    10. Lukasz Wozny, 2016. "Repeated moral hazard with costly self-control," KAE Working Papers 2016-017, Warsaw School of Economics, Collegium of Economic Analysis.
    11. Daron Acemoglu & Martin Kaae Jensen, 2018. "Equilibrium Analysis in the Behavioral Neoclassical Growth Model," NBER Working Papers 25363, National Bureau of Economic Research, Inc.
    12. Robert Becker & Juan Pablo Rincon-Zapatero, 2018. "Recursive Utility and Thompson Aggregators, II: Uniqueness of the Recursive Utility Representation," CAEPR Working Papers 2018-008, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    2. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2018. "On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty," Journal of Economic Theory, Elsevier, vol. 176(C), pages 293-310.
    3. Méder, Zsombor Z. & Flesch, János & Peeters, Ronald, 2017. "Naiveté and sophistication in dynamic inconsistency," Mathematical Social Sciences, Elsevier, vol. 87(C), pages 40-54.
    4. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2022. "Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting," Journal of Economic Theory, Elsevier, vol. 204(C).
    5. Wozny Lukasz & Growiec Jakub, 2012. "Intergenerational Interactions in Human Capital Accumulation," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 12(1), pages 1-47, June.
    6. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2012. "Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment," Journal of Mathematical Economics, Elsevier, vol. 48(2), pages 115-132.
    7. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
    8. Jung Hun Cho, 2007. "Self-Reputation and Perception of Reputation," CERGE-EI Working Papers wp343, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    9. Mihm, Maximilian & Ozbek, Kemal, 2019. "On the identification of changing tastes," Games and Economic Behavior, Elsevier, vol. 116(C), pages 203-216.
    10. Kan, Kamhon, 2007. "Cigarette smoking and self-control," Journal of Health Economics, Elsevier, vol. 26(1), pages 61-81, January.
    11. Salanie, Francois & Treich, Nicolas, 2006. "Over-savings and hyperbolic discounting," European Economic Review, Elsevier, vol. 50(6), pages 1557-1570, August.
    12. Tyson, Christopher J., 2008. "Management of a capital stock by Strotz's naive planner," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2214-2239, July.
    13. Jianjun Miao, 2008. "Option exercise with temptation," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 34(3), pages 473-501, March.
    14. Drew Fudenberg & David K. Levine, 2012. "Timing and Self‐Control," Econometrica, Econometric Society, vol. 80(1), pages 1-42, January.
    15. Hammond, Peter J & Zank, Horst, 2013. "Rationality and Dynamic Consistency under Risk and Uncertainty," The Warwick Economics Research Paper Series (TWERPS) 1033, University of Warwick, Department of Economics.
    16. Cherchye, Laurens & De Rock, Bram & Griffith, Rachel & O’Connell, Martin & Smith, Kate & Vermeulen, Frederic, 2020. "A new year, a new you? Within-individual variation in food purchases," European Economic Review, Elsevier, vol. 127(C).
    17. Cobb-Clark, Deborah A. & Dahmann, Sarah C. & Kamhöfer, Daniel A. & Schildberg-Hörisch, Hannah, 2022. "The Predictive Power of Self-Control for Life Outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 725-744.
    18. Doruk Cetemen & Felix Zhiyu Feng & Can Urgun, 2019. "Contracting with Non-Exponential Discounting: Moral Hazard and Dynamic Inconsistency," Working Papers 2019-17, Princeton University. Economics Department..
    19. Tyson, Christopher J., 2008. "Management of a capital stock by Strotz's naive planner," Journal of Economic Dynamics and Control, Elsevier, vol. 32(7), pages 2214-2239, July.
    20. Cobb-Clark, Deborah A. & Dahmann, Sarah Christina & Kamhöfer, Daniel A. & Schildberg-Hörisch, Hannah, 2019. "Self-control: Determinants, life outcomes and intergenerational implications," DICE Discussion Papers 319, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jogath:v:44:y:2015:i:1:p:83-112. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.