IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v58y2021i2d10.1007_s10614-020-10037-x.html
   My bibliography  Save this article

A Generalized Time Iteration Method for Solving Dynamic Optimization Problems with Occasionally Binding Constraints

Author

Listed:
  • Ayşe Kabukçuoğlu

    (North Carolina State University)

  • Enrique Martínez-García

    (Federal Reserve Bank of Dallas)

Abstract

We study a generalized version of Coleman (J Bus Econ Stat 8:27–29, 1990)’s time iteration method (GTI) for solving dynamic optimization problems. Our benchmark framework is an irreversible investment model with labor-leisure choice. The GTI algorithm is simple to implement and provides advantages in terms of speed relative to Howard’s (Dynamic Programming and Markov Processes. MIT Press, Cambridge, MA, 1960) improvement algorithm. A second application on a heterogeneous-agents incomplete-markets model further explores the performance of GTI.

Suggested Citation

  • Ayşe Kabukçuoğlu & Enrique Martínez-García, 2021. "A Generalized Time Iteration Method for Solving Dynamic Optimization Problems with Occasionally Binding Constraints," Computational Economics, Springer;Society for Computational Economics, vol. 58(2), pages 435-460, August.
    • Handle: RePEc:kap:compec:v:58:y:2021:i:2:d:10.1007_s10614-020-10037-x
    DOI: 10.1007/s10614-020-10037-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-020-10037-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-020-10037-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christiano, Lawrence J. & Fisher, Jonas D. M., 2000. "Algorithms for solving dynamic models with occasionally binding constraints," Journal of Economic Dynamics and Control, Elsevier, vol. 24(8), pages 1179-1232, July.
    2. Veronica Guerrieri & Guido Lorenzoni, 2017. "Credit Crises, Precautionary Savings, and the Liquidity Trap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(3), pages 1427-1467.
    3. Tauchen, George & Hussey, Robert, 1991. "Quadrature-Based Methods for Obtaining Approximate Solutions to Nonlinear Asset Pricing Models," Econometrica, Econometric Society, vol. 59(2), pages 371-396, March.
    4. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, December.
    5. Giulio Fella, 2014. "A generalized endogenous grid method for non-smooth and non-concave problems," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 17(2), pages 329-344, April.
    6. Tom D. Holden, 2023. "Existence and Uniqueness of Solutions to Dynamic Models with Occasionally Binding Constraints," The Review of Economics and Statistics, MIT Press, vol. 105(6), pages 1481-1499, November.
    7. Maliar, Serguei & Maliar, Lilia & Judd, Kenneth, 2011. "Solving the multi-country real business cycle model using ergodic set methods," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 207-228, February.
    8. Jonathan Heathcote & Kjetil Storesletten & Giovanni L. Violante, 2017. "Optimal Tax Progressivity: An Analytical Framework," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(4), pages 1693-1754.
    9. Maliar, Lilia & Maliar, Serguei, 2013. "Envelope condition method versus endogenous grid method for solving dynamic programming problems," Economics Letters, Elsevier, vol. 120(2), pages 262-266.
    10. Martin M Andreasen & Jesús Fernández-Villaverde & Juan F Rubio-Ramírez, 2018. "The Pruned State-Space System for Non-Linear DSGE Models: Theory and Empirical Applications," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(1), pages 1-49.
    11. Guerrieri, Luca & Iacoviello, Matteo, 2015. "OccBin: A toolkit for solving dynamic models with occasionally binding constraints easily," Journal of Monetary Economics, Elsevier, vol. 70(C), pages 22-38.
    12. den Haan, Wouter J & Marcet, Albert, 1990. "Solving the Stochastic Growth Model by Parameterizing Expectations," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 31-34, January.
    13. White, Matthew N., 2015. "The method of endogenous gridpoints in theory and practice," Journal of Economic Dynamics and Control, Elsevier, vol. 60(C), pages 26-41.
    14. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    15. Enrique G. Mendoza & Vincenzo Quadrini & José-Víctor Ríos-Rull & Giancarlo Corsetti & Memet Yorukoglu, 2007. "On the Welfare Implications of Financial Globalization without Financial Development [with Comments]," NBER International Seminar on Macroeconomics, University of Chicago Press, vol. 2007(1), pages 283-322.
    16. S. Rao Aiyagari, 1994. "Uninsured Idiosyncratic Risk and Aggregate Saving," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(3), pages 659-684.
    17. Kenneth L. Judd & Lilia Maliar & Serguei Maliar & Inna Tsener, 2017. "How to solve dynamic stochastic models computing expectations just once," Quantitative Economics, Econometric Society, vol. 8(3), pages 851-893, November.
    18. David Domeij & Martin Floden, 2006. "The Labor-Supply Elasticity and Borrowing Constraints: Why Estimates are Biased," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 9(2), pages 242-262, April.
    19. Holden, Tom D., 2016. "Computation of solutions to dynamic models with occasionally binding constraints," EconStor Preprints 144569, ZBW - Leibniz Information Centre for Economics.
    20. Carroll, Christopher D., 2006. "The method of endogenous gridpoints for solving dynamic stochastic optimization problems," Economics Letters, Elsevier, vol. 91(3), pages 312-320, June.
    21. Lilia Maliar & Serguei Maliar, 2005. "Parameterized Expectations Algorithm: How to Solve for Labor Easily," Computational Economics, Springer;Society for Computational Economics, vol. 25(3), pages 269-274, June.
    22. Baxter, Marianne, 1991. "Approximating suboptimal dynamic equilibria : An Euler equation approach," Journal of Monetary Economics, Elsevier, vol. 28(2), pages 173-200, October.
    23. Ljungqvist, Lars & Sargent, Thomas J., 2012. "Recursive Macroeconomic Theory, Third Edition," MIT Press Books, The MIT Press, edition 3, volume 1, number 0262018748, December.
    24. Schmitt-Grohe, Stephanie & Uribe, Martin, 2004. "Solving dynamic general equilibrium models using a second-order approximation to the policy function," Journal of Economic Dynamics and Control, Elsevier, vol. 28(4), pages 755-775, January.
    25. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    26. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    27. Malin, Benjamin A. & Krueger, Dirk & Kubler, Felix, 2011. "Solving the multi-country real business cycle model using a Smolyak-collocation method," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 229-239, February.
    28. David Domeij & Jonathan Heathcote, 2004. "On The Distributional Effects Of Reducing Capital Taxes," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 523-554, May.
    29. J. B. Taylor & Harald Uhlig (ed.), 2016. "Handbook of Macroeconomics," Handbook of Macroeconomics, Elsevier, edition 1, volume 2, number 2.
    30. Barillas, Francisco & Fernandez-Villaverde, Jesus, 2007. "A generalization of the endogenous grid method," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2698-2712, August.
    31. John Rust, 1997. "Using Randomization to Break the Curse of Dimensionality," Econometrica, Econometric Society, vol. 65(3), pages 487-516, May.
    32. Pontus Rendahl, 2015. "Inequality Constraints and Euler Equation‐based Solution Methods," Economic Journal, Royal Economic Society, vol. 125(585), pages 1110-1135, June.
    33. Hintermaier, Thomas & Koeniger, Winfried, 2010. "The method of endogenous gridpoints with occasionally binding constraints among endogenous variables," Journal of Economic Dynamics and Control, Elsevier, vol. 34(10), pages 2074-2088, October.
    34. Enrique G. Mendoza & Vincenzo Quadrini & José-Víctor Ríos-Rull, 2009. "Financial Integration, Financial Development, and Global Imbalances," Journal of Political Economy, University of Chicago Press, vol. 117(3), pages 371-416, June.
    35. Enrique G. Mendoza & Vincenzo Quadrini & José-Víctor Ríos-Rull, 2009. "On the Welfare Implications of Financial Globalization without Financial Development," NBER Chapters, in: NBER International Seminar on Macroeconomics 2007, pages 283-312, National Bureau of Economic Research, Inc.
    36. Judd, Kenneth L., 1992. "Projection methods for solving aggregate growth models," Journal of Economic Theory, Elsevier, vol. 58(2), pages 410-452, December.
    37. Coleman, Wilbur John, II, 1990. "Solving the Stochastic Growth Model by Policy-Function Iteration," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 27-29, January.
    38. Martin L. Puterman & Shelby L. Brumelle, 1979. "On the Convergence of Policy Iteration in Stationary Dynamic Programming," Mathematics of Operations Research, INFORMS, vol. 4(1), pages 60-69, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ayse Kabukcuoglu & Enrique Martínez-García, 2016. "The Market Resources Method for Solving Dynamic Optimization Problems," Koç University-TUSIAD Economic Research Forum Working Papers 1607, Koc University-TUSIAD Economic Research Forum.
    2. Judd, Kenneth L. & Maliar, Lilia & Maliar, Serguei & Valero, Rafael, 2014. "Smolyak method for solving dynamic economic models: Lagrange interpolation, anisotropic grid and adaptive domain," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 92-123.
    3. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    4. Yasuo Hirose & Takeki Sunakawa, 2019. "Review of Solution and Estimation Methods for Nonlinear Dynamic Stochastic General Equilibrium Models with the Zero Lower Bound," The Japanese Economic Review, Japanese Economic Association, vol. 70(1), pages 51-104, March.
    5. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    6. Lilia Maliar & Serguei Maliar & John B. Taylor & Inna Tsener, 2020. "A tractable framework for analyzing a class of nonstationary Markov models," Quantitative Economics, Econometric Society, vol. 11(4), pages 1289-1323, November.
    7. Serguei Maliar & John Taylor & Lilia Maliar, 2016. "The Impact of Alternative Transitions to Normalized Monetary Policy," 2016 Meeting Papers 794, Society for Economic Dynamics.
    8. Alexander Ludwig & Matthias Schön, 2018. "Endogenous Grids in Higher Dimensions: Delaunay Interpolation and Hybrid Methods," Computational Economics, Springer;Society for Computational Economics, vol. 51(3), pages 463-492, March.
    9. Kabukçuoğlu, Ayşe, 2017. "The winners and losers of tax reform: An assessment under financial integration," Journal of Economic Dynamics and Control, Elsevier, vol. 85(C), pages 90-122.
    10. Hull, Isaiah, 2015. "Approximate dynamic programming with post-decision states as a solution method for dynamic economic models," Journal of Economic Dynamics and Control, Elsevier, vol. 55(C), pages 57-70.
    11. Jeppe Druedahl, 2021. "A Guide on Solving Non-convex Consumption-Saving Models," Computational Economics, Springer;Society for Computational Economics, vol. 58(3), pages 747-775, October.
    12. Enrique Mendoza & Sergio Villalvazo, 2020. "FiPIt: A Simple, Fast Global Method for Solving Models with Two Endogenous States & Occasionally Binding Constraints," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 37, pages 81-102, July.
    13. Pontus Rendahl, 2015. "Inequality Constraints and Euler Equation‐based Solution Methods," Economic Journal, Royal Economic Society, vol. 125(585), pages 1110-1135, June.
    14. Maliar, Lilia & Maliar, Serguei & Winant, Pablo, 2021. "Deep learning for solving dynamic economic models," Journal of Monetary Economics, Elsevier, vol. 122(C), pages 76-101.
    15. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, December.
    16. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    17. Barillas, Francisco & Fernandez-Villaverde, Jesus, 2007. "A generalization of the endogenous grid method," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2698-2712, August.
    18. Lepetyuk, Vadym & Maliar, Lilia & Maliar, Serguei, 2020. "When the U.S. catches a cold, Canada sneezes: A lower-bound tale told by deep learning," Journal of Economic Dynamics and Control, Elsevier, vol. 117(C).
    19. Yongyang Cai & Kenneth L. Judd, 2023. "A simple but powerful simulated certainty equivalent approximation method for dynamic stochastic problems," Quantitative Economics, Econometric Society, vol. 14(2), pages 651-687, May.
    20. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.

    More about this item

    Keywords

    General equilibrium models; Occasionally binding constraints; Computational methods; Time iteration; Policy function iteration; Endogenous grid;
    All these keywords.

    JEL classification:

    • C6 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C68 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computable General Equilibrium Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:58:y:2021:i:2:d:10.1007_s10614-020-10037-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.