IDEAS home Printed from https://ideas.repec.org/a/jns/jbstat/v231y2011i4p494-515.html
   My bibliography  Save this article

Value Function Iteration as a Solution Method for the Ramsey Model

Author

Listed:
  • Heer Burkhard

    (Free University of Bolzano-Bozen, School of Economics and Management, Piazza Universitá , 39100 Bolzano-Bozen, Italy)

  • Maußner Alfred

    (University of Augsburg, Department of Economics, Universitätsstraße 16, 86159 Augsburg, Germany)

Abstract

Value function iteration is one of the standard tools for the solution of dynamic general equilibrium models if the dimension of the state space is one ore two. We consider three kinds of models: the deterministic and the stochastic growth model and a simple heterogenous agent model. Each model is solved with six different algorithms: (1) simple value function iteration as compared to (2) smart value function iteration neglects the special structure of the problem. (3) Full and (4) modified policy iteration are methods to speed up convergence. (5) linear and (6) cubic interpolation between the grid points are methods that enhance precision and reduce the size of the grid. We evaluate the algorithms with respect to speed and accuracy. Accuracy is defined as the maximum absolute value of the residual of the Euler equation that determines the household’s savings. We demonstrate that the run time of all algorithms can be reduced substantially if the value function is initialized stepwise, starting on a coarse grid and increasing the number of grid points successively until the desired size is reached.We find that value function iteration with cubic spline interpolation between grid points dominates the other methods if a high level of accuracy is needed.

Suggested Citation

  • Heer Burkhard & Maußner Alfred, 2011. "Value Function Iteration as a Solution Method for the Ramsey Model," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(4), pages 494-515, August.
  • Handle: RePEc:jns:jbstat:v:231:y:2011:i:4:p:494-515
    DOI: 10.1515/jbnst-2011-0404
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jbnst-2011-0404
    Download Restriction: no

    File URL: https://libkey.io/10.1515/jbnst-2011-0404?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    2. Christiano, Lawrence J. & Fisher, Jonas D. M., 2000. "Algorithms for solving dynamic models with occasionally binding constraints," Journal of Economic Dynamics and Control, Elsevier, vol. 24(8), pages 1179-1232, July.
    3. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, April.
    4. Heer, Burkhard & Maußner, Alfred, 2008. "Computation Of Business Cycle Models: A Comparison Of Numerical Methods," Macroeconomic Dynamics, Cambridge University Press, vol. 12(5), pages 641-663, November.
    5. Tauchen, George, 1986. "Finite state markov-chain approximations to univariate and vector autoregressions," Economics Letters, Elsevier, vol. 20(2), pages 177-181.
    6. Martin L. Puterman & Moon Chirl Shin, 1978. "Modified Policy Iteration Algorithms for Discounted Markov Decision Problems," Management Science, INFORMS, vol. 24(11), pages 1127-1137, July.
    7. Gaspar, Jess & L. Judd, Kenneth, 1997. "Solving Large-Scale Rational-Expectations Models," Macroeconomic Dynamics, Cambridge University Press, vol. 1(1), pages 45-75, January.
    8. Erosa, Andres & Ventura, Gustavo, 2002. "On inflation as a regressive consumption tax," Journal of Monetary Economics, Elsevier, vol. 49(4), pages 761-795, May.
    9. Judd, Kenneth L., 1992. "Projection methods for solving aggregate growth models," Journal of Economic Theory, Elsevier, vol. 58(2), pages 410-452, December.
    10. Martin L. Puterman & Shelby L. Brumelle, 1979. "On the Convergence of Policy Iteration in Stationary Dynamic Programming," Mathematics of Operations Research, INFORMS, vol. 4(1), pages 60-69, February.
    11. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    12. Huggett, Mark, 1993. "The risk-free rate in heterogeneous-agent incomplete-insurance economies," Journal of Economic Dynamics and Control, Elsevier, vol. 17(5-6), pages 953-969.
    13. Marimon, Ramon & Scott, Andrew (ed.), 1999. "Computational Methods for the Study of Dynamic Economies," OUP Catalogue, Oxford University Press, number 9780198294979.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brüggemann, Bettina & Yoo, Jinhyuk, 2015. "Aggregate and distributional effects of increasing taxes on top income earners," IMFS Working Paper Series 94, Goethe University Frankfurt, Institute for Monetary and Financial Stability (IMFS).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kenneth L. Judd & Lilia Maliar & Serguei Maliar & Inna Tsener, 2017. "How to solve dynamic stochastic models computing expectations just once," Quantitative Economics, Econometric Society, vol. 8(3), pages 851-893, November.
    2. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    3. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    4. Hull, Isaiah, 2015. "Approximate dynamic programming with post-decision states as a solution method for dynamic economic models," Journal of Economic Dynamics and Control, Elsevier, vol. 55(C), pages 57-70.
    5. Judd, Kenneth L. & Maliar, Lilia & Maliar, Serguei & Valero, Rafael, 2014. "Smolyak method for solving dynamic economic models: Lagrange interpolation, anisotropic grid and adaptive domain," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 92-123.
    6. Dorofeenko, Victor & Lee, Gabriel S. & Salyer, Kevin D., 2010. "A new algorithm for solving dynamic stochastic macroeconomic models," Journal of Economic Dynamics and Control, Elsevier, vol. 34(3), pages 388-403, March.
    7. Ayse Kabukcuoglu & Enrique Martínez-García, 2016. "The Market Resources Method for Solving Dynamic Optimization Problems," Koç University-TUSIAD Economic Research Forum Working Papers 1607, Koc University-TUSIAD Economic Research Forum.
    8. Lilia Maliar & Serguei Maliar & John B. Taylor & Inna Tsener, 2020. "A tractable framework for analyzing a class of nonstationary Markov models," Quantitative Economics, Econometric Society, vol. 11(4), pages 1289-1323, November.
    9. Pichler, Paul, 2011. "Solving the multi-country Real Business Cycle model using a monomial rule Galerkin method," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 240-251, February.
    10. Serguei Maliar & John Taylor & Lilia Maliar, 2016. "The Impact of Alternative Transitions to Normalized Monetary Policy," 2016 Meeting Papers 794, Society for Economic Dynamics.
    11. José Cao-Alvira, 2010. "Finite Elements in the Presence of Occasionally Binding Constraints," Computational Economics, Springer;Society for Computational Economics, vol. 35(4), pages 355-370, April.
    12. Kollmann, Robert & Maliar, Serguei & Malin, Benjamin A. & Pichler, Paul, 2011. "Comparison of solutions to the multi-country Real Business Cycle model," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 186-202, February.
    13. Paul Pichler, 2005. "Evaluating Approximate Equilibria of Dynamic Economic Models," Vienna Economics Papers 0510, University of Vienna, Department of Economics.
    14. de Castro, Luciano & Galvao, Antonio F. & Muchon, Andre, 2023. "Numerical Solution of Dynamic Quantile Models," Journal of Economic Dynamics and Control, Elsevier, vol. 148(C).
    15. Yongyang Cai & Kenneth Judd & Jevgenijs Steinbuks, 2017. "A nonlinear certainty equivalent approximation method for dynamic stochastic problems," Quantitative Economics, Econometric Society, vol. 8(1), pages 117-147, March.
    16. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2010. "A Cluster-Grid Projection Method: Solving Problems with High Dimensionality," NBER Working Papers 15965, National Bureau of Economic Research, Inc.
    17. Andrew Foerster & Juan F. Rubio‐Ramírez & Daniel F. Waggoner & Tao Zha, 2016. "Perturbation methods for Markov‐switching dynamic stochastic general equilibrium models," Quantitative Economics, Econometric Society, vol. 7(2), pages 637-669, July.
    18. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, April.
    19. Posch, Olaf & Trimborn, Timo, 2013. "Numerical solution of dynamic equilibrium models under Poisson uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 37(12), pages 2602-2622.
    20. Viktors Ajevskis, 2019. "Generalised Impulse Response Function as a Perturbation of a Global Solution to DSGE Models," Working Papers 2019/04, Latvijas Banka.

    More about this item

    Keywords

    Value function iteration; policy function iteration; Howard’s Algorithm; acceleration; cubic interpolation; stochastic Ramsey model; heterogeneous agents; Value function iteration; policy function iteration; Howard’s Algorithm; acceleration; cubic interpolation; stochastic Ramsey model; heterogeneous agents;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C68 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computable General Equilibrium Models
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jns:jbstat:v:231:y:2011:i:4:p:494-515. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.