IDEAS home Printed from https://ideas.repec.org/p/ctc/serie6/itemq0745.html
   My bibliography  Save this paper

From simple growth to numerical simulations: a primer in dynamic programming

Author

Listed:
  • Gianluca Femminis

    (DISCE, Università Cattolica)

Abstract

These notes provide an intuitive introduction to dynamic programming. The first two Sections present the standard deterministic Ramsey model using the Lagrangian approach. These can be skipped by whom is already acquainted with this framework. Section 3 shows how to solve the well understood Ramsey model by means of a Bellman equation, while Section 4 shows how to "guess" the solution (when this is possible). Section 5 is devoted to applications of the envelope theorem. Section 6 provides a "paper and pencil" introduction to the numerical techniques used in dynamic programming, and can be skipped by the uninterested reader. Sections 7 to 9 are devoted to stochastic modelling, and to stochastic Bellman equations. Section 10 extends the discussion of numerical techniques. An Appendix provides details about the Matlab routines used to solve the examples.

Suggested Citation

  • Gianluca Femminis, 2007. "From simple growth to numerical simulations: a primer in dynamic programming," DISCE - Quaderni dell'Istituto di Teoria Economica e Metodi Quantitativi itemq0745, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    • Handle: RePEc:ctc:serie6:itemq0745
    as

    Download full text from publisher

    File URL: http://www.unicatt.it/Istituti/TeoriaEconomica/Quaderni/itemq0745.pdf
    File Function: First version, 2007
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christiano, Lawrence J. & Fisher, Jonas D. M., 2000. "Algorithms for solving dynamic models with occasionally binding constraints," Journal of Economic Dynamics and Control, Elsevier, vol. 24(8), pages 1179-1232, July.
    2. Benveniste, L M & Scheinkman, J A, 1979. "On the Differentiability of the Value Function in Dynamic Models of Economics," Econometrica, Econometric Society, vol. 47(3), pages 727-732, May.
    3. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, April.
    4. William A. Brock & Leonard J. Mirman, 2001. "Optimal Economic Growth And Uncertainty: The Discounted Case," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 1, pages 3-37, Edward Elgar Publishing.
    5. Chow, Gregory C., 1997. "Dynamic Economics: Optimization by the Lagrange Method," OUP Catalogue, Oxford University Press, number 9780195101928.
    6. Ellen R. McGrattan, 1998. "Application of weighted residual methods to dynamic economic models," Staff Report 232, Federal Reserve Bank of Minneapolis.
    7. Albert Marcet & Guido Lorenzoni, 1998. "Parameterized expectations approach; Some practical issues," Economics Working Papers 296, Department of Economics and Business, Universitat Pompeu Fabra.
    8. Marimon, Ramon & Scott, Andrew (ed.), 1999. "Computational Methods for the Study of Dynamic Economies," OUP Catalogue, Oxford University Press, number 9780198294979.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chiara Punzo & Giulia Rivolta, 2022. "Money versus debt financed regime: Evidence from an estimated DSGE model," DISCE - Working Papers del Dipartimento di Economia e Finanza def120, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    2. Boitani, Andrea & Dragomirescu-Gaina, Catalin, 2023. "News and narratives: A cointegration analysis of Russian economic policy uncertainty," Economics Letters, Elsevier, vol. 226(C).
    3. Valentina Colombo & Alessia Paccagnini, 2024. "Uncertainty and the Federal Reserve’s Balance Sheet Monetary Policy," DISCE - Working Papers del Dipartimento di Economia e Finanza def131, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    4. Pieroni, Luca & Roig, Melcior Rosselló & Salmasi, Luca, 2023. "Italy: Immigration and the evolution of populism," European Journal of Political Economy, Elsevier, vol. 76(C).
    5. Sebastiano Della Lena & Fabrizio Panebianco, 2019. "Cultural Transmission with Incomplete Information: Parental Perceived Efficacy and Group Misrepresentation," DISCE - Working Papers del Dipartimento di Economia e Finanza def079, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    6. Basiglio, Stefania & Foresta, Alessandra & Turati, Gilberto, 2024. "Impatience and crime. Evidence from the NLSY97," Journal of Economic Psychology, Elsevier, vol. 101(C).
    7. Daniele Checchi & Alessandra Fenizia & Claudio Lucifora, 2021. "PUBLIC SECTOR JOBS: Working in the public sector in Europe and the US," DISCE - Working Papers del Dipartimento di Economia e Finanza def107, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    8. Rosario Crinò & Giovanni Immordino & Salvatore Piccolo, 2018. "Fighting Mobile Crime," DISCE - Working Papers del Dipartimento di Economia e Finanza def071, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    9. Michele Tettamanzi, 2017. "E Many Pluribus Unum: A Behavioural Macro-Economic Agent Based Model," DISCE - Working Papers del Dipartimento di Economia e Finanza def062, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    10. Fanfani, Bernardo, 2022. "Tastes for discrimination in monopsonistic labour markets," Labour Economics, Elsevier, vol. 75(C).
    11. Cottini Elena & Ghinetti Paolo, 2017. "Is it the Way You Live or the Job You Have? Health Effects of Lifestyles and Working Conditions," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 17(3), pages 1-20, July.
    12. Enrico Bellino, 2012. "Pasinetti on Ricardo," DISCE - Quaderni dell'Istituto di Teoria Economica e Metodi Quantitativi itemq1258, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    13. Russell Davidson & Andrea Monticini, 2023. "Bootstrap Performance with Heteroskedasticity," DISCE - Working Papers del Dipartimento di Economia e Finanza def130, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    14. Irene Torrini & Claudio Lucifora & Antonio Russo, 2022. "The Long-Term Effects of Hospitalization on Health Care Expenditures: An Empirical Analysis for the Young-Old Population," DISCE - Working Papers del Dipartimento di Economia e Finanza def117, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    15. Russell Davidson & Andrea Monticini, 2018. "Improvements in Bootstrap Inference," DISCE - Working Papers del Dipartimento di Economia e Finanza def070, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    16. Elenka Brenna & Lara Gitto, 2018. "Adult education, the use of Information and Communication Technologies and the impact on quality of life: a case study," DISCE - Working Papers del Dipartimento di Economia e Finanza def073, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Sirakaya & Stephen Turnovsky & M. Alemdar, 2006. "Feedback Approximation of the Stochastic Growth Model by Genetic Neural Networks," Computational Economics, Springer;Society for Computational Economics, vol. 27(2), pages 185-206, May.
    2. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    3. Lilia Maliar & Serguei Maliar & John B. Taylor & Inna Tsener, 2020. "A tractable framework for analyzing a class of nonstationary Markov models," Quantitative Economics, Econometric Society, vol. 11(4), pages 1289-1323, November.
    4. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, April.
    5. Kenneth L. Judd & Lilia Maliar & Serguei Maliar & Inna Tsener, 2017. "How to solve dynamic stochastic models computing expectations just once," Quantitative Economics, Econometric Society, vol. 8(3), pages 851-893, November.
    6. Posch, Olaf & Trimborn, Timo, 2013. "Numerical solution of dynamic equilibrium models under Poisson uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 37(12), pages 2602-2622.
    7. Serguei Maliar & John Taylor & Lilia Maliar, 2016. "The Impact of Alternative Transitions to Normalized Monetary Policy," 2016 Meeting Papers 794, Society for Economic Dynamics.
    8. Lars J. Olson & Santanu Roy, 2006. "Theory of Stochastic Optimal Economic Growth," Springer Books, in: Rose-Anne Dana & Cuong Le Van & Tapan Mitra & Kazuo Nishimura (ed.), Handbook on Optimal Growth 1, chapter 11, pages 297-335, Springer.
    9. Alfonso Novales & Javier J. PÈrez, 2004. "Is It Worth Refining Linear Approximations to Non-Linear Rational Expectations Models?," Computational Economics, Springer;Society for Computational Economics, vol. 23(4), pages 343-377, June.
    10. Kenneth Judd & Lilia Maliar & Serguei Maliar, 2009. "Numerically Stable Stochastic Simulation Approaches for Solving Dynamic Economic Models," NBER Working Papers 15296, National Bureau of Economic Research, Inc.
    11. Guerra Vallejos, Ernesto & Bobenrieth Hochfarber, Eugenio & Bobenrieth Hochfarber, Juan & Wright, Brian D., 2021. "Solving dynamic stochastic models with multiple occasionally binding constraints," Economic Modelling, Elsevier, vol. 105(C).
    12. Michael Creel, 2008. "Using Parallelization to Solve a Macroeconomic Model: A Parallel Parameterized Expectations Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 343-352, November.
    13. Heer Burkhard & Maußner Alfred, 2011. "Value Function Iteration as a Solution Method for the Ramsey Model," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(4), pages 494-515, August.
    14. repec:hum:wpaper:sfb649dp2013-024 is not listed on IDEAS
    15. Pichler, Paul, 2011. "Solving the multi-country Real Business Cycle model using a monomial rule Galerkin method," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 240-251, February.
    16. Hull, Isaiah, 2015. "Approximate dynamic programming with post-decision states as a solution method for dynamic economic models," Journal of Economic Dynamics and Control, Elsevier, vol. 55(C), pages 57-70.
    17. José Cao-Alvira, 2010. "Finite Elements in the Presence of Occasionally Binding Constraints," Computational Economics, Springer;Society for Computational Economics, vol. 35(4), pages 355-370, April.
    18. Ajevskis, Viktors, 2019. "Nonlocal Solutions To Dynamic Equilibrium Models: The Approximate Stable Manifolds Approach," Macroeconomic Dynamics, Cambridge University Press, vol. 23(6), pages 2544-2571, September.
    19. Maliar, Lilia & Maliar, Serguei, 2005. "Solving nonlinear dynamic stochastic models: an algorithm computing value function by simulations," Economics Letters, Elsevier, vol. 87(1), pages 135-140, April.
    20. Klaeffling, Matt & López Pérez, Víctor, 2003. "Inflation targets and the liquidity trap," Working Paper Series 272, European Central Bank.
    21. Ángel Gavilán & Juan A. Rojas, 2009. "Solving Portfolio Problems with the Smolyak-Parameterized Expectations Algorithm," Working Papers 0838, Banco de España.

    More about this item

    Keywords

    Dynamic programming; Bellman equation; Optimal growth; Numerical techniques.;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • O41 - Economic Development, Innovation, Technological Change, and Growth - - Economic Growth and Aggregate Productivity - - - One, Two, and Multisector Growth Models
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ctc:serie6:itemq0745. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gianluca Femminis (email available below). General contact details of provider: https://edirc.repec.org/data/dscatit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.