IDEAS home Printed from https://ideas.repec.org/a/spr/mathme/v81y2015i3p245-267.html
   My bibliography  Save this article

Dynamic programming with Hermite approximation

Author

Listed:
  • Yongyang Cai
  • Kenneth Judd

Abstract

Numerical dynamic programming algorithms typically use Lagrange data to approximate value functions over continuous states. Hermite data can be easily obtained from solving the Bellman equation and used to approximate the value functions. We illustrate the use of Hermite data with one-, three-, and six-dimensional examples. We find that Hermite approximation improves the accuracy in value function iteration (VFI) by one to three digits using little extra computing time. Moreover, VFI with Hermite approximation is significantly faster than VFI with Lagrange approximation for the same accuracy, and this advantage increases with the dimension of the continuous states. Copyright Springer-Verlag Berlin Heidelberg 2015

Suggested Citation

  • Yongyang Cai & Kenneth Judd, 2015. "Dynamic programming with Hermite approximation," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 81(3), pages 245-267, June.
  • Handle: RePEc:spr:mathme:v:81:y:2015:i:3:p:245-267
    DOI: 10.1007/s00186-015-0495-z
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00186-015-0495-z
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s00186-015-0495-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yongyang Cai & Kenneth Judd & Greg Thain & Stephen Wright, 2015. "Solving Dynamic Programming Problems on a Computational Grid," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 261-284, February.
    2. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, April.
    3. Juillard, Michel & Villemot, Sébastien, 2011. "Multi-country real business cycle models: Accuracy tests and test bench," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 178-185, February.
    4. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2011. "Numerically stable and accurate stochastic simulation approaches for solving dynamic economic models," Quantitative Economics, Econometric Society, vol. 2(2), pages 173-210, July.
    5. J. Rust & J. F. Traub & H. Wozniakowski, 2002. "Is There a Curse of Dimensionality for Contraction Fixed Points in the Worst Case?," Econometrica, Econometric Society, vol. 70(1), pages 285-329, January.
    6. Yongyang Cai & Kenneth L. Judd & Thomas S. Lontzek, 2013. "The Social Cost of Stochastic and Irreversible Climate Change," NBER Working Papers 18704, National Bureau of Economic Research, Inc.
    7. Den Haan, Wouter J. & Judd, Kenneth L. & Juillard, Michel, 2011. "Computational suite of models with heterogeneous agents II: Multi-country real business cycle models," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 175-177, February.
    8. Elizabeth D. Dolan & Robert Fourer & Jean-Pierre Goux & Todd S. Munson & Jason Sarich, 2008. "Kestrel: An Interface from Optimization Modeling Systems to the NEOS Server," INFORMS Journal on Computing, INFORMS, vol. 20(4), pages 525-538, November.
    9. C. Russell Philbrick & Peter K. Kitanidis, 2001. "Improved Dynamic Programming Methods for Optimal Control of Lumped-Parameter Stochastic Systems," Operations Research, INFORMS, vol. 49(3), pages 398-412, June.
    10. Richard Bellman, 1957. "On a Dynamic Programming Approach to the Caterer Problem--I," Management Science, INFORMS, vol. 3(3), pages 270-278, April.
    11. Aldrich, Eric M. & Fernández-Villaverde, Jesús & Ronald Gallant, A. & Rubio-Ramírez, Juan F., 2011. "Tapping the supercomputer under your desk: Solving dynamic equilibrium models with graphics processors," Journal of Economic Dynamics and Control, Elsevier, vol. 35(3), pages 386-393, March.
    12. Yongyang Cai & Kenneth L. Judd & Rong Xu, 2013. "Numerical Solution of Dynamic Portfolio Optimization with Transaction Costs," NBER Working Papers 18709, National Bureau of Economic Research, Inc.
    13. Trick, Michael A. & Zin, Stanley E., 1997. "Spline Approximations To Value Functions," Macroeconomic Dynamics, Cambridge University Press, vol. 1(1), pages 255-277, January.
    14. Robert Fourer & David M. Gay & Brian W. Kernighan, 1990. "A Modeling Language for Mathematical Programming," Management Science, INFORMS, vol. 36(5), pages 519-554, May.
    15. Yongyang Cai & Kenneth Judd, 2013. "Shape-preserving dynamic programming," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 77(3), pages 407-421, June.
    16. Malin, Benjamin A. & Krueger, Dirk & Kubler, Felix, 2011. "Solving the multi-country real business cycle model using a Smolyak-collocation method," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 229-239, February.
    17. John Rust, 1997. "Using Randomization to Break the Curse of Dimensionality," Econometrica, Econometric Society, vol. 65(3), pages 487-516, May.
    18. Joao F. Cocco, 2005. "Consumption and Portfolio Choice over the Life Cycle," The Review of Financial Studies, Society for Financial Studies, vol. 18(2), pages 491-533.
    19. Cai, Yongyang & Judd, Kenneth L., 2012. "Dynamic programming with shape-preserving rational spline Hermite interpolation," Economics Letters, Elsevier, vol. 117(1), pages 161-164.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yongyang Cai & Kenneth Judd & Jevgenijs Steinbuks, 2017. "A nonlinear certainty equivalent approximation method for dynamic stochastic problems," Quantitative Economics, Econometric Society, vol. 8(1), pages 117-147, March.
    2. Peter Schober & Julian Valentin & Dirk Pflüger, 2022. "Solving High-Dimensional Dynamic Portfolio Choice Models with Hierarchical B-Splines on Sparse Grids," Computational Economics, Springer;Society for Computational Economics, vol. 59(1), pages 185-224, January.
    3. Yongyang Cai & Kenneth L. Judd & Rong Xu, 2013. "Numerical Solution of Dynamic Portfolio Optimization with Transaction Costs," NBER Working Papers 18709, National Bureau of Economic Research, Inc.
    4. Wonjun Chang & Michael C. Ferris & Youngdae Kim & Thomas F. Rutherford, 2020. "Solving Stochastic Dynamic Programming Problems: A Mixed Complementarity Approach," Computational Economics, Springer;Society for Computational Economics, vol. 55(3), pages 925-955, March.
    5. Yongyang Cai & Kenneth L. Judd & Thomas S. Lontzek, 2013. "The Social Cost of Stochastic and Irreversible Climate Change," NBER Working Papers 18704, National Bureau of Economic Research, Inc.
    6. Yongyang Cai & Kenneth Judd & Greg Thain & Stephen Wright, 2015. "Solving Dynamic Programming Problems on a Computational Grid," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 261-284, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yongyang Cai & Kenneth Judd & Greg Thain & Stephen Wright, 2015. "Solving Dynamic Programming Problems on a Computational Grid," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 261-284, February.
    2. Yongyang Cai & Kenneth Judd & Jevgenijs Steinbuks, 2017. "A nonlinear certainty equivalent approximation method for dynamic stochastic problems," Quantitative Economics, Econometric Society, vol. 8(1), pages 117-147, March.
    3. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    4. Yongyang Cai & Kenneth L. Judd, 2023. "A simple but powerful simulated certainty equivalent approximation method for dynamic stochastic problems," Quantitative Economics, Econometric Society, vol. 14(2), pages 651-687, May.
    5. Peter Schober & Julian Valentin & Dirk Pflüger, 2022. "Solving High-Dimensional Dynamic Portfolio Choice Models with Hierarchical B-Splines on Sparse Grids," Computational Economics, Springer;Society for Computational Economics, vol. 59(1), pages 185-224, January.
    6. Cai, Yongyang & Judd, Kenneth L. & Lontzek, Thomas S. & Michelangeli, Valentina & Su, Che-Lin, 2017. "A Nonlinear Programming Method For Dynamic Programming," Macroeconomic Dynamics, Cambridge University Press, vol. 21(2), pages 336-361, March.
    7. Lilia Maliar & Serguei Maliar & Sébastien Villemot, 2013. "Taking Perturbation to the Accuracy Frontier: A Hybrid of Local and Global Solutions," Computational Economics, Springer;Society for Computational Economics, vol. 42(3), pages 307-325, October.
    8. Judd, Kenneth L. & Maliar, Lilia & Maliar, Serguei & Valero, Rafael, 2014. "Smolyak method for solving dynamic economic models: Lagrange interpolation, anisotropic grid and adaptive domain," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 92-123.
    9. Yongyang Cai & Kenneth L. Judd & Rong Xu, 2013. "Numerical Solution of Dynamic Portfolio Optimization with Transaction Costs," NBER Working Papers 18709, National Bureau of Economic Research, Inc.
    10. Yongyang Cai & Kenneth Judd, 2013. "Shape-preserving dynamic programming," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 77(3), pages 407-421, June.
    11. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    12. Kristensen, Dennis & Mogensen, Patrick K. & Moon, Jong Myun & Schjerning, Bertel, 2021. "Solving dynamic discrete choice models using smoothing and sieve methods," Journal of Econometrics, Elsevier, vol. 223(2), pages 328-360.
    13. Mercedes Esteban-Bravo & Jose M. Vidal-Sanz & Gökhan Yildirim, 2014. "Valuing Customer Portfolios with Endogenous Mass and Direct Marketing Interventions Using a Stochastic Dynamic Programming Decomposition," Marketing Science, INFORMS, vol. 33(5), pages 621-640, September.
    14. Fernández-Villaverde, Jesús & Gordon, Grey & Guerrón-Quintana, Pablo & Rubio-Ramírez, Juan F., 2015. "Nonlinear adventures at the zero lower bound," Journal of Economic Dynamics and Control, Elsevier, vol. 57(C), pages 182-204.
    15. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2014. "Lower Bounds on Approximation Errors: Testing the Hypothesis That a Numerical Solution Is Accurate?," BYU Macroeconomics and Computational Laboratory Working Paper Series 2014-06, Brigham Young University, Department of Economics, BYU Macroeconomics and Computational Laboratory.
    16. Kollmann, Robert & Maliar, Serguei & Malin, Benjamin A. & Pichler, Paul, 2011. "Comparison of solutions to the multi-country Real Business Cycle model," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 186-202, February.
    17. Maliar, Serguei & Maliar, Lilia & Judd, Kenneth, 2011. "Solving the multi-country real business cycle model using ergodic set methods," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 207-228, February.
    18. Malin, Benjamin A. & Krueger, Dirk & Kubler, Felix, 2011. "Solving the multi-country real business cycle model using a Smolyak-collocation method," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 229-239, February.
    19. Aryan Eftekhari & Simon Scheidegger, 2022. "High-Dimensional Dynamic Stochastic Model Representation," Papers 2202.06555, arXiv.org.
    20. Julien Albertini & Stéphane Moyen, 2020. "A General and Efficient Method for Solving Regime-Switching DSGE Models," Working Papers 2035, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.

    More about this item

    Keywords

    Dynamic programming; Value function iteration; Hermite approximation; Dynamic portfolio optimization; Multi-country optimal growth model; C61; C63;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:mathme:v:81:y:2015:i:3:p:245-267. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.