IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v49y2017i1d10.1007_s10614-015-9544-1.html
   My bibliography  Save this article

A Toolkit for Value Function Iteration

Author

Listed:
  • Robert Kirkby

    (Victoria University of Wellington)

Abstract

This article introduces a Toolkit for Value Function Iteration. The toolkit is implemented in Matlab and makes automatic use of the GPU and of parallel CPUs. Likely uses are Teaching, Testing Algorithms, Replication, and Research. I here provide a description of some of the main components and algorithms. I also describe the design philosophy underlying choices about how to structure the toolkit and which algorithms to use. Rather than provide simple examples, something best done online (links are given), I instead perform a replication of a classic paper from the real business cycle literature as a demonstration of the use of such a toolkit. The Toolkit, Documentation, Examples, Replications, and more can be found at vfitoolkit.com

Suggested Citation

  • Robert Kirkby, 2017. "A Toolkit for Value Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 49(1), pages 1-15, January.
    • Handle: RePEc:kap:compec:v:49:y:2017:i:1:d:10.1007_s10614-015-9544-1
    DOI: 10.1007/s10614-015-9544-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-015-9544-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-015-9544-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hansen, Gary D., 1985. "Indivisible labor and the business cycle," Journal of Monetary Economics, Elsevier, vol. 16(3), pages 309-327, November.
    2. Maliar, Lilia & Maliar, Serguei, 2013. "Envelope condition method versus endogenous grid method for solving dynamic programming problems," Economics Letters, Elsevier, vol. 120(2), pages 262-266.
    3. Kamihigashi, Takashi & Stachurski, John, 2016. "Seeking ergodicity in dynamic economies," Journal of Economic Theory, Elsevier, vol. 163(C), pages 900-924.
    4. Lorenzo Garlappi & Georgios Skoulakis, 2009. "Numerical Solutions to Dynamic Portfolio Problems: The Case for Value Function Iteration using Taylor Approximation," Computational Economics, Springer;Society for Computational Economics, vol. 33(2), pages 193-207, March.
    5. Robert Kirkby Author-Email: robertkirkby@gmail.com|, 2017. "Convergence of Discretized Value Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 49(1), pages 117-153, January.
    6. Marimon, Ramon & Scott, Andrew (ed.), 2001. "Computational Methods for the Study of Dynamic Economies," OUP Catalogue, Oxford University Press, number 9780199248278.
    7. Manuel S. Santos & Adrian Peralta-Alva, 2005. "Accuracy of Simulations for Stochastic Dynamic Models," Econometrica, Econometric Society, vol. 73(6), pages 1939-1976, November.
    8. Manuel S. Santos & Adrian Peralta-Alva, 2005. "Accuracy of Simulations for Stochastic Dynamic Models," Econometrica, Econometric Society, vol. 73(6), pages 1939-1976, November.
    9. Aldrich, Eric M. & Fernández-Villaverde, Jesús & Ronald Gallant, A. & Rubio-Ramírez, Juan F., 2011. "Tapping the supercomputer under your desk: Solving dynamic equilibrium models with graphics processors," Journal of Economic Dynamics and Control, Elsevier, vol. 35(3), pages 386-393, March.
    10. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    11. Barillas, Francisco & Fernandez-Villaverde, Jesus, 2007. "A generalization of the endogenous grid method," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2698-2712, August.
    12. Matt Dziubinski & Stefano Grassi, 2014. "Heterogeneous Computing in Economics: A Simplified Approach," Computational Economics, Springer;Society for Computational Economics, vol. 43(4), pages 485-495, April.
    13. Lucas C. Coffman & Muriel Niederle, 2015. "Pre-analysis Plans Have Limited Upside, Especially Where Replications Are Feasible," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 81-98, Summer.
    14. Bona, Jerry L. & Santos, Manuel S., 1997. "On the Role of Computation in Economic Theory," Journal of Economic Theory, Elsevier, vol. 72(2), pages 241-281, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christopher Ferrall, 2020. "Object Oriented (Dynamic) Programming: Replication, Innovation and "Structural" Estimation," Working Paper 1432, Economics Department, Queen's University.
    2. Darío Serrano-Puente, 2020. "Optimal progressivity of personal income tax: a general equilibrium evaluation for Spain," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 11(4), pages 407-455, December.
    3. Hirokuni Iiboshi & Daikuke Ozaki & Yui Yoshii, 2023. "Child Care, Time Allocation, and the Life Cycle," Papers 2304.11531, arXiv.org, revised Jul 2024.
    4. Robert Kirkby Author-Email: robertkirkby@gmail.com|, 2017. "Convergence of Discretized Value Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 49(1), pages 117-153, January.
    5. Robert Kirkby, 2023. "Quantitative Macroeconomics: Lessons Learned from Fourteen Replications," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 875-896, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert Kirkby, 2016. "Value Function Iteration Toolkit: In Matlab, on the GPU," EcoMod2016 9122, EcoMod.
    2. Robert Kirkby Author-Email: robertkirkby@gmail.com|, 2017. "Convergence of Discretized Value Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 49(1), pages 117-153, January.
    3. Andrew Foerster & Juan F. Rubio‐Ramírez & Daniel F. Waggoner & Tao Zha, 2016. "Perturbation methods for Markov‐switching dynamic stochastic general equilibrium models," Quantitative Economics, Econometric Society, vol. 7(2), pages 637-669, July.
    4. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    5. Robert Kirkby, 2023. "Quantitative Macroeconomics: Lessons Learned from Fourteen Replications," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 875-896, February.
    6. RUGE-MURCIA, Francisco J., 2010. "Estimating Nonlinear DSGE Models by the Simulated Method of Moments," Cahiers de recherche 2010-10, Universite de Montreal, Departement de sciences economiques.
    7. Fernández-Villaverde, Jesús & Guerrón-Quintana, Pablo & Rubio-Ramírez, Juan F., 2015. "Estimating dynamic equilibrium models with stochastic volatility," Journal of Econometrics, Elsevier, vol. 185(1), pages 216-229.
    8. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2008. "How Structural Are Structural Parameters?," NBER Chapters, in: NBER Macroeconomics Annual 2007, Volume 22, pages 83-137, National Bureau of Economic Research, Inc.
    9. Guerrieri, Luca & Iacoviello, Matteo, 2015. "OccBin: A toolkit for solving dynamic models with occasionally binding constraints easily," Journal of Monetary Economics, Elsevier, vol. 70(C), pages 22-38.
    10. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2014. "Lower Bounds on Approximation Errors: Testing the Hypothesis That a Numerical Solution Is Accurate?," BYU Macroeconomics and Computational Laboratory Working Paper Series 2014-06, Brigham Young University, Department of Economics, BYU Macroeconomics and Computational Laboratory.
    11. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    12. Alexander Ludwig & Matthias Schön, 2018. "Endogenous Grids in Higher Dimensions: Delaunay Interpolation and Hybrid Methods," Computational Economics, Springer;Society for Computational Economics, vol. 51(3), pages 463-492, March.
    13. Kenneth L. Judd & Lilia Maliar & Serguei Maliar, 2017. "Lower Bounds on Approximation Errors to Numerical Solutions of Dynamic Economic Models," Econometrica, Econometric Society, vol. 85, pages 991-1012, May.
    14. Ayşe Kabukçuoğlu & Enrique Martínez-García, 2021. "A Generalized Time Iteration Method for Solving Dynamic Optimization Problems with Occasionally Binding Constraints," Computational Economics, Springer;Society for Computational Economics, vol. 58(2), pages 435-460, August.
    15. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    16. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    17. Ruge-Murcia, Francisco, 2012. "Estimating nonlinear DSGE models by the simulated method of moments: With an application to business cycles," Journal of Economic Dynamics and Control, Elsevier, vol. 36(6), pages 914-938.
    18. Manuel S. Santos & Adrian Peralta-Alva, 2012. "Analysis of Numerical Errors," Working Papers 2012-6, University of Miami, Department of Economics.
    19. Ayse Kabukcuoglu & Enrique Martínez-García, 2016. "The Market Resources Method for Solving Dynamic Optimization Problems," Koç University-TUSIAD Economic Research Forum Working Papers 1607, Koc University-TUSIAD Economic Research Forum.
    20. Kenichiro McAlinn & Kosaku Takanashi, 2021. "Convergence of Computed Dynamic Models with Unbounded Shock," Papers 2103.06483, arXiv.org.

    More about this item

    Keywords

    Value Function Iteration; Matlab Toolkit; GPU; Discretization; Replication;
    All these keywords.

    JEL classification:

    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • E00 - Macroeconomics and Monetary Economics - - General - - - General
    • C68 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computable General Equilibrium Models
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:49:y:2017:i:1:d:10.1007_s10614-015-9544-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.