IDEAS home Printed from https://ideas.repec.org/a/eee/dyncon/v37y2013i11p2322-2335.html
   My bibliography  Save this article

A polyhedral approximation approach to concave numerical dynamic programming

Author

Listed:
  • Fukushima, Kenichi
  • Waki, Yuichiro

Abstract

This paper introduces a numerical method for solving concave continuous state dynamic programming problems which is based on a pair of polyhedral approximations of concave functions. The method is globally convergent and produces computable upper and lower bounds on the value function which can in theory be made arbitrarily tight. This is true regardless of the pattern of binding constraints, the smoothness of model primitives, and the dimensionality and rectangularity of the state space. We illustrate the method's performance using an optimal firm management problem subject to credit constraints and partial investment irreversibilities.

Suggested Citation

  • Fukushima, Kenichi & Waki, Yuichiro, 2013. "A polyhedral approximation approach to concave numerical dynamic programming," Journal of Economic Dynamics and Control, Elsevier, vol. 37(11), pages 2322-2335.
    • Handle: RePEc:eee:dyncon:v:37:y:2013:i:11:p:2322-2335
    DOI: 10.1016/j.jedc.2013.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165188913001334
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jedc.2013.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christopher Phelan & Robert M. Townsend, 1991. "Computing Multi-Period, Information-Constrained Optima," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(5), pages 853-881.
    2. John Stachurski, 2008. "Continuous State Dynamic Programming via Nonexpansive Approximation," Computational Economics, Springer;Society for Computational Economics, vol. 31(2), pages 141-160, March.
    3. Aubhik Khan & Julia K. Thomas, 2013. "Credit Shocks and Aggregate Fluctuations in an Economy with Production Heterogeneity," Journal of Political Economy, University of Chicago Press, vol. 121(6), pages 1055-1107.
    4. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, April.
    5. Andrew B. Abel & Janice C. Eberly, 1996. "Optimal Investment with Costly Reversibility," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 63(4), pages 581-593.
    6. Kiyotaki, Nobuhiro & Moore, John, 1997. "Credit Cycles," Journal of Political Economy, University of Chicago Press, vol. 105(2), pages 211-248, April.
    7. Julia K. Thomas & Aubhik Khan, 2011. "Default Risk and Aggregate Fluctuations in an Economy with Production Heterogeneity," 2011 Meeting Papers 1333, Society for Economic Dynamics.
    8. Tauchen, George, 1986. "Finite state markov-chain approximations to univariate and vector autoregressions," Economics Letters, Elsevier, vol. 20(2), pages 177-181.
    9. Kenneth L. Judd & Sevin Yeltekin & James Conklin, 2003. "Computing Supergame Equilibria," Econometrica, Econometric Society, vol. 71(4), pages 1239-1254, July.
    10. Nishimura, Kazuo & Stachurski, John, 2009. "Equilibrium storage with multiple commodities," Journal of Mathematical Economics, Elsevier, vol. 45(1-2), pages 80-96, January.
    11. Manuel S. Santos & Jesus Vigo-Aguiar, 1998. "Analysis of a Numerical Dynamic Programming Algorithm Applied to Economic Models," Econometrica, Econometric Society, vol. 66(2), pages 409-426, March.
    12. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    13. Manuel S. Santos, 2000. "Accuracy of Numerical Solutions using the Euler Equation Residuals," Econometrica, Econometric Society, vol. 68(6), pages 1377-1402, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Waki, Yuichiro & Dennis, Richard & Fujiwara, Ippei, 2018. "The optimal degree of monetary-discretion in a New Keynesian model with private information," Theoretical Economics, Econometric Society, vol. 13(3), September.
    2. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    3. Waki, Yuichiro & Dennis, Richard & Fujiwara, Ippei, 2015. "The Optimal Degree of Monetary-Discretion in a New Keynesian Model with Private Information," 2007 Annual Meeting, July 29-August 1, 2007, Portland, Oregon TN 2015-66, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    4. Jenö Pál & John Stachurski, 2011. "Fitted Value Function Iteration With Probability One Contractions," ANU Working Papers in Economics and Econometrics 2011-560, Australian National University, College of Business and Economics, School of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicholas Bloom & Max Floetotto & Nir Jaimovich & Itay Saporta†Eksten & Stephen J. Terry, 2018. "Really Uncertain Business Cycles," Econometrica, Econometric Society, vol. 86(3), pages 1031-1065, May.
    2. Xiao, J., 2016. "Corporate Debt Structure, Precautionary Savings, and Investment Dynamics," Cambridge Working Papers in Economics 1666, Faculty of Economics, University of Cambridge.
    3. Fabrizio Perri & Vincenzo Quadrini, 2018. "International Recessions," American Economic Review, American Economic Association, vol. 108(4-5), pages 935-984, April.
    4. Robert Kirkby Author-Email: robertkirkby@gmail.com|, 2017. "Convergence of Discretized Value Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 49(1), pages 117-153, January.
    5. Safronov, M., 2016. "Experimentation and Learning-by-Doing," Cambridge Working Papers in Economics 1667, Faculty of Economics, University of Cambridge.
    6. Yicheng Wang, 2017. "Debt-Market Friction, Firm-specific Knowledge Capital Accumulation and Macroeconomic Implications," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 26, pages 19-39, October.
    7. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    8. Joao Ayres & Gajendran Raveendranathan, 2023. "Firm Entry and Exit during Recessions," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 47, pages 47-66, January.
    9. Aruoba, S. Boragan & Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Comparing solution methods for dynamic equilibrium economies," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2477-2508, December.
    10. Barillas, Francisco & Fernandez-Villaverde, Jesus, 2007. "A generalization of the endogenous grid method," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2698-2712, August.
    11. Joao Ayres & Gajendran Raveendranathan, 2018. "The Firm Dynamics of Business Cycles," Department of Economics Working Papers 2018-16, McMaster University.
    12. Iván Alfaro & Nicholas Bloom & Xiaoji Lin, 2024. "The Finance Uncertainty Multiplier," Journal of Political Economy, University of Chicago Press, vol. 132(2), pages 577-615.
    13. Fernandez-Villaverde, Jesus & Rubio-Ramirez, Juan F., 2006. "Solving DSGE models with perturbation methods and a change of variables," Journal of Economic Dynamics and Control, Elsevier, vol. 30(12), pages 2509-2531, December.
    14. Arellano, Cristina & Maliar, Lilia & Maliar, Serguei & Tsyrennikov, Viktor, 2016. "Envelope condition method with an application to default risk models," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 436-459.
    15. Moody Chu & Chun-Hung Kuo & Matthew Lin, 2013. "Tensor Spline Approximation in Economic Dynamics with Uncertainties," Computational Economics, Springer;Society for Computational Economics, vol. 42(2), pages 175-198, August.
    16. Giuseppe Fiori & Filippo Scoccianti, 2021. "Aggregate dynamics and microeconomic heterogeneity: the role of vintage technology," Questioni di Economia e Finanza (Occasional Papers) 651, Bank of Italy, Economic Research and International Relations Area.
    17. Yicheng Wang, 2015. "Can Wage Dynamics in Long-term Employment Relationships Help Mitigate Financial Shocks?," 2015 Meeting Papers 1189, Society for Economic Dynamics.
    18. Huiyu Li, 2015. "Numerical Policy Error Bounds for $$\eta $$ η -Concave Stochastic Dynamic Programming with Non-interior Solutions," Computational Economics, Springer;Society for Computational Economics, vol. 46(2), pages 171-187, August.
    19. Jesus Fernandez-Villaverde & Juan F. Rubio-Ramirez, 2003. "Some Results on the Solution of the Neoclassical Growth Model," PIER Working Paper Archive 04-002, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    20. Marios Karabarbounis & Patrick Macnamara, 2021. "Misallocation and Financial Frictions: the Role of Long-Term Financing," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 40, pages 44-63, April.

    More about this item

    Keywords

    Numerical methods; Dynamic programming;

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:dyncon:v:37:y:2013:i:11:p:2322-2335. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jedc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.