IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v31y2008i2p181-206.html
   My bibliography  Save this article

Numerical Solution of Optimal Control Problems with Constant Control Delays

Author

Listed:
  • Ulrich Brandt-Pollmann
  • Ralph Winkler
  • Sebastian Sager
  • Ulf Moslener
  • Johannes Schlöder

Abstract

We investigate a class of optimal control problems that exhibit constant exogenously given delays in the control in the equation of motion of the differential states. Therefore, we formulate an exemplary optimal control problem with one stock and one control variable and review some analytic properties of an optimal solution. However, analytical considerations are quite limited in case of delayed optimal control problems. In order to overcome these limits, we reformulate the problem and apply direct numerical methods to calculate approximate solutions that give a better understanding of this class of optimization problems. In particular, we present two possibilities to reformulate the delayed optimal control problem into an instantaneous optimal control problem and show how these can be solved numerically with a state-of-the-art direct method by applying Bock’s direct multiple shooting algorithm. We further demonstrate the strength of our approach by two economic examples.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Ulrich Brandt-Pollmann & Ralph Winkler & Sebastian Sager & Ulf Moslener & Johannes Schlöder, 2008. "Numerical Solution of Optimal Control Problems with Constant Control Delays," Computational Economics, Springer;Society for Computational Economics, vol. 31(2), pages 181-206, March.
    • Handle: RePEc:kap:compec:v:31:y:2008:i:2:p:181-206
    DOI: 10.1007/s10614-007-9113-3
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10614-007-9113-3
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10614-007-9113-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Asea, Patrick K. & Zak, Paul J., 1999. "Time-to-build and cycles," Journal of Economic Dynamics and Control, Elsevier, vol. 23(8), pages 1155-1175, August.
    2. Fabrice Collard & Omar Licandro & Luis A. Puch, 2008. "The short-run Dynamics of Optimal Growth Model with Delays," Annals of Economics and Statistics, GENES, issue 90, pages 127-143.
    3. de la Croix, David & Licandro, Omar, 1999. "Life expectancy and endogenous growth," Economics Letters, Elsevier, vol. 65(2), pages 255-263, November.
    4. Raouf Boucekkine & David de la Croix & Omar Licandro, 2006. "Vintage Capital," Economics Working Papers ECO2006/8, European University Institute.
    5. Jody Overland & Christopher D. Carroll & David N. Weil, 2000. "Saving and Growth with Habit Formation," American Economic Review, American Economic Association, vol. 90(3), pages 341-355, June.
    6. Boucekkine, Raouf & Germain, Marc & Licandro, Omar, 1997. "Replacement Echoes in the Vintage Capital Growth Model," Journal of Economic Theory, Elsevier, vol. 74(2), pages 333-348, June.
    7. Boucekkine, Raouf & Licandro, Omar & Puch, Luis A. & del Rio, Fernando, 2005. "Vintage capital and the dynamics of the AK model," Journal of Economic Theory, Elsevier, vol. 120(1), pages 39-72, January.
    8. Boucekkine, Raouf & Germain, Marc & Licandro, Omar & Magnus, Alphonse, 1998. "Creative Destruction, Investment Volatility, and the Average Age of Capital," Journal of Economic Growth, Springer, vol. 3(4), pages 361-384, December.
    9. Feichtinger, Gustav & Hartl, Richard F. & Kort, Peter M. & Veliov, Vladimir M., 2006. "Anticipation effects of technological progress on capital accumulation: a vintage capital approach," Journal of Economic Theory, Elsevier, vol. 126(1), pages 143-164, January.
    10. Benhabib, Jess & Rustichini, Aldo, 1991. "Vintage capital, investment, and growth," Journal of Economic Theory, Elsevier, vol. 55(2), pages 323-339, December.
    11. Boucekkine, Raouf & Germain, Marc & Licandro, Omar & Magnus, Alphonse, 2001. "Numerical solution by iterative methods of a class of vintage capital models," Journal of Economic Dynamics and Control, Elsevier, vol. 25(5), pages 655-669, May.
    12. Boyer, Marcel, 1978. "A Habit Forming Optimal Growth Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 19(3), pages 585-609, October.
    13. Raouf Boucekkine & David Croix & Omar Licandro, 2004. "MODELLING VINTAGE STRUCTURES WITH DDEs: PRINCIPLES AND APPLICATIONS," Mathematical Population Studies, Taylor & Francis Journals, vol. 11(3-4), pages 151-179.
    14. Boucekkine, Raouf & de la Croix, David & Licandro, Omar, 2002. "Vintage Human Capital, Demographic Trends, and Endogenous Growth," Journal of Economic Theory, Elsevier, vol. 104(2), pages 340-375, June.
    15. Boucekkine, Raouf & Licandro, Omar & Paul, Christopher, 1997. "Differential-difference equations in economics: On the numerical solution of vintage capital growth models," Journal of Economic Dynamics and Control, Elsevier, vol. 21(2-3), pages 347-362.
    16. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    17. Peeters, Marga, 1996. "Investment gestation lags: The difference between time-to-build and delivery lags," MPRA Paper 28549, University Library of Munich, Germany.
    18. Winkler, Ralph & Brandt-Pollmann, Ulrich & Moslener, Ulf & Schlöder, Johannes, 2005. "On the Transition from Instantaneous to Time-Lagged Capital Accumilation: The Case of Leontief Type Production Functions," ZEW Discussion Papers 05-30, ZEW - Leibniz Centre for European Economic Research.
    19. El-Hodiri, Mohamed A & Loehman, Edna & Whinston, Andrew B, 1972. "An Optimal Growth Model with Time Lags," Econometrica, Econometric Society, vol. 40(6), pages 1137-1146, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yüksel, Mustafa Kerem, 2011. "Capital dependent population growth induces cycles," Chaos, Solitons & Fractals, Elsevier, vol. 44(9), pages 759-763.
    2. Balistreri, Edward J. & Hillberry, Russell H. & Rutherford, Thomas F., 2011. "Structural estimation and solution of international trade models with heterogeneous firms," Journal of International Economics, Elsevier, vol. 83(2), pages 95-108, March.
    3. Ralph Winkler, 2008. "Optimal control of pollutants with delayed stock accumulation," CER-ETH Economics working paper series 08/91, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    4. Leon A. Petrosyan & David W.K. Yeung, 2020. "Cooperative Dynamic Games with Durable Controls: Theory and Application," Dynamic Games and Applications, Springer, vol. 10(4), pages 872-896, December.
    5. Cyril Bourgeois & Pierre-Alain Jayet, 2010. "Revisited water-oriented relationships between a set of farmers and an aquifer: accounting for lag effect," Working Papers 2010/06, INRA, Economie Publique.
    6. David W. K. Yeung & Leon A. Petrosyan, 2019. "Cooperative Dynamic Games with Control Lags," Dynamic Games and Applications, Springer, vol. 9(2), pages 550-567, June.
    7. Rădulescu, I.R. & Cândea, D. & Halanay, A., 2016. "Optimal control analysis of a leukemia model under imatinib treatment," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 121(C), pages 1-11.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raouf Boucekkine & David De la Croix & Omar Licandro, 2011. "Vintage Capital Growth Theory: Three Breakthroughs," Working Papers 565, Barcelona School of Economics.
    2. Raouf Boucekkine & David Croix & Omar Licandro, 2004. "MODELLING VINTAGE STRUCTURES WITH DDEs: PRINCIPLES AND APPLICATIONS," Mathematical Population Studies, Taylor & Francis Journals, vol. 11(3-4), pages 151-179.
    3. Bambi, Mauro & Gozzi, Fausto & Licandro, Omar, 2014. "Endogenous growth and wave-like business fluctuations," Journal of Economic Theory, Elsevier, vol. 154(C), pages 68-111.
    4. Fabrice Collard & Omar Licandro & Luis A. Puch, 2008. "The short-run Dynamics of Optimal Growth Model with Delays," Annals of Economics and Statistics, GENES, issue 90, pages 127-143.
    5. Augeraud-Veron, Emmanuelle & Bambi, Mauro, 2015. "Endogenous growth with addictive habits," Journal of Mathematical Economics, Elsevier, vol. 56(C), pages 15-25.
    6. Hippolyte d'Albis & Jean-Pierre Drugeon, 2020. "On Investment and Cycles in Explicitely Solved Vintage Capital Models," PSE Working Papers halshs-02570648, HAL.
    7. Lin, Hwan C. & Shampine, L.F., 2014. "Finite-length Patents and Functional Differential Equations in a Non-scale R&D-based Growth Model," MPRA Paper 61603, University Library of Munich, Germany.
    8. Hwan C. Lin & L. F. Shampine, 2018. "R&D-based Calibrated Growth Models with Finite-Length Patents: A Novel Relaxation Algorithm for Solving an Autonomous FDE System of Mixed Type," Computational Economics, Springer;Society for Computational Economics, vol. 51(1), pages 123-158, January.
    9. Mauro Bambi, 2006. "Endogenous growth and time to build: the AK case," Computing in Economics and Finance 2006 77, Society for Computational Economics.
    10. Faggian, Silvia & Gozzi, Fausto & Kort, Peter M., 2021. "Optimal investment with vintage capital: Equilibrium distributions," Journal of Mathematical Economics, Elsevier, vol. 96(C).
    11. Fabbri, Giorgio & Gozzi, Fausto, 2008. "Solving optimal growth models with vintage capital: The dynamic programming approach," Journal of Economic Theory, Elsevier, vol. 143(1), pages 331-373, November.
    12. Gamboa, Franklin & Maldonado, Wilfredo Leiva, 2014. "Feasibility and optimality of the initial capital stock in the Ramsey vintage capital model," Journal of Mathematical Economics, Elsevier, vol. 52(C), pages 40-45.
    13. Futagami, Koichi & Iwaisako, Tatsuro, 2007. "Dynamic analysis of patent policy in an endogenous growth model," Journal of Economic Theory, Elsevier, vol. 132(1), pages 306-334, January.
    14. d’Albis, Hippolyte & Augeraud-Véron, Emmanuelle & Hupkes, Hermen Jan, 2014. "Multiple solutions in systems of functional differential equations," Journal of Mathematical Economics, Elsevier, vol. 52(C), pages 50-56.
    15. Mauro Bambi & Cristina Girolami & Salvatore Federico & Fausto Gozzi, 2017. "Generically distributed investments on flexible projects and endogenous growth," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 63(2), pages 521-558, February.
    16. Fabbri, Giorgio, 2006. "Viscosity solutions approach to economic models governed by DDEs," MPRA Paper 2826, University Library of Munich, Germany.
    17. David de la Croix & Omar Licandro, 2013. "The Child is Father Of the Man: Implications for the Demographic Transition," Economic Journal, Royal Economic Society, vol. 123(567), pages 236-261, March.
    18. Ralph Winkler, 2008. "Optimal control of pollutants with delayed stock accumulation," CER-ETH Economics working paper series 08/91, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    19. d’Albis, Hippolyte & Augeraud-Veron, Emmanuelle & Venditti, Alain, 2012. "Business cycle fluctuations and learning-by-doing externalities in a one-sector model," Journal of Mathematical Economics, Elsevier, vol. 48(5), pages 295-308.
    20. Boucekkine, Raouf & Licandro, Omar & Puch, Luis A. & del Rio, Fernando, 2005. "Vintage capital and the dynamics of the AK model," Journal of Economic Theory, Elsevier, vol. 120(1), pages 39-72, January.

    More about this item

    Keywords

    Delayed differential equations; Delayed optimal control; Numerical optimization; C63; C61;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:31:y:2008:i:2:p:181-206. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.