IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v219y2012i1p18-26.html
   My bibliography  Save this article

A tutorial on the deterministic Impulse Control Maximum Principle: Necessary and sufficient optimality conditions

Author

Listed:
  • Chahim, Mohammed
  • Hartl, Richard F.
  • Kort, Peter M.

Abstract

This paper considers a class of optimal control problems that allows jumps in the state variable. We present the necessary optimality conditions of the Impulse Control Maximum Principle based on the current value formulation. By reviewing the existing impulse control models in the literature, we point out that meaningful problems do not satisfy the sufficiency conditions. In particular, such problems either have a concave cost function, contain a fixed cost, or have a control-state interaction, which have in common that they each violate the concavity hypotheses used in the sufficiency theorem. The implication is that the corresponding problem in principle has multiple solutions that satisfy the necessary optimality conditions. Moreover, we argue that problems with fixed cost do not satisfy the conditions under which the necessary optimality conditions can be applied. However, we design a transformation, which ensures that the application of the Impulse Control Maximum Principle still provides the optimal solution. Finally, we show for the first time that for some existing models in the literature no optimal solution exists.

Suggested Citation

  • Chahim, Mohammed & Hartl, Richard F. & Kort, Peter M., 2012. "A tutorial on the deterministic Impulse Control Maximum Principle: Necessary and sufficient optimality conditions," European Journal of Operational Research, Elsevier, vol. 219(1), pages 18-26.
    • Handle: RePEc:eee:ejores:v:219:y:2012:i:1:p:18-26
    DOI: 10.1016/j.ejor.2011.12.035
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221711011295
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2011.12.035?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dale Jorgenson, 1967. "The Theory of Investment Behavior," NBER Chapters, in: Determinants of Investment Behavior, pages 129-175, National Bureau of Economic Research, Inc.
    2. Katrin Erdlenbruch & Alain Jean-Marie & Michel Moreaux & Mabel Tidball, 2013. "Optimality of impulse harvesting policies," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 52(2), pages 429-459, March.
    3. Y. Liu & K. L. Teo & L. S. Jennings & S. Wang, 1998. "On a Class of Optimal Control Problems with State Jumps," Journal of Optimization Theory and Applications, Springer, vol. 98(1), pages 65-82, July.
    4. Luhmer, Alfred, 1986. "A continuous time, deterministic, nonstationary model of economic ordering," European Journal of Operational Research, Elsevier, vol. 24(1), pages 123-135, January.
    5. Avinash K. Dixit & Robert S. Pindyck, 1994. "Investment under Uncertainty," Economics Books, Princeton University Press, edition 1, number 5474.
    6. Gaimon, Cheryl, 1986. "An impulsive control approach to deriving the optimal dynamic mix of manual and automatic output," European Journal of Operational Research, Elsevier, vol. 24(3), pages 360-368, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. M. Chahim & D. Grass & R. F. Hartl & P. M. Kort, 2017. "Product innovation with lumpy investment," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 25(1), pages 159-182, March.
    2. Grass, D. & Chahim, M., 2012. "Numerical Algorithms for Deterministic Impulse Control Models with Applications," Discussion Paper 2012-081, Tilburg University, Center for Economic Research.
    3. De Giovanni, Pietro & Zaccour, Georges, 2023. "A survey of dynamic models of product quality," European Journal of Operational Research, Elsevier, vol. 307(3), pages 991-1007.
    4. Perera, Sandun & Gupta, Varun & Buckley, Winston, 2020. "Management of online server congestion using optimal demand throttling," European Journal of Operational Research, Elsevier, vol. 285(1), pages 324-342.
    5. Utsav Sadana & Puduru Viswanadha Reddy & Tamer Başar & Georges Zaccour, 2021. "Sampled-Data Nash Equilibria in Differential Games with Impulse Controls," Journal of Optimization Theory and Applications, Springer, vol. 190(3), pages 999-1022, September.
    6. Imane Abouelkheir & Fadwa El Kihal & Mostafa Rachik & Ilias Elmouki, 2019. "Optimal Impulse Vaccination Approach for an SIR Control Model with Short-Term Immunity," Mathematics, MDPI, vol. 7(5), pages 1-21, May.
    7. Grass, D. & Chahim, M., 2012. "Numerical Algorithms for Deterministic Impulse Control Models with Applications," Other publications TiSEM 1295ac64-8704-4e47-ae89-b, Tilburg University, School of Economics and Management.
    8. Korn, Ralf & Melnyk, Yaroslav & Seifried, Frank Thomas, 2017. "Stochastic impulse control with regime-switching dynamics," European Journal of Operational Research, Elsevier, vol. 260(3), pages 1024-1042.
    9. Lappi, Pauli, 2018. "Optimal clean-up of polluted sites," Resource and Energy Economics, Elsevier, vol. 54(C), pages 53-68.
    10. Chahim, M. & Brekelmans, R.C.M. & den Hertog, D. & Kort, P.M., 2012. "An Impulse Control Approach to Dike Height Optimization (Revised version of CentER DP 2011-097)," Other publications TiSEM 3c3300f1-03c8-45b2-9fb6-4, Tilburg University, School of Economics and Management.
    11. Freya Bachmann & Gilbert Koch & Marc Pfister & Gabor Szinnai & Johannes Schropp, 2021. "OptiDose: Computing the Individualized Optimal Drug Dosing Regimen Using Optimal Control," Journal of Optimization Theory and Applications, Springer, vol. 189(1), pages 46-65, April.
    12. Johanna Grames & Dieter Grass & Peter M. Kort & Alexia Prskawetz, 2019. "Optimal investment and location decisions of a firm in a flood risk area using impulse control theory," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 27(4), pages 1051-1077, December.
    13. Richard F. Hartl & Peter M. Kort & Andrea Seidl, 2020. "Decisions on pricing, capacity investment, and introduction timing of new product generations in a durable-good monopoly," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 28(2), pages 497-519, June.
    14. Sadana, Utsav & Reddy, Puduru Viswanadha & Zaccour, Georges, 2021. "Nash equilibria in nonzero-sum differential games with impulse control," European Journal of Operational Research, Elsevier, vol. 295(2), pages 792-805.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chahim, M. & Hartl, R.F. & Kort, P.M., 2011. "The Deterministic Impulse Control Maximum Principle in Operations Research : Necessary and Sufficient Optimality Conditions (replaces CentER DP 2011-052)," Discussion Paper 2011-133, Tilburg University, Center for Economic Research.
    2. Samuel, Cherian, 1996. "The investment decision : a re-examination of competing theories using panel data," Policy Research Working Paper Series 1656, The World Bank.
    3. Peter N. Gal & Gabor Pinter, 2017. "Capital over the Business Cycle: Renting versus Ownership," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(6), pages 1299-1338, September.
    4. Grass, D. & Chahim, M., 2012. "Numerical Algorithms for Deterministic Impulse Control Models with Applications," Discussion Paper 2012-081, Tilburg University, Center for Economic Research.
    5. Grass, D. & Chahim, M., 2012. "Numerical Algorithms for Deterministic Impulse Control Models with Applications," Other publications TiSEM 1295ac64-8704-4e47-ae89-b, Tilburg University, School of Economics and Management.
    6. Mahraddika, Wishnu, 2019. "Does international reserve accumulation crowd out domestic private investment?," International Economics, Elsevier, vol. 158(C), pages 39-50.
    7. Prema-Chandra Athukorala & Kunal Sen, 1996. "Reforms And Investment In India," Departmental Working Papers 1996-06, The Australian National University, Arndt-Corden Department of Economics.
    8. Sinem Celik Girgin & Thanasis Karlis & Hong-Oanh Nguyen, 2018. "A Critical Review of the Literature on Firm-Level Theories on Ship Investment," IJFS, MDPI, vol. 6(1), pages 1-19, January.
    9. Shiferaw, A., 2002. "Private investment and public policy in sub-Saharan Africa," ISS Working Papers - General Series 19100, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    10. Hassan B. GHASSAN & Hassan R. ALHAJHOJ, 2012. "Bound Cointegration Test on Private Investment’s Equation: Evidence from Saudi Economy," Applied Econometrics and International Development, Euro-American Association of Economic Development, vol. 12(1).
    11. Sadana, Utsav & Reddy, Puduru Viswanadha & Zaccour, Georges, 2021. "Nash equilibria in nonzero-sum differential games with impulse control," European Journal of Operational Research, Elsevier, vol. 295(2), pages 792-805.
    12. Ben Abdallah, Skander & Lasserre, Pierre, 2016. "Asset retirement with infinitely repeated alternative replacements: Harvest age and species choice in forestry," Journal of Economic Dynamics and Control, Elsevier, vol. 70(C), pages 144-164.
    13. Oscar Gutiérrez & Francisco Ruiz-Aliseda, 2011. "Real options with unknown-date events," Annals of Finance, Springer, vol. 7(2), pages 171-198, May.
    14. Timothy Erickson & Toni M. Whited, 2000. "Measurement Error and the Relationship between Investment and q," Journal of Political Economy, University of Chicago Press, vol. 108(5), pages 1027-1057, October.
    15. Arve, Malin & Zwart, Gijsbert, 2023. "Optimal procurement and investment in new technologies under uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 147(C).
    16. Shively, Gerald E., 2001. "Price thresholds, price volatility, and the private costs of investment in a developing country grain market," Economic Modelling, Elsevier, vol. 18(3), pages 399-414, August.
    17. Marks, Phillipa & Marks, Brian, 2007. "Spectrum Allocation, Spectrum Commons and Public Goods: the Role of the Market," MPRA Paper 6785, University Library of Munich, Germany.
    18. Stern, Nicholas, 2018. "Public economics as if time matters: Climate change and the dynamics of policy," Journal of Public Economics, Elsevier, vol. 162(C), pages 4-17.
    19. Krause, M.U., 2002. "Inter-Industry Wage Differentials and Job Flows," Discussion Paper 2002-3, Tilburg University, Center for Economic Research.
    20. Wong, Kit Pong & Yi, Long, 2013. "Irreversibility, mean reversion, and investment timing," Economic Modelling, Elsevier, vol. 30(C), pages 770-775.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:219:y:2012:i:1:p:18-26. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.