IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i2p462-d1036545.html
   My bibliography  Save this article

The Hamilton–Jacobi–Bellman Equation for Differential Games with Composite Distribution of Random Time Horizon

Author

Listed:
  • Tatyana Balas

    (Faculty of Applied Mathematics and Control Processes, St. Petersburg State University, 199034 St. Petersburg, Russia
    These authors contributed equally to this work.)

  • Anna Tur

    (Faculty of Applied Mathematics and Control Processes, St. Petersburg State University, 199034 St. Petersburg, Russia
    These authors contributed equally to this work.)

Abstract

A differential game with random duration is considered. The terminal time of the game is a random variable settled using a composite distribution function. Such a scenario occurs when the operating mode of the system changes over time at the appropriate switching points. On each interval between switchings, the distribution of the terminal time is characterized by its own distribution function. A method for solving such games using dynamic programming is proposed. An example of a non-renewable resource extraction model is given, where a solution of the problem of maximizing the total payoff in closed-loop strategies is found. An analytical view of the optimal control of each player and the optimal trajectory depending on the parameters of the described model is obtained.

Suggested Citation

  • Tatyana Balas & Anna Tur, 2023. "The Hamilton–Jacobi–Bellman Equation for Differential Games with Composite Distribution of Random Time Horizon," Mathematics, MDPI, vol. 11(2), pages 1-13, January.
    • Handle: RePEc:gam:jmathe:v:11:y:2023:i:2:p:462-:d:1036545
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/2/462/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/11/2/462/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Menahem E. Yaari, 1965. "Uncertain Lifetime, Life Insurance, and the Theory of the Consumer," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 32(2), pages 137-150.
    2. Leung, Siu Fai, 2009. "Cake eating, exhaustible resource extraction, life-cycle saving, and non-atomic games: Existence theorems for a class of optimal allocation problems," Journal of Economic Dynamics and Control, Elsevier, vol. 33(6), pages 1345-1360, June.
    3. Anastasiia Zaremba & Ekaterina Gromova & Anna Tur, 2020. "A Differential Game with Random Time Horizon and Discontinuous Distribution," Mathematics, MDPI, vol. 8(12), pages 1-21, December.
    4. Dockner,Engelbert J. & Jorgensen,Steffen & Long,Ngo Van & Sorger,Gerhard, 2000. "Differential Games in Economics and Management Science," Cambridge Books, Cambridge University Press, number 9780521637329, November.
    5. Kamien, Morton I & Schwartz, Nancy L, 1972. "Timing of Innovations Under Rivalry," Econometrica, Econometric Society, vol. 40(1), pages 43-60, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ekaterina Gromova & Anastasiya Malakhova & Arsen Palestini, 2018. "Payoff Distribution in a Multi-Company Extraction Game with Uncertain Duration," Mathematics, MDPI, vol. 6(9), pages 1-17, September.
    2. José Daniel López-Barrientos & Ekaterina Viktorovna Gromova & Ekaterina Sergeevna Miroshnichenko, 2020. "Resource Exploitation in a Stochastic Horizon under Two Parametric Interpretations," Mathematics, MDPI, vol. 8(7), pages 1-29, July.
    3. Ekaterina Gromova & Anastasiia Zaremba & Nahid Masoudi, 2022. "Reclamation of a Resource Extraction Site Model with Random Components," Mathematics, MDPI, vol. 10(24), pages 1-15, December.
    4. Fouad Ouardighi & Matan Shnaiderman & Federico Pasin, 2014. "Research and Development with Stock-Dependent Spillovers and Price Competition in a Duopoly," Journal of Optimization Theory and Applications, Springer, vol. 161(2), pages 626-647, May.
    5. Anastasiia Zaremba & Ekaterina Gromova & Anna Tur, 2020. "A Differential Game with Random Time Horizon and Discontinuous Distribution," Mathematics, MDPI, vol. 8(12), pages 1-21, December.
    6. S. Kostyunin & A. Palestini & E. Shevkoplyas, 2014. "On a Nonrenewable Resource Extraction Game Played by Asymmetric Firms," Journal of Optimization Theory and Applications, Springer, vol. 163(2), pages 660-673, November.
    7. Mengyuan Zhou, 2022. "Does the Source of Inheritance Matter in Bequest Attitudes? Evidence from Japan," Journal of Family and Economic Issues, Springer, vol. 43(4), pages 867-887, December.
    8. An Chen & Thai Nguyen & Thorsten Sehner, 2022. "Unit-Linked Tontine: Utility-Based Design, Pricing and Performance," Risks, MDPI, vol. 10(4), pages 1-27, April.
    9. Masahiko Hattori & Yasuhito Tanaka, 2019. "General analysis of dynamic oligopoly with sticky price," Economics Bulletin, AccessEcon, vol. 39(4), pages 2990-2998.
    10. Liliana Meza-González & Jaime Marie Sepulveda, 2019. "The impact of competition with China in the US market on innovation in Mexican manufacturing firms," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 28(1), pages 1-21, December.
    11. Frédéric Gannon & Vincent Touzé, 2006. "Insurance and Optimal Growth," SciencePo Working papers Main halshs-00085181, HAL.
    12. Axel Börsch‐Supan & Alexander Ludwig & Joachim Winter, 2006. "Ageing, Pension Reform and Capital Flows: A Multi‐Country Simulation Model," Economica, London School of Economics and Political Science, vol. 73(292), pages 625-658, November.
    13. Paul Beaudry & Katsiaryna Kartashova & Césaire A Meh, 2022. "Gazing at r*: A Hysteresis Perspective," RBA Annual Conference Papers acp2022-08, Reserve Bank of Australia, revised Dec 2022.
    14. Régis Chenavaz & Corina Paraschiv & Gabriel Turinici, 2017. "Dynamic Pricing of New Products in Competitive Markets: A Mean-Field Game Approach," Working Papers hal-01592958, HAL.
    15. Reinhard Neck & Dmitri Blueschke, 2014. "“Haircuts” for the EMU periphery: virtue or vice?," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 41(2), pages 153-175, May.
    16. Brito Paulo & Marini Giancarlo & Piergallini Alessandro, 2016. "House prices and monetary policy," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(3), pages 251-277, June.
    17. Hirte Georg, 2002. "Welfare and Macroeconomic Effects of the German Pension Acts of 1992 and 1999: A Dynamic CGE Study," German Economic Review, De Gruyter, vol. 3(1), pages 81-106, February.
    18. D. Dragone & H. Strulik, 2017. "Human Health and Aging over an Infinite Time Horizon," Working Papers wp1104, Dipartimento Scienze Economiche, Universita' di Bologna.
    19. Wrzaczek, Stefan & Kuhn, Michael & Prskawetz, Alexia & Feichtinger, Gustav, 2010. "The reproductive value in distributed optimal control models," Theoretical Population Biology, Elsevier, vol. 77(3), pages 164-170.
    20. Joan Costa-Font & Cristina Vilaplana-Prieto, 2022. "Biased survival expectations and behaviours: Does domain specific information matter?," Journal of Risk and Uncertainty, Springer, vol. 65(3), pages 285-317, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:2:p:462-:d:1036545. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.