IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v154y2022ics0960077921009929.html
   My bibliography  Save this article

Control variable parameterization and optimization method for stochastic linear quadratic models

Author

Listed:
  • Li, Bo
  • Huang, Tian

Abstract

The linear quadratic (LQ) optimal control model is widely used in industrial production, medical treatment, finance and other fields. For the stochastic dynamic system, the optimal control of LQ optimal control problem is given in an analytic solution. However, the analytic optimal control is governed by a time-dependent Riccati differential equation, which is often complex and difficult to be solved accurately. Hence, the analytic optimal control may be inconvenient to be implemented in practice. Here, we discuss a parametric optimal control problem of stochastic LQ model. Firstly, the optimal control of a stochastic LQ model is derived. For obtaining an approximate control strategy with a simplified expression, we formulate a parametric stochastic LQ control model, and a control variable parameterization and optimization method is presented to solve optimal control parameter. Finally, for showing effectiveness and practicability of the control variable parameterization and optimization method, an inventory control problem under stochastic environment is discussed.

Suggested Citation

  • Li, Bo & Huang, Tian, 2022. "Control variable parameterization and optimization method for stochastic linear quadratic models," Chaos, Solitons & Fractals, Elsevier, vol. 154(C).
    • Handle: RePEc:eee:chsofr:v:154:y:2022:i:c:s0960077921009929
    DOI: 10.1016/j.chaos.2021.111638
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077921009929
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.chaos.2021.111638?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Özen, Ulaş & Doğru, Mustafa K. & Armagan Tarim, S., 2012. "Static-dynamic uncertainty strategy for a single-item stochastic inventory control problem," Omega, Elsevier, vol. 40(3), pages 348-357.
    2. Kohlmann, Michael & Tang, Shanjian, 2002. "Global adapted solution of one-dimensional backward stochastic Riccati equations, with application to the mean-variance hedging," Stochastic Processes and their Applications, Elsevier, vol. 97(2), pages 255-288, February.
    3. Urban, Timothy L., 2005. "Inventory models with inventory-level-dependent demand: A comprehensive review and unifying theory," European Journal of Operational Research, Elsevier, vol. 162(3), pages 792-804, May.
    4. Li, Bo & Zhang, Ranran & Jin, Ting & Shu, Yadong, 2021. "Parametric approximate optimal control of uncertain differential game with application to counter terror," Chaos, Solitons & Fractals, Elsevier, vol. 146(C).
    5. Alfares, Hesham K., 2007. "Inventory model with stock-level dependent demand rate and variable holding cost," International Journal of Production Economics, Elsevier, vol. 108(1-2), pages 259-265, July.
    6. Jie Min & Yong-Wu Zhou & Gui-Qing Liu & Sheng-Dong Wang, 2012. "An EPQ model for deteriorating items with inventory-level-dependent demand and permissible delay in payments," International Journal of Systems Science, Taylor & Francis Journals, vol. 43(6), pages 1039-1053.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Bo & Huang, Tian, 2024. "Stochastic optimal control and piecewise parameterization and optimization method for inventory control system improvement," Chaos, Solitons & Fractals, Elsevier, vol. 178(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Urban, Timothy L., 2008. "An extension of inventory models with discretely variable holding costs," International Journal of Production Economics, Elsevier, vol. 114(1), pages 399-403, July.
    2. Youhua (Frank) Chen & Ye Lu & Minghui Xu, 2012. "Optimal inventory control policy for periodic‐review inventory systems with inventory‐level‐dependent demand," Naval Research Logistics (NRL), John Wiley & Sons, vol. 59(6), pages 430-440, September.
    3. Pando, Valentín & San-José, Luis A. & García-Laguna, Juan & Sicilia, Joaquín, 2013. "An economic lot-size model with non-linear holding cost hinging on time and quantity," International Journal of Production Economics, Elsevier, vol. 145(1), pages 294-303.
    4. Chih-Te Yang & Liang-Yuh Ouyang & Kun-Shan Wu & Hsiu-Feng Yen, 2011. "An optimal replenishment policy for deteriorating items with stock-dependent demand and relaxed terminal conditions under limited storage space," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(1), pages 139-153, March.
    5. Zhai, Yue & Zhong, Ray Y. & Huang, George Q., 2018. "Buffer space hedging and coordination in prefabricated construction supply chain management," International Journal of Production Economics, Elsevier, vol. 200(C), pages 192-206.
    6. Yang, Chih-Te, 2014. "An inventory model with both stock-dependent demand rate and stock-dependent holding cost rate," International Journal of Production Economics, Elsevier, vol. 155(C), pages 214-221.
    7. Mohammad Saffari, 2022. "Periodic inventory management when demand stochastically depends on shelf-stock," OPSEARCH, Springer;Operational Research Society of India, vol. 59(4), pages 1489-1501, December.
    8. Chandra K. Jaggi & Mamta Gupta & Amrina Kausar & Sunil Tiwari, 2019. "Inventory and credit decisions for deteriorating items with displayed stock dependent demand in two-echelon supply chain using Stackelberg and Nash equilibrium solution," Annals of Operations Research, Springer, vol. 274(1), pages 309-329, March.
    9. Kim, Chul & Jun, Duk Bin & Park, Sungho, 2018. "Capturing flexible correlations in multiple-discrete choice outcomes using copulas," International Journal of Research in Marketing, Elsevier, vol. 35(1), pages 34-59.
    10. Ramasesh, Ranga V., 2010. "Lot-sizing decisions under limited-time price incentives: A review," Omega, Elsevier, vol. 38(3-4), pages 118-135, June.
    11. Pol Boada-Collado & Victor Martínez-de-Albéniz, 2020. "Estimating and Optimizing the Impact of Inventory on Consumer Choices in a Fashion Retail Setting," Manufacturing & Service Operations Management, INFORMS, vol. 22(3), pages 582-597, May.
    12. Daniela Favaretto & Alessandro Marin & Marco Tolotti, 2023. "A theoretical validation of the DDMRP reorder policy," Computational Management Science, Springer, vol. 20(1), pages 1-28, December.
    13. Xiaoning Luo & Yanmin Jiang & Qiying Hu, 2010. "Supply chain coordination with shelf‐space and retail price dependent demand and heterogeneous retailers," Naval Research Logistics (NRL), John Wiley & Sons, vol. 57(8), pages 673-685, December.
    14. J. N. Roul & K. Maity & S. Kar & M. Maiti, 2020. "Optimal time-dependent production policy under random time horizon," OPSEARCH, Springer;Operational Research Society of India, vol. 57(2), pages 391-413, June.
    15. Guchhait, Partha & Kumar Maiti, Manas & Maiti, Manoranjan, 2013. "Production-inventory models for a damageable item with variable demands and inventory costs in an imperfect production process," International Journal of Production Economics, Elsevier, vol. 144(1), pages 180-188.
    16. Lihao Lu & Jianxiong Zhang & Wansheng Tang, 2016. "Optimal dynamic pricing and replenishment policy for perishable items with inventory-level-dependent demand," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(6), pages 1480-1494, April.
    17. Gordon H. Bell & Johannes Ledolter & Arthur J. Swersey, 2009. "A Plackett-Burman Experiment to Increase Supermarket Sales of a National Magazine," Interfaces, INFORMS, vol. 39(2), pages 145-158, April.
    18. Stephen A. Smith & Narendra Agrawal, 2017. "Optimal Markdown Pricing and Inventory Allocation for Retail Chains with Inventory Dependent Demand," Manufacturing & Service Operations Management, INFORMS, vol. 19(2), pages 290-304, May.
    19. R. Sundararajan & M. Palanivel & S. Vaithyasubramanian, 2023. "On the EOQ Models with Advertisement-Price-Dependent Demand and Quantity Discount with Expiration Date Under Shortage," SN Operations Research Forum, Springer, vol. 4(4), pages 1-31, December.
    20. Sarkar, Biswajit & Sarkar, Sumon, 2013. "An improved inventory model with partial backlogging, time varying deterioration and stock-dependent demand," Economic Modelling, Elsevier, vol. 30(C), pages 924-932.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:154:y:2022:i:c:s0960077921009929. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.