IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v66y2018i1p150-162.html
   My bibliography  Save this article

Effects of System Parameters on the Optimal Cost and Policy in a Class of Multidimensional Queueing Control Problems

Author

Listed:
  • Samuel Vercraene

    (INSA-Lyon, DISP, Villeurbanne F-69621, France)

  • Jean-Philippe Gayon

    (University Grenoble Alpes, CNRS, G-SCOP, 38 000 Grenoble, France)

  • Fikri Karaesmen

    (Koç University, Sariyer, 34450, Istanbul, Turkey)

Abstract

We consider a class of Markov Decision Processes frequently employed to model queueing and inventory control problems. For these problems, we explore how changes in different system input parameters (transition rates, costs, discount rates etc.) affect the optimal cost and the optimal policy when the state space of the problem is multidimensional. To address a large class of problems, we introduce two generic dynamic programming operators to model different types of controlled events. For these operators, we derive sufficient conditions to propagate monotonicity and supermodularity properties of the value function. These properties allow to predict how changes in system input parameters affect the optimal cost and policy. Finally, we explore the case when several parameters are changed at the same time. The online appendix is available at https://doi.org/10.1287/opre.2017.1600 .

Suggested Citation

  • Samuel Vercraene & Jean-Philippe Gayon & Fikri Karaesmen, 2018. "Effects of System Parameters on the Optimal Cost and Policy in a Class of Multidimensional Queueing Control Problems," Operations Research, INFORMS, vol. 66(1), pages 150-162, January.
    • Handle: RePEc:inm:oropre:v:66:y:2018:i:1:p:150-162
    DOI: 10.1287/opre.2017.1600
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/opre.2017.1600
    Download Restriction: no
    File URL: https://libkey.io/10.1287/opre.2017.1600?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Satır, Benhür & Savasaneril, Secil & Serin, Yasemin, 2012. "Pooling through lateral transshipments in service parts systems," European Journal of Operational Research, Elsevier, vol. 220(2), pages 370-377.
    2. Noah Gans & Sergei Savin, 2007. "Pricing and Capacity Rationing for Rentals with Uncertain Durations," Management Science, INFORMS, vol. 53(3), pages 390-407, March.
    3. Zhuang, Weifen & Li, Michael Z.F., 2012. "Monotone optimal control for a class of Markov decision processes," European Journal of Operational Research, Elsevier, vol. 217(2), pages 342-350.
    4. Aktaran-KalaycI, Tûba & Ayhan, Hayriye, 2009. "Sensitivity of optimal prices to system parameters in a steady-state service facility," European Journal of Operational Research, Elsevier, vol. 193(1), pages 120-128, February.
    5. James E. Smith & Kevin F. McCardle, 2002. "Structural Properties of Stochastic Dynamic Programs," Operations Research, INFORMS, vol. 50(5), pages 796-809, October.
    6. Saif Benjaafar & Mohsen ElHafsi & Tingliang Huang, 2010. "Optimal control of a production‐inventory system with both backorders and lost sales," Naval Research Logistics (NRL), John Wiley & Sons, vol. 57(3), pages 252-265, April.
    7. Vercraene, Samuel & Gayon, Jean-Philippe, 2013. "Optimal control of a production-inventory system with productreturns," International Journal of Production Economics, Elsevier, vol. 142(2), pages 302-310.
    8. Michael H. Veatch & Lawrence M. Wein, 1994. "Optimal Control of a Two-Station Tandem Production/Inventory System," Operations Research, INFORMS, vol. 42(2), pages 337-350, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. De Munck, Thomas & Chevalier, Philippe & Tancrez, Jean-Sébastien, 2023. "Managing priorities on on-demand service platforms with waiting time differentiation," International Journal of Production Economics, Elsevier, vol. 266(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Seçil Savaşaneril & Paul M. Griffin & Pınar Keskinocak, 2010. "Dynamic Lead-Time Quotation for an M/M/1 Base-Stock Inventory Queue," Operations Research, INFORMS, vol. 58(2), pages 383-395, April.
    2. Hossein Abouee-Mehrizi & Opher Baron & Oded Berman, 2014. "Exact Analysis of Capacitated Two-Echelon Inventory Systems with Priorities," Manufacturing & Service Operations Management, INFORMS, vol. 16(4), pages 561-577, October.
    3. Demet Batur & Jennifer K. Ryan & Zhongyuan Zhao & Mehmet C. Vuran, 2019. "Dynamic Pricing of Wireless Internet Based on Usage and Stochastically Changing Capacity," Manufacturing & Service Operations Management, INFORMS, vol. 21(4), pages 833-852, October.
    4. De Munck, Thomas & Chevalier, Philippe & Tancrez, Jean-Sébastien, 2023. "Managing priorities on on-demand service platforms with waiting time differentiation," International Journal of Production Economics, Elsevier, vol. 266(C).
    5. Ruitu Xu & Yifei Min & Tianhao Wang & Zhaoran Wang & Michael I. Jordan & Zhuoran Yang, 2023. "Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning," Papers 2303.04833, arXiv.org.
    6. Dong Li & Zhan Pang & Lixian Qian, 2023. "Bid price controls for car rental network revenue management," Production and Operations Management, Production and Operations Management Society, vol. 32(1), pages 261-282, January.
    7. Vits, Jeroen & Gelders, Ludo & Pintelon, Liliane, 2006. "Production process changes: A dynamic programming approach to manage effective capacity and experience," International Journal of Production Economics, Elsevier, vol. 104(2), pages 473-481, December.
    8. Yongchang Wei & Fangyu Chen & Feng Xiong, 2018. "Dynamic Complexities in a Supply Chain System with Lateral Transshipments," Complexity, Hindawi, vol. 2018, pages 1-15, June.
    9. Yanyi Xu & Doğan A. Serel & Arnab Bisi & Maqbool Dada, 2022. "Coping with Demand Uncertainty: The Interplay between Dual Sourcing and Endogenous Partial Backordering," Production and Operations Management, Production and Operations Management Society, vol. 31(4), pages 1560-1575, April.
    10. Vibhanshu Abhishek & Jose A. Guajardo & Zhe Zhang, 2021. "Business Models in the Sharing Economy: Manufacturing Durable Goods in the Presence of Peer-to-Peer Rental Markets," Information Systems Research, INFORMS, vol. 32(4), pages 1450-1469, December.
    11. Paul Zipkin, 2008. "On the Structure of Lost-Sales Inventory Models," Operations Research, INFORMS, vol. 56(4), pages 937-944, August.
    12. Opher Baron & Oded Berman & Dmitry Krass & Jianfu Wang, 2014. "Using Strategic Idleness to Improve Customer Service Experience in Service Networks," Operations Research, INFORMS, vol. 62(1), pages 123-140, February.
    13. Shan Wang & Nan Liu & Guohua Wan, 2020. "Managing Appointment-Based Services in the Presence of Walk-in Customers," Management Science, INFORMS, vol. 66(2), pages 667-686, February.
    14. Sen Lin & Bo Li & Antonio Arreola-Risa & Yiwei Huang, 2023. "Optimizing a single-product production-inventory system under constant absolute risk aversion," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(3), pages 510-537, October.
    15. Alireza Pooya & Morteza Pakdaman, 2019. "Optimal control model for finite capacity continuous MRP with deteriorating items," Journal of Intelligent Manufacturing, Springer, vol. 30(5), pages 2203-2215, June.
    16. Belleh Fontem, 2022. "An optimal stopping policy for car rental businesses with purchasing customers," Annals of Operations Research, Springer, vol. 317(1), pages 47-76, October.
    17. Keumseok Kang & J. George Shanthikumar & Kemal Altinkemer, 2016. "Postponable Acceptance and Assignment: A Stochastic Dynamic Programming Approach," Manufacturing & Service Operations Management, INFORMS, vol. 18(4), pages 493-508, October.
    18. Xinchang Wang & Sigrún Andradóttir & Hayriye Ayhan, 2019. "Optimal pricing for tandem queues with finite buffers," Queueing Systems: Theory and Applications, Springer, vol. 92(3), pages 323-396, August.
    19. Ma, Weina & Hekimoğlu, Mustafa & Dekker, Rommert, 2023. "Admission control for a capacitated supply system with real-time replenishment information," International Journal of Production Economics, Elsevier, vol. 266(C).
    20. Ioana Popescu & Yaozhong Wu, 2007. "Dynamic Pricing Strategies with Reference Effects," Operations Research, INFORMS, vol. 55(3), pages 413-429, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:66:y:2018:i:1:p:150-162. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.