IDEAS home Printed from https://ideas.repec.org/a/eee/proeco/v271y2024ics092552732400063x.html
   My bibliography  Save this article

Augmenting Monte Carlo Tree Search for managing service level agreements

Author

Listed:
  • Fadaki, Masih
  • Asadikia, Atie

Abstract

Monte Carlo Tree Search (MCTS) is an algorithmic technique utilized in reinforcement learning, a subfield of artificial intelligence, that combines tree-based search and random sampling for decision-making in uncertain environments. Although MCTS has been successfully used for playing complex games such as Chess and Go, without customizing the original algorithm using domain knowledge, it struggles to effectively solve complex supply chain problems. This study proposes several augmenting mechanisms for MCTS, tailored for managing service level agreements. Furthermore, we enhance the proposed solution for products/services where adjusting the base-stock level is feasible. The results demonstrate that even with non-stationary demand, where most optimization methods reach their limits, employing these augmentation mechanisms significantly improves MCTS performance.

Suggested Citation

  • Fadaki, Masih & Asadikia, Atie, 2024. "Augmenting Monte Carlo Tree Search for managing service level agreements," International Journal of Production Economics, Elsevier, vol. 271(C).
    • Handle: RePEc:eee:proeco:v:271:y:2024:i:c:s092552732400063x
    DOI: 10.1016/j.ijpe.2024.109206
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S092552732400063X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijpe.2024.109206?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kloos, Konstantin & Pibernik, Richard, 2020. "Allocation planning under service-level contracts," European Journal of Operational Research, Elsevier, vol. 280(1), pages 203-218.
    2. Hamed Jahani & Babak Abbasi & Zahra Hosseinifard & Masih Fadaki & James P. Minas, 2021. "Disruption risk management in service-level agreements," International Journal of Production Research, Taylor & Francis Journals, vol. 59(1), pages 226-244, January.
    3. Douglas J. Thomas, 2005. "Measuring Item Fill-Rate Performance in a Finite Horizon," Manufacturing & Service Operations Management, INFORMS, vol. 7(1), pages 74-80, September.
    4. Sean J. Taylor & Benjamin Letham, 2018. "Forecasting at Scale," The American Statistician, Taylor & Francis Journals, vol. 72(1), pages 37-45, January.
    5. Wang, Yihua & Minner, Stefan, 2024. "Deep reinforcement learning for demand fulfillment in online retail," International Journal of Production Economics, Elsevier, vol. 269(C).
    6. Chun†Miin (Jimmy) Chen & Douglas J. Thomas, 2018. "Inventory Allocation in the Presence of Service†Level Agreements," Production and Operations Management, Production and Operations Management Society, vol. 27(3), pages 553-577, March.
    7. Deniz Preil & Michael Krapp, 2022. "Artificial intelligence-based inventory management: a Monte Carlo tree search approach," Annals of Operations Research, Springer, vol. 308(1), pages 415-439, January.
    8. Masih Fadaki & Babak Abbasi & Prem Chhetri, 2022. "Quantum game approach for capacity allocation decisions under strategic reasoning," Computational Management Science, Springer, vol. 19(3), pages 491-512, July.
    9. Fadaki, Masih & Abareshi, Ahmad & Far, Shaghayegh Maleki & Lee, Paul Tae-Woo, 2022. "Multi-period vaccine allocation model in a pandemic: A case study of COVID-19 in Australia," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 161(C).
    10. Qiu, Huaxin & Wang, Sutong & Yin, Yunqiang & Wang, Dujuan & Wang, Yanzhang, 2022. "A deep reinforcement learning-based approach for the home delivery and installation routing problem," International Journal of Production Economics, Elsevier, vol. 244(C).
    11. Saeed, Naima & Nguyen, Su & Cullinane, Kevin & Gekara, Victor & Chhetri, Prem, 2023. "Forecasting container freight rates using the Prophet forecasting method," Transport Policy, Elsevier, vol. 133(C), pages 86-107.
    12. Kaynov, Illya & van Knippenberg, Marijn & Menkovski, Vlado & van Breemen, Albert & van Jaarsveld, Willem, 2024. "Deep Reinforcement Learning for One-Warehouse Multi-Retailer inventory management," International Journal of Production Economics, Elsevier, vol. 267(C).
    13. Wang, Peipei & Zheng, Xinqi & Li, Jiayang & Zhu, Bangren, 2020. "Prediction of epidemic trends in COVID-19 with logistic model and machine learning technics," Chaos, Solitons & Fractals, Elsevier, vol. 139(C).
    14. Elena Katok & Douglas Thomas & Andrew Davis, 2008. "Inventory Service-Level Agreements as Coordination Mechanisms: The Effect of Review Periods," Manufacturing & Service Operations Management, INFORMS, vol. 10(4), pages 609-624, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fuqiang Zhang, 2010. "Procurement Mechanism Design in a Two-Echelon Inventory System with Price-Sensitive Demand," Manufacturing & Service Operations Management, INFORMS, vol. 12(4), pages 608-626, August.
    2. Masih Fadaki & Babak Abbasi & Prem Chhetri, 2022. "Quantum game approach for capacity allocation decisions under strategic reasoning," Computational Management Science, Springer, vol. 19(3), pages 491-512, July.
    3. Yuanguang Zhong & Zhichao Zheng & Mabel C. Chou & Chung-Piaw Teo, 2018. "Resource Pooling and Allocation Policies to Deliver Differentiated Service," Management Science, INFORMS, vol. 64(4), pages 1555-1573, April.
    4. Saeed, Naima & Nguyen, Su & Cullinane, Kevin & Gekara, Victor & Chhetri, Prem, 2023. "Forecasting container freight rates using the Prophet forecasting method," Transport Policy, Elsevier, vol. 133(C), pages 86-107.
    5. Abbasi, B. & Hosseinifard, Z. & Alamri, O. & Thomas, D. & Minas, J.P., 2018. "Finite time horizon fill rate analysis for multiple customer cases," Omega, Elsevier, vol. 76(C), pages 1-17.
    6. Gary E. Bolton & Sabrina Bonzelet & Tobias Stangl & Ulrich W. Thonemann, 2023. "Decision making under service‐level contracts: The role of cost saliency," Production and Operations Management, Production and Operations Management Society, vol. 32(4), pages 1243-1261, April.
    7. Kim, Nayeon & Montreuil, Benoit & Klibi, Walid, 2022. "Inventory availability commitment under uncertainty in a dropshipping supply chain," European Journal of Operational Research, Elsevier, vol. 302(3), pages 1155-1174.
    8. Wang, Peipei & Zheng, Xinqi & Ai, Gang & Liu, Dongya & Zhu, Bangren, 2020. "Time series prediction for the epidemic trends of COVID-19 using the improved LSTM deep learning method: Case studies in Russia, Peru and Iran," Chaos, Solitons & Fractals, Elsevier, vol. 140(C).
    9. Jorge-Eusebio Velasco-López & Ramón-Alberto Carrasco & Jesús Serrano-Guerrero & Francisco Chiclana, 2024. "Profiling Social Sentiment in Times of Health Emergencies with Information from Social Networks and Official Statistics," Mathematics, MDPI, vol. 12(6), pages 1-23, March.
    10. Matthias Klumpp & Dominic Loske, 2021. "Sustainability and Resilience Revisited: Impact of Information Technology Disruptions on Empirical Retail Logistics Efficiency," Sustainability, MDPI, vol. 13(10), pages 1-20, May.
    11. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    12. Alex Roubos & Ger Koole & Raik Stolletz, 2012. "Service-Level Variability of Inbound Call Centers," Manufacturing & Service Operations Management, INFORMS, vol. 14(3), pages 402-413, July.
    13. Maghsoodi, Abtin Ijadi, 2023. "Cryptocurrency portfolio allocation using a novel hybrid and predictive big data decision support system," Omega, Elsevier, vol. 115(C).
    14. Miroslav Navratil & Andrea Kolkova, 2019. "Decomposition and Forecasting Time Series in the Business Economy Using Prophet Forecasting Model," Central European Business Review, Prague University of Economics and Business, vol. 2019(4), pages 26-39.
    15. Fadi Kahwash & Basel Barakat & Ahmad Taha & Qammer H. Abbasi & Muhammad Ali Imran, 2021. "Optimising Electrical Power Supply Sustainability Using a Grid-Connected Hybrid Renewable Energy System—An NHS Hospital Case Study," Energies, MDPI, vol. 14(21), pages 1-23, October.
    16. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
    17. Lorenzo Menculini & Andrea Marini & Massimiliano Proietti & Alberto Garinei & Alessio Bozza & Cecilia Moretti & Marcello Marconi, 2021. "Comparing Prophet and Deep Learning to ARIMA in Forecasting Wholesale Food Prices," Forecasting, MDPI, vol. 3(3), pages 1-19, September.
    18. Al Hanbali, Ahmad & van der Heijden, Matthieu, 2013. "Interval availability analysis of a two-echelon, multi-item system," European Journal of Operational Research, Elsevier, vol. 228(3), pages 494-503.
    19. Romero-Fiances, Irene & Livera, Andreas & Theristis, Marios & Makrides, George & Stein, Joshua S. & Nofuentes, Gustavo & de la Casa, Juan & Georghiou, George E., 2022. "Impact of duration and missing data on the long-term photovoltaic degradation rate estimation," Renewable Energy, Elsevier, vol. 181(C), pages 738-748.
    20. Lamghari-Idrissi, Douniel & Basten, Rob & van Houtum, Geert-Jan, 2020. "Spare parts inventory control under a fixed-term contract with a long-down constraint," International Journal of Production Economics, Elsevier, vol. 219(C), pages 123-137.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:proeco:v:271:y:2024:i:c:s092552732400063x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijpe .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.