IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v308y2022i1d10.1007_s10479-021-03935-2.html
   My bibliography  Save this article

Artificial intelligence-based inventory management: a Monte Carlo tree search approach

Author

Listed:
  • Deniz Preil

    (University of Augsburg)

  • Michael Krapp

    (University of Augsburg)

Abstract

The coordination of order policies constitutes a great challenge in supply chain inventory management as various stochastic factors increase its complexity. Therefore, analytical approaches to determine a policy that minimises overall inventory costs are only suitable to a limited extent. In contrast, we adopt a heuristic approach, from the domain of artificial intelligence (AI), namely, Monte Carlo tree search (MCTS). To the best of our knowledge, MCTS has neither been applied to supply chain inventory management before nor is it yet widely disseminated in other branches of operations research. We develop an offline model as well as an online model which bases decisions on real-time data. For demonstration purposes, we consider a supply chain structure similar to the classical beer game with four actors and both stochastic demand and lead times. We demonstrate that both the offline and the online MCTS models perform better than other previously adopted AI-based approaches. Furthermore, we provide evidence that a dynamic order policy determined by MCTS eliminates the bullwhip effect.

Suggested Citation

  • Deniz Preil & Michael Krapp, 2022. "Artificial intelligence-based inventory management: a Monte Carlo tree search approach," Annals of Operations Research, Springer, vol. 308(1), pages 415-439, January.
    • Handle: RePEc:spr:annopr:v:308:y:2022:i:1:d:10.1007_s10479-021-03935-2
    DOI: 10.1007/s10479-021-03935-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-021-03935-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-021-03935-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ehsan Badakhshan & Paul Humphreys & Liam Maguire & Ronan McIvor, 2020. "Using simulation-based system dynamics and genetic algorithms to reduce the cash flow bullwhip in the supply chain," International Journal of Production Research, Taylor & Francis Journals, vol. 58(17), pages 5253-5279, September.
    2. Petrovic, Dobrila & Roy, Rajat & Petrovic, Radivoj, 1999. "Supply chain modelling using fuzzy sets," International Journal of Production Economics, Elsevier, vol. 59(1-3), pages 443-453, March.
    3. Bertsimas, Dimitris & Griffith, J. Daniel & Gupta, Vishal & Kochenderfer, Mykel J. & Mišić, Velibor V., 2017. "A comparison of Monte Carlo tree search and rolling horizon optimization for large-scale dynamic resource allocation problems," European Journal of Operational Research, Elsevier, vol. 263(2), pages 664-678.
    4. Anupam Keshari & Nishikant Mishra & Nagesh Shukla & Steve McGuire & Sangeeta Khorana, 2018. "Multiple order-up-to policy for mitigating bullwhip effect in supply chain network," Annals of Operations Research, Springer, vol. 269(1), pages 361-386, October.
    5. Duan, Qinglin & Warren Liao, T., 2013. "Optimization of replenishment policies for decentralized and centralized capacitated supply chains under various demands," International Journal of Production Economics, Elsevier, vol. 142(1), pages 194-204.
    6. Hau L. Lee & V. Padmanabhan & Seungjin Whang, 1997. "Information Distortion in a Supply Chain: The Bullwhip Effect," Management Science, INFORMS, vol. 43(4), pages 546-558, April.
    7. Deshpande, Paras & Shukla, Deepak & Tiwari, M.K., 2011. "Fuzzy goal programming for inventory management: A bacterial foraging approach," European Journal of Operational Research, Elsevier, vol. 212(2), pages 325-336, July.
    8. Giannoccaro, Ilaria & Pontrandolfo, Pierpaolo, 2002. "Inventory management in supply chains: a reinforcement learning approach," International Journal of Production Economics, Elsevier, vol. 78(2), pages 153-161, July.
    9. K. Devika & A. Jafarian & A. Hassanzadeh & R. Khodaverdi, 2016. "Optimizing of bullwhip effect and net stock amplification in three-echelon supply chains using evolutionary multi-objective metaheuristics," Annals of Operations Research, Springer, vol. 242(2), pages 457-487, July.
    10. Sterman, John D., 1989. "Misperceptions of feedback in dynamic decision making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(3), pages 301-335, June.
    11. Rachel Croson & Karen Donohue, 2006. "Behavioral Causes of the Bullwhip Effect and the Observed Value of Inventory Information," Management Science, INFORMS, vol. 52(3), pages 323-336, March.
    12. Karwowski, Jan & Mańdziuk, Jacek, 2019. "A Monte Carlo Tree Search approach to finding efficient patrolling schemes on graphs," European Journal of Operational Research, Elsevier, vol. 277(1), pages 255-268.
    13. Kees Jan Roodbergen & Iris F.A. Vis & G. Don Taylor, 2015. "Simultaneous determination of warehouse layout and control policies," International Journal of Production Research, Taylor & Francis Journals, vol. 53(11), pages 3306-3326, June.
    14. Carbonneau, Real & Laframboise, Kevin & Vahidov, Rustam, 2008. "Application of machine learning techniques for supply chain demand forecasting," European Journal of Operational Research, Elsevier, vol. 184(3), pages 1140-1154, February.
    15. John D. Sterman, 1989. "Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment," Management Science, INFORMS, vol. 35(3), pages 321-339, March.
    16. Li, Xiuhui & Wang, Qinan, 2007. "Coordination mechanisms of supply chain systems," European Journal of Operational Research, Elsevier, vol. 179(1), pages 1-16, May.
    17. Neto, Teresa & Constantino, Miguel & Martins, Isabel & Pedroso, João Pedro, 2020. "A multi-objective Monte Carlo tree search for forest harvest scheduling," European Journal of Operational Research, Elsevier, vol. 282(3), pages 1115-1126.
    18. Daniel, J. Sudhir Ryan & Rajendran, Chandrasekharan, 2006. "Heuristic approaches to determine base-stock levels in a serial supply chain with a single objective and with multiple objectives," European Journal of Operational Research, Elsevier, vol. 175(1), pages 566-592, November.
    19. Daniel R. Jiang & Lina Al-Kanj & Warren B. Powell, 2020. "Optimistic Monte Carlo Tree Search with Sampled Information Relaxation Dual Bounds," Operations Research, INFORMS, vol. 68(6), pages 1678-1697, November.
    20. Jörn Grahl & Stefan Minner & Daniel Dittmar, 2016. "Meta-heuristics for placing strategic safety stock in multi-echelon inventory with differentiated service times," Annals of Operations Research, Springer, vol. 242(2), pages 489-504, July.
    21. Kannan Govindan, 2016. "Evolutionary algorithms for supply chain management," Annals of Operations Research, Springer, vol. 242(2), pages 195-206, July.
    22. Paolo Priore & Borja Ponte & Rafael Rosillo & David de la Fuente, 2019. "Applying machine learning to the dynamic selection of replenishment policies in fast-changing supply chain environments," International Journal of Production Research, Taylor & Francis Journals, vol. 57(11), pages 3663-3677, June.
    23. Giannoccaro, Ilaria & Pontrandolfo, Pierpaolo & Scozzi, Barbara, 2003. "A fuzzy echelon approach for inventory management in supply chains," European Journal of Operational Research, Elsevier, vol. 149(1), pages 185-196, August.
    24. David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Park, Hyungjun & Choi, Dong Gu & Min, Daiki, 2023. "Adaptive inventory replenishment using structured reinforcement learning by exploiting a policy structure," International Journal of Production Economics, Elsevier, vol. 266(C).
    2. Fadaki, Masih & Asadikia, Atie, 2024. "Augmenting Monte Carlo Tree Search for managing service level agreements," International Journal of Production Economics, Elsevier, vol. 271(C).
    3. Zhitao Xu & Adel Elomri & Roberto Baldacci & Laoucine Kerbache & Zhenyong Wu, 2024. "Frontiers and trends of supply chain optimization in the age of industry 4.0: an operations research perspective," Annals of Operations Research, Springer, vol. 338(2), pages 1359-1401, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Preil, Deniz & Krapp, Michael, 2022. "Bandit-based inventory optimisation: Reinforcement learning in multi-echelon supply chains," International Journal of Production Economics, Elsevier, vol. 252(C).
    2. Enrique Holgado de Frutos & Juan R Trapero & Francisco Ramos, 2020. "A literature review on operational decisions applied to collaborative supply chains," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-28, March.
    3. K. Devika & A. Jafarian & A. Hassanzadeh & R. Khodaverdi, 2016. "Optimizing of bullwhip effect and net stock amplification in three-echelon supply chains using evolutionary multi-objective metaheuristics," Annals of Operations Research, Springer, vol. 242(2), pages 457-487, July.
    4. Ma, Yungao & Wang, Nengmin & He, Zhengwen & Lu, Jizhou & Liang, Huigang, 2015. "Analysis of the bullwhip effect in two parallel supply chains with interacting price-sensitive demands," European Journal of Operational Research, Elsevier, vol. 243(3), pages 815-825.
    5. Manuel Brauch & Andreas Größler, 2022. "Holistic versus analytic thinking orientation and its relationship to the bullwhip effect," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 121-134, April.
    6. Robert L. Bray & Haim Mendelson, 2012. "Information Transmission and the Bullwhip Effect: An Empirical Investigation," Management Science, INFORMS, vol. 58(5), pages 860-875, May.
    7. Cantor, David E. & Katok, Elena, 2012. "Production smoothing in a serial supply chain: A laboratory investigation," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 48(4), pages 781-794.
    8. Tarikere T. Niranjan & Narendra K. Ghosalya & Srinagesh Gavirneni, 2022. "Crying Wolf and a Knowing Wink: A Behavioral Study of Order Inflation and Discounting in Supply Chains," Production and Operations Management, Production and Operations Management Society, vol. 31(3), pages 1071-1088, March.
    9. Özalp Özer & Yanchong Zheng & Yufei Ren, 2014. "Trust, Trustworthiness, and Information Sharing in Supply Chains Bridging China and the United States," Management Science, INFORMS, vol. 60(10), pages 2435-2460, October.
    10. Yang Yu & Ray Qing Cao & Dara Schniederjans, 2017. "Cloud computing and its impact on service level: a multi-agent simulation model," International Journal of Production Research, Taylor & Francis Journals, vol. 55(15), pages 4341-4353, August.
    11. Erkan Bayraktar & Kazim Sari & Ekrem Tatoglu & Selim Zaim & Dursun Delen, 2020. "Assessing the supply chain performance: a causal analysis," Annals of Operations Research, Springer, vol. 287(1), pages 37-60, April.
    12. Chatfield, Dean C. & Pritchard, Alan M., 2013. "Returns and the bullwhip effect," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 49(1), pages 159-175.
    13. Schmitt, Thomas G. & Kumar, Sanjay & Stecke, Kathryn E. & Glover, Fred W. & Ehlen, Mark A., 2017. "Mitigating disruptions in a multi-echelon supply chain using adaptive ordering," Omega, Elsevier, vol. 68(C), pages 185-198.
    14. Fransoo, Jan C. & Udenio, Maximiliano, 2021. "The bullwhip effect," Other publications TiSEM 382aec81-b3b0-4696-bf00-5, Tilburg University, School of Economics and Management.
    15. Springer, Mark & Kim, Ilhyung, 2010. "Managing the order pipeline to reduce supply chain volatility," European Journal of Operational Research, Elsevier, vol. 203(2), pages 380-392, June.
    16. Li Chen & Hau L. Lee, 2012. "Bullwhip Effect Measurement and Its Implications," Operations Research, INFORMS, vol. 60(4), pages 771-784, August.
    17. Arunachalam Narayanan & Brent B. Moritz, 2015. "Decision Making and Cognition in Multi-Echelon Supply Chains: An Experimental Study," Production and Operations Management, Production and Operations Management Society, vol. 24(8), pages 1216-1234, August.
    18. Xuanming Su, 2008. "Bounded Rationality in Newsvendor Models," Manufacturing & Service Operations Management, INFORMS, vol. 10(4), pages 566-589, May.
    19. Rana Azghandi & Jacqueline Griffin & Mohammad S. Jalali, 2018. "Minimization of Drug Shortages in Pharmaceutical Supply Chains: A Simulation-Based Analysis of Drug Recall Patterns and Inventory Policies," Complexity, Hindawi, vol. 2018, pages 1-14, December.
    20. Yang, Y. & Lin, J. & Liu, G. & Zhou, L., 2021. "The behavioural causes of bullwhip effect in supply chains: A systematic literature review," International Journal of Production Economics, Elsevier, vol. 236(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:308:y:2022:i:1:d:10.1007_s10479-021-03935-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.