IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i22p9996-d1522262.html
   My bibliography  Save this article

Leveraging Multi-Agent Reinforcement Learning for Digital Transformation in Supply Chain Inventory Optimization

Author

Listed:
  • Bo Zhang

    (College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore)

  • Wen Jun Tan

    (College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore)

  • Wentong Cai

    (College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore)

  • Allan N. Zhang

    (Singapore Institute of Manufacturing Technology (SIMTech), Agency for Science, Technology and Research (A*STAR), 5 CleantTech Loop, Singapore 636732, Singapore
    School of Mechanical and Aerospace Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore)

Abstract

In today’s volatile supply chain (SC) environment, competition has shifted beyond individual companies to the entire SC ecosystem. Reducing overall SC costs is crucial for success and benefits all participants. One effective approach to achieve this is through digital transformation, enhancing SC coordination via information sharing, and establishing decision policies among entities. However, the risk of unauthorized leakage of sensitive information poses a significant challenge. We aim to propose a Privacy-preserving Multi-agent Reinforcement Learning (PMaRL) method to enhance SC visibility, coordination, and performance during inventory management while effectively mitigating the risk of information leakage by leveraging machine learning techniques. The SC inventory policies are optimized using multi-agent reinforcement learning with additional SC connectivity information to improve training performance. The simulation-based evaluation results illustrate that the PMaRL method surpasses traditional optimization methods in achieving cost performance comparable to full visibility methods, all while preserving privacy. This research addresses the dual objectives of information security and cost reduction in SC inventory management, aligning with the broader trend of digital transformation.

Suggested Citation

  • Bo Zhang & Wen Jun Tan & Wentong Cai & Allan N. Zhang, 2024. "Leveraging Multi-Agent Reinforcement Learning for Digital Transformation in Supply Chain Inventory Optimization," Sustainability, MDPI, vol. 16(22), pages 1-17, November.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:9996-:d:1522262
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/22/9996/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/22/9996/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sean P. Willems, 2008. "Data Set--Real-World Multiechelon Supply Chains Used for Inventory Optimization," Manufacturing & Service Operations Management, INFORMS, vol. 10(1), pages 19-23, February.
    2. Kevin H. Shang & Jing-Sheng Song, 2003. "Newsvendor Bounds and Heuristic for Optimal Policies in Serial Supply Chains," Management Science, INFORMS, vol. 49(5), pages 618-638, May.
    3. Rodrigue Fokouop & Evren Sahin & Zied Jemai & Yves Dallery, 2024. "A heuristic approach for multi-echelon inventory optimisation in a closed-loop supply chain," International Journal of Production Research, Taylor & Francis Journals, vol. 62(10), pages 3435-3459, May.
    4. Tarun Kumar Agrawal & Ravi Kalaiarasan & Jan Olhager & Magnus Wiktorsson, 2024. "Supply chain visibility: A Delphi study on managerial perspectives and priorities," International Journal of Production Research, Taylor & Francis Journals, vol. 62(8), pages 2927-2942, April.
    5. Yiwei Chen & Özalp Özer, 2019. "Supply Chain Contracts That Prevent Information Leakage," Management Science, INFORMS, vol. 65(12), pages 5619-5650, December.
    6. Ying Rong & Zümbül Atan & Lawrence V. Snyder, 2017. "Heuristics for Base-Stock Levels in Multi-Echelon Distribution Networks," Production and Operations Management, Production and Operations Management Society, vol. 26(9), pages 1760-1777, September.
    7. Anup Kumar & Santosh Kumar Shrivastav & Avinash K. Shrivastava & Rashmi Ranjan Panigrahi & Abbas Mardani & Fausto Cavallaro, 2023. "Sustainable Supply Chain Management, Performance Measurement, and Management: A Review," Sustainability, MDPI, vol. 15(6), pages 1-25, March.
    8. Kim Hua Tan & W. P. Wong & Leanne Chung, 2016. "Information and Knowledge Leakage in Supply Chain," Information Systems Frontiers, Springer, vol. 18(3), pages 621-638, June.
    9. Ilya Jackson & Dmitry Ivanov & Alexandre Dolgui & Jafar Namdar, 2024. "Generative artificial intelligence in supply chain and operations management: a capability-based framework for analysis and implementation," International Journal of Production Research, Taylor & Francis Journals, vol. 62(17), pages 6120-6145, September.
    10. Lin Chen & Ting Dong & Jin Peng & Dan Ralescu, 2023. "Uncertainty Analysis and Optimization Modeling with Application to Supply Chain Management: A Systematic Review," Mathematics, MDPI, vol. 11(11), pages 1-45, May.
    11. Dehaybe, Henri & Catanzaro, Daniele & Chevalier, Philippe, 2024. "Deep Reinforcement Learning for inventory optimization with non-stationary uncertain demand," European Journal of Operational Research, Elsevier, vol. 314(2), pages 433-445.
    12. Yao Zhao, 2008. "Evaluation and Optimization of Installation Base-Stock Policies in Supply Chains with Compound Poisson Demand," Operations Research, INFORMS, vol. 56(2), pages 437-452, April.
    13. Zhang, Allan N. & Goh, Mark & Meng, Fanwen, 2011. "Conceptual modelling for supply chain inventory visibility," International Journal of Production Economics, Elsevier, vol. 133(2), pages 578-585, October.
    14. Rebeca B. Sánchez-Flores & Samantha E. Cruz-Sotelo & Sara Ojeda-Benitez & Ma. Elizabeth Ramírez-Barreto, 2020. "Sustainable Supply Chain Management—A Literature Review on Emerging Economies," Sustainability, MDPI, vol. 12(17), pages 1-27, August.
    15. Y Barlas & B Gunduz, 2011. "Demand forecasting and sharing strategies to reduce fluctuations and the bullwhip effect in supply chains," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 458-473, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Qiu-xiang & Ji, Hui-min & Huang, Yi-min, 2022. "The information leakage strategies of the supply chain under the block chain technology introduction," Omega, Elsevier, vol. 110(C).
    2. Kevin Geevers & Lotte Hezewijk & Martijn R. K. Mes, 2024. "Multi-echelon inventory optimization using deep reinforcement learning," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 32(3), pages 653-683, September.
    3. Reza Hadizadeh & Amir Abbas Shojaie, 2017. "A Measure of SCM Bullwhip Effect Under Mixed Autoregressive-Moving Average with Errors Heteroscedasticity (ARMA(1,1)–GARCH(1,1)) Model," Annals of Data Science, Springer, vol. 4(1), pages 83-104, March.
    4. Pablo Pérez-Gosende & Josefa Mula & Manuel Díaz-Madroñero, 2020. "Overview of Dynamic Facility Layout Planning as a Sustainability Strategy," Sustainability, MDPI, vol. 12(19), pages 1-16, October.
    5. Woonghee Tim Huh & Ganesh Janakiraman & Mahesh Nagarajan, 2016. "Capacitated Multiechelon Inventory Systems: Policies and Bounds," Manufacturing & Service Operations Management, INFORMS, vol. 18(4), pages 570-584, October.
    6. Kevin H. Shang & Sean X. Zhou & Geert-Jan van Houtum, 2010. "Improving Supply Chain Performance: Real-Time Demand Information and Flexible Deliveries," Manufacturing & Service Operations Management, INFORMS, vol. 12(3), pages 430-448, May.
    7. Ivanov, Dmitry & Sokolov, Boris, 2013. "Control and system-theoretic identification of the supply chain dynamics domain for planning, analysis and adaptation of performance under uncertainty," European Journal of Operational Research, Elsevier, vol. 224(2), pages 313-323.
    8. Arts, Joachim & Kiesmüller, Gudrun P., 2013. "Analysis of a two-echelon inventory system with two supply modes," European Journal of Operational Research, Elsevier, vol. 225(2), pages 263-272.
    9. Hong Zheng & Lin Tian & Guo Li, 2023. "A bane or a boon? Profit‐margin‐guarantee contract in a channel with downstream competition," Production and Operations Management, Production and Operations Management Society, vol. 32(7), pages 2087-2100, July.
    10. Yi Tao & Loo Hay Lee & Ek Peng Chew, 2016. "Quantifying the Effect of Sharing Information in a Supply Chain Facing Supply Disruptions," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 33(04), pages 1-28, August.
    11. Najafi, Mehdi & Zolfagharinia, Hossein, 2024. "A Multi-objective integrated approach to address sustainability in a meat supply chain," Omega, Elsevier, vol. 124(C).
    12. Zhiyuan Wang & Zhiqiang (Eric) Zheng & Wei Jiang & Shaojie Tang, 2021. "Blockchain‐Enabled Data Sharing in Supply Chains: Model, Operationalization, and Tutorial," Production and Operations Management, Production and Operations Management Society, vol. 30(7), pages 1965-1985, July.
    13. M. Lahandi Baskoro & Benny Tjahjono & Macarena Beltran & Anna Bogush & Yichuan Wang, 2024. "The imperative of communication signals in boosting business strategies of the bioplastic packaging industry," Business Strategy and the Environment, Wiley Blackwell, vol. 33(2), pages 307-334, February.
    14. Steffen T. Klosterhalfen & Stefan Minner & Sean P. Willems, 2014. "Strategic Safety Stock Placement in Supply Networks with Static Dual Supply," Manufacturing & Service Operations Management, INFORMS, vol. 16(2), pages 204-219, May.
    15. Shivam Gupta & Vinayak A. Drave & Surajit Bag & Zongwei Luo, 2019. "Leveraging Smart Supply Chain and Information System Agility for Supply Chain Flexibility," Information Systems Frontiers, Springer, vol. 21(3), pages 547-564, June.
    16. Kevin H. Shang & Jing-Sheng Song, 2006. "A Closed-Form Approximation for Serial Inventory Systems and Its Application to System Design," Manufacturing & Service Operations Management, INFORMS, vol. 8(4), pages 394-406, September.
    17. Hsieh, Chung-Chi & Wu, Cheng-Han & Huang, Ya-Jing, 2008. "Ordering and pricing decisions in a two-echelon supply chain with asymmetric demand information," European Journal of Operational Research, Elsevier, vol. 190(2), pages 509-525, October.
    18. Ehsan Shekarian & Behrang Ijadi & Amirreza Zare & Jukka Majava, 2022. "Sustainable Supply Chain Management: A Comprehensive Systematic Review of Industrial Practices," Sustainability, MDPI, vol. 14(13), pages 1-30, June.
    19. Yazdani, Majid & Aouam, Tarik, 2023. "Shipment planning and safety stock placement in maritime supply chains with stochastic demand and transportation times," International Journal of Production Economics, Elsevier, vol. 263(C).
    20. Bin Shen & Hau-Ling Chan, 2017. "Forecast Information Sharing for Managing Supply Chains in the Big Data Era: Recent Development and Future Research," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 34(01), pages 1-26, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:9996-:d:1522262. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.