IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i22p10025-d1522793.html
   My bibliography  Save this article

Research on Sustainable Scheduling of Material-Handling Systems in Mixed-Model Assembly Workshops Based on Deep Reinforcement Learning

Author

Listed:
  • Beixin Xia

    (School of Management, Shanghai University, Shanghai 200444, China)

  • Yuan Li

    (School of Management, Shanghai University, Shanghai 200444, China)

  • Jiayi Gu

    (School of Management, Shanghai University, Shanghai 200444, China)

  • Yunfang Peng

    (School of Management, Shanghai University, Shanghai 200444, China)

Abstract

In order to dynamically respond to changes in the state of the assembly line and effectively balance the production efficiency and energy consumption of mixed-model assembly, this paper proposes a deep reinforcement learning sustainable scheduling model based on the Deep Q network. According to the particularity of the workshop material-handling system, the action strategy and reward and punishment function are designed, and the neural network structure, parameter update method, and experience pool selection method of the original Deep Q network dual neural network are improved. Prioritized experience replay is adopted to form a real-time scheduling method for workshop material handling based on the Prioritized Experience Replay Deep Q network. The simulation results demonstrate that compared with other scheduling methods, this deep reinforcement learning approach significantly optimizes material-handling scheduling in mixed-flow assembly workshops, effectively reducing handling distance while ensuring timely delivery to the assembly line, ultimately achieving maximum output with sustainable considerations.

Suggested Citation

  • Beixin Xia & Yuan Li & Jiayi Gu & Yunfang Peng, 2024. "Research on Sustainable Scheduling of Material-Handling Systems in Mixed-Model Assembly Workshops Based on Deep Reinforcement Learning," Sustainability, MDPI, vol. 16(22), pages 1-15, November.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10025-:d:1522793
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/22/10025/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/22/10025/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marcel Panzer & Benedict Bender, 2022. "Deep reinforcement learning in production systems: a systematic literature review," International Journal of Production Research, Taylor & Francis Journals, vol. 60(13), pages 4316-4341, July.
    2. Renke Liu & Rajesh Piplani & Carlos Toro, 2022. "Deep reinforcement learning for dynamic scheduling of a flexible job shop," International Journal of Production Research, Taylor & Francis Journals, vol. 60(13), pages 4049-4069, July.
    3. Emde, Simon & Boysen, Nils, 2012. "Optimally routing and scheduling tow trains for JIT-supply of mixed-model assembly lines," European Journal of Operational Research, Elsevier, vol. 217(2), pages 287-299.
    4. Wenjiao Zai & Junjie Wang & Guohui Li, 2023. "A Drone Scheduling Method for Emergency Power Material Transportation Based on Deep Reinforcement Learning Optimized PSO Algorithm," Sustainability, MDPI, vol. 15(17), pages 1-29, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marcel Panzer & Norbert Gronau, 2024. "Designing an adaptive and deep learning based control framework for modular production systems," Journal of Intelligent Manufacturing, Springer, vol. 35(8), pages 4113-4136, December.
    2. Daria Battini & Nils Boysen & Simon Emde, 2013. "Just-in-Time supermarkets for part supply in the automobile industry," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 24(2), pages 209-217, July.
    3. Simon Emde, 2017. "Scheduling the replenishment of just-in-time supermarkets in assembly plants," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 39(1), pages 321-345, January.
    4. He, Zhiliang & Thürer, Matthias & Zhou, Wanling, 2024. "The use of reinforcement learning for material flow control: An assessment by simulation," International Journal of Production Economics, Elsevier, vol. 274(C).
    5. Diefenbach, Heiko & Emde, Simon & Glock, Christoph H., 2020. "Loading tow trains ergonomically for just-in-time part supply," European Journal of Operational Research, Elsevier, vol. 284(1), pages 325-344.
    6. Diefenbach, Heiko & Emde, Simon & Glock, Christoph H., 2023. "Multi-depot electric vehicle scheduling in in-plant production logistics considering non-linear charging models," European Journal of Operational Research, Elsevier, vol. 306(2), pages 828-848.
    7. C. Briand & Y. He & S. U. Ngueveu, 2018. "Energy-efficient planning for supplying assembly lines with vehicles," EURO Journal on Transportation and Logistics, Springer;EURO - The Association of European Operational Research Societies, vol. 7(4), pages 387-414, December.
    8. Minhyeok Lee, 2023. "Game-Theoretical Analysis of Reviewer Rewards in Peer-Review Journal Systems: Analysis and Experimental Evaluation using Deep Reinforcement Learning," Papers 2305.12088, arXiv.org.
    9. Du, Yu & Li, Jun-qing, 2024. "A deep reinforcement learning based algorithm for a distributed precast concrete production scheduling," International Journal of Production Economics, Elsevier, vol. 268(C).
    10. Bock, Stefan, 2015. "Solving the traveling repairman problem on a line with general processing times and deadlines," European Journal of Operational Research, Elsevier, vol. 244(3), pages 690-703.
    11. Emde, Simon & Gendreau, Michel, 2017. "Scheduling in-house transport vehicles to feed parts to automotive assembly lines," European Journal of Operational Research, Elsevier, vol. 260(1), pages 255-267.
    12. Boysen, Nils & Emde, Simon & Hoeck, Michael & Kauderer, Markus, 2015. "Part logistics in the automotive industry: Decision problems, literature review and research agenda," European Journal of Operational Research, Elsevier, vol. 242(1), pages 107-120.
    13. Erfan Ghorbani & Mahdi Alinaghian & Gevork. B. Gharehpetian & Sajad Mohammadi & Guido Perboli, 2020. "A Survey on Environmentally Friendly Vehicle Routing Problem and a Proposal of Its Classification," Sustainability, MDPI, vol. 12(21), pages 1-71, October.
    14. Sternatz, Johannes, 2015. "The joint line balancing and material supply problem," International Journal of Production Economics, Elsevier, vol. 159(C), pages 304-318.
    15. Hanson, Robin & Finnsgård, Christian, 2014. "Impact of unit load size on in-plant materials supply efficiency," International Journal of Production Economics, Elsevier, vol. 147(PA), pages 46-52.
    16. Alberto Loffredo & Marvin Carl May & Andrea Matta & Gisela Lanza, 2024. "Reinforcement learning for sustainability enhancement of production lines," Journal of Intelligent Manufacturing, Springer, vol. 35(8), pages 3775-3791, December.
    17. Masood Fathi & Morteza Ghobakhloo, 2020. "Enabling Mass Customization and Manufacturing Sustainability in Industry 4.0 Context: A Novel Heuristic Algorithm for in-Plant Material Supply Optimization," Sustainability, MDPI, vol. 12(16), pages 1-15, August.
    18. Stefan Helber & Carolin Kellenbrink & Insa Südbeck, 2024. "Evaluation of stochastic flow lines with provisioning of auxiliary material," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 46(3), pages 669-708, September.
    19. Boysen, Nils & Emde, Simon, 2014. "Scheduling the part supply of mixed-model assembly lines in line-integrated supermarkets," European Journal of Operational Research, Elsevier, vol. 239(3), pages 820-829.
    20. Simon Emde & Michael Schneider, 2018. "Just-In-Time Vehicle Routing for In-House Part Feeding to Assembly Lines," Transportation Science, INFORMS, vol. 52(3), pages 657-672, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10025-:d:1522793. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.