IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i24p4000-d1548017.html
   My bibliography  Save this article

Large Language Model-Assisted Reinforcement Learning for Hybrid Disassembly Line Problem

Author

Listed:
  • Xiwang Guo

    (College of Information and Control Engineering, Liaoning Shihua University, Fushun 113001, China)

  • Chi Jiao

    (College of Information and Control Engineering, Liaoning Shihua University, Fushun 113001, China)

  • Peng Ji

    (College of Information and Control Engineering, Liaoning Shihua University, Fushun 113001, China)

  • Jiacun Wang

    (Department of Computer Science and Software Engineering, Monmouth University, West Long Branch, NJ 07764, USA)

  • Shujin Qin

    (College of Economics and Management, Shangqiu Normal University, Shangqiu 476000, China)

  • Bin Hu

    (Department of Computer Science and Technology, Kean University, Union, NJ 07083, USA)

  • Liang Qi

    (Department of Artificial Intelligence, Shandong University of Science and Technology, Qingdao 266590, China)

  • Xianming Lang

    (College of Information and Control Engineering, Liaoning Shihua University, Fushun 113001, China)

Abstract

Recycling end-of-life products is essential for reducing environmental impact and promoting resource reuse. In the realm of remanufacturing, researchers are increasingly concentrating on the challenge of the disassembly line balancing problem (DLBP), particularly on how to allocate work tasks effectively to enhance productivity. However, many current studies overlook two key issues: (1) how to reasonably arrange the posture of workers during disassembly, and (2) how to reasonably arrange disassembly tasks when the disassembly environment is not a single type of disassembly line but a hybrid disassembly line. To address these issues, we propose a mixed-integrated programming model suitable for linear and U-shaped hybrid disassembly lines, while also considering how to reasonably allocate worker postures to alleviate worker fatigue. Additionally, we introduce large language model-assisted reinforcement learning to solve this model, which employs a Dueling Deep Q-Network (Duel-DQN) to tackle the problem and integrates a large language model (LLM) into the algorithm. The experimental results show that compared to solutions that solely use reinforcement learning, large language model-assisted reinforcement learning reduces the number of iterations required for convergence by approximately 50% while ensuring the quality of the solutions. This provides new insights into the application of LLM in reinforcement learning and DLBP.

Suggested Citation

  • Xiwang Guo & Chi Jiao & Peng Ji & Jiacun Wang & Shujin Qin & Bin Hu & Liang Qi & Xianming Lang, 2024. "Large Language Model-Assisted Reinforcement Learning for Hybrid Disassembly Line Problem," Mathematics, MDPI, vol. 12(24), pages 1-20, December.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:24:p:4000-:d:1548017
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/24/4000/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/24/4000/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Quan Liu & Zhihao Liu & Wenjun Xu & Quan Tang & Zude Zhou & Duc Truong Pham, 2019. "Human-robot collaboration in disassembly for sustainable manufacturing," International Journal of Production Research, Taylor & Francis Journals, vol. 57(12), pages 4027-4044, June.
    2. Feifeng Zheng & Junkai He & Feng Chu & Ming Liu, 2018. "A new distribution-free model for disassembly line balancing problem with stochastic task processing times," International Journal of Production Research, Taylor & Francis Journals, vol. 56(24), pages 7341-7353, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Battaïa, Olga & Dolgui, Alexandre, 2022. "Hybridizations in line balancing problems: A comprehensive review on new trends and formulations," International Journal of Production Economics, Elsevier, vol. 250(C).
    2. Chiuhsiang Joe Lin & Rio Prasetyo Lukodono, 2021. "Sustainable Human–Robot Collaboration Based on Human Intention Classification," Sustainability, MDPI, vol. 13(11), pages 1-26, May.
    3. Xiaoxia Chen & Mélanie Despeisse & Björn Johansson, 2020. "Environmental Sustainability of Digitalization in Manufacturing: A Review," Sustainability, MDPI, vol. 12(24), pages 1-31, December.
    4. Wei Meng & Xiufen Zhang, 2020. "Optimization of Remanufacturing Disassembly Line Balance Considering Multiple Failures and Material Hazards," Sustainability, MDPI, vol. 12(18), pages 1-16, September.
    5. He, Junkai & Chu, Feng & Dolgui, Alexandre & Anjos, Miguel F., 2024. "Multi-objective disassembly line balancing and related supply chain management problems under uncertainty: Review and future trends," International Journal of Production Economics, Elsevier, vol. 272(C).
    6. Peng Hu & Feng Chu & Yunfei Fang & Peng Wu, 2022. "Novel distribution-free model and method for stochastic disassembly line balancing with limited distributional information," Journal of Combinatorial Optimization, Springer, vol. 43(5), pages 1423-1446, July.
    7. Junkai He & Feng Chu & Feifeng Zheng & Ming Liu, 2021. "A green-oriented bi-objective disassembly line balancing problem with stochastic task processing times," Annals of Operations Research, Springer, vol. 296(1), pages 71-93, January.
    8. Fang, Yilin & Liu, Quan & Li, Miqing & Laili, Yuanjun & Pham, Duc Truong, 2019. "Evolutionary many-objective optimization for mixed-model disassembly line balancing with multi-robotic workstations," European Journal of Operational Research, Elsevier, vol. 276(1), pages 160-174.
    9. Yicong Gao & Shanhe Lou & Hao Zheng & Jianrong Tan, 2023. "A data-driven method of selective disassembly planning at end-of-life under uncertainty," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 565-585, February.
    10. Lixia Zhu & Zeqiang Zhang & Yi Wang & Ning Cai, 2020. "On the end-of-life state oriented multi-objective disassembly line balancing problem," Journal of Intelligent Manufacturing, Springer, vol. 31(6), pages 1403-1428, August.
    11. Junyong Liang & Shunsheng Guo & Yunfei Zhang & Wenfang Liu & Shengwen Zhou, 2021. "Energy-Efficient Optimization of Two-Sided Disassembly Line Balance Considering Parallel Operation and Uncertain Using Multiobjective Flatworm Algorithm," Sustainability, MDPI, vol. 13(6), pages 1-23, March.
    12. Suman Kumar Das & Gianmarco Bressanelli & Nicola Saccani, 2024. "Clustering the Research at the Intersection of Industry 4.0 Technologies, Environmental Sustainability and Circular Economy: Evidence from Literature and Future Research Directions," Circular Economy and Sustainability, Springer, vol. 4(4), pages 2473-2504, December.
    13. Hu, Peng & Chu, Feng & Dolgui, Alexandre & Chu, Chengbin & Liu, Ming, 2024. "Integrated multi-product reverse supply chain design and disassembly line balancing under uncertainty," Omega, Elsevier, vol. 126(C).
    14. Feng, Yunting & Lai, Kee-hung & Zhu, Qinghua, 2022. "Green supply chain innovation: Emergence, adoption, and challenges," International Journal of Production Economics, Elsevier, vol. 248(C).
    15. Ömer Faruk Yılmaz & Büşra Yazıcı, 2022. "Tactical level strategies for multi-objective disassembly line balancing problem with multi-manned stations: an optimization model and solution approaches," Annals of Operations Research, Springer, vol. 319(2), pages 1793-1843, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:24:p:4000-:d:1548017. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.