IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i11p4544-d1402992.html
   My bibliography  Save this article

Low-Carbon Flexible Job Shop Scheduling Problem Based on Deep Reinforcement Learning

Author

Listed:
  • Yimin Tang

    (School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China)

  • Lihong Shen

    (School of Science, Zhejiang Sci-Tech University, Hangzhou 310018, China)

  • Shuguang Han

    (School of Science, Zhejiang Sci-Tech University, Hangzhou 310018, China)

Abstract

As the focus on environmental sustainability sharpens, the significance of low-carbon manufacturing and energy conservation continues to rise. While traditional flexible job shop scheduling strategies are primarily concerned with minimizing completion times, they often overlook the energy consumption of machines. To address this gap, this paper introduces a novel solution utilizing deep reinforcement learning. The study begins by defining the Low-carbon Flexible Job Shop Scheduling problem (LC-FJSP) and constructing a disjunctive graph model. A sophisticated representation, based on the Markov Decision Process (MDP), incorporates a low-carbon graph attention network featuring multi-head attention modules and graph pooling techniques, aimed at boosting the model’s generalization capabilities. Additionally, Bayesian optimization is employed to enhance the solution refinement process, and the method is benchmarked against conventional models. The empirical results indicate that our algorithm markedly enhances scheduling efficiency by 5% to 12% and reduces carbon emissions by 3% to 8%. This work not only contributes new insights and methods to the realm of low-carbon manufacturing and green production but also underscores its considerable theoretical and practical implications.

Suggested Citation

  • Yimin Tang & Lihong Shen & Shuguang Han, 2024. "Low-Carbon Flexible Job Shop Scheduling Problem Based on Deep Reinforcement Learning," Sustainability, MDPI, vol. 16(11), pages 1-23, May.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:11:p:4544-:d:1402992
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/11/4544/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/11/4544/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. S. S. Panwalkar & Wafik Iskander, 1977. "A Survey of Scheduling Rules," Operations Research, INFORMS, vol. 25(1), pages 45-61, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drexl, Andreas & Kolisch, Rainer, 1991. "Produktionsplanung und -steuerung bei Einzel- und Kleinserienfertigung," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 281, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.
    2. Anurag Agarwal & Varghese S. Jacob & Hasan Pirkul, 2006. "An Improved Augmented Neural-Network Approach for Scheduling Problems," INFORMS Journal on Computing, INFORMS, vol. 18(1), pages 119-128, February.
    3. Binzi Xu & Kai Xu & Baolin Fei & Dengchao Huang & Liang Tao & Yan Wang, 2024. "Automatic Design of Energy-Efficient Dispatching Rules for Multi-Objective Dynamic Flexible Job Shop Scheduling Based on Dual Feature Weight Sets," Mathematics, MDPI, vol. 12(10), pages 1-24, May.
    4. Parlakturk, Ali & Kumar, Sunil, 2004. "Self-Interested Routing in Queueing Networks," Research Papers 1782r, Stanford University, Graduate School of Business.
    5. Bierwirth, C. & Kuhpfahl, J., 2017. "Extended GRASP for the job shop scheduling problem with total weighted tardiness objective," European Journal of Operational Research, Elsevier, vol. 261(3), pages 835-848.
    6. Mobin, Mohammadsadegh & Li, Zhaojun & Cheraghi, S. Hossein & Wu, Gongyu, 2019. "An approach for design Verification and Validation planning and optimization for new product reliability improvement," Reliability Engineering and System Safety, Elsevier, vol. 190(C), pages 1-1.
    7. M. Vimala Rani & M. Mathirajan, 2020. "Performance evaluation of due-date based dispatching rules in dynamic scheduling of diffusion furnace," OPSEARCH, Springer;Operational Research Society of India, vol. 57(2), pages 462-512, June.
    8. P Chen & C-C Wu & W-C Lee, 2006. "A bi-criteria two-machine flowshop scheduling problem with a learning effect," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(9), pages 1113-1125, September.
    9. Chauvet, Fabrice & Levner, Eugene & Meyzin, Leonid K. & Proth, Jean-Marie, 2000. "On-line scheduling in a surface treatment system," European Journal of Operational Research, Elsevier, vol. 120(2), pages 382-392, January.
    10. Zoghby, Jeriad & Wesley Barnes, J. & Hasenbein, John J., 2005. "Modeling the reentrant job shop scheduling problem with setups for metaheuristic searches," European Journal of Operational Research, Elsevier, vol. 167(2), pages 336-348, December.
    11. Valls, Vicente & Angeles Perez, M. & Sacramento Quintanilla, M., 1998. "A tabu search approach to machine scheduling," European Journal of Operational Research, Elsevier, vol. 106(2-3), pages 277-300, April.
    12. Alejandra Duenas & Dobrila Petrovic, 2008. "An approach to predictive-reactive scheduling of parallel machines subject to disruptions," Annals of Operations Research, Springer, vol. 159(1), pages 65-82, March.
    13. Jain, A. S. & Meeran, S., 1999. "Deterministic job-shop scheduling: Past, present and future," European Journal of Operational Research, Elsevier, vol. 113(2), pages 390-434, March.
    14. Guinet, Alain & Legrand, Marie, 1998. "Reduction of job-shop problems to flow-shop problems with precedence constraints," European Journal of Operational Research, Elsevier, vol. 109(1), pages 96-110, August.
    15. Monaci, Marta & Agasucci, Valerio & Grani, Giorgio, 2024. "An actor-critic algorithm with policy gradients to solve the job shop scheduling problem using deep double recurrent agents," European Journal of Operational Research, Elsevier, vol. 312(3), pages 910-926.
    16. Chen, Haoxun & Luh, Peter B., 2003. "An alternative framework to Lagrangian relaxation approach for job shop scheduling," European Journal of Operational Research, Elsevier, vol. 149(3), pages 499-512, September.
    17. Qingmiao Liao & Jianjun Yang & Yong Zhou, 2019. "Sustainable Scheduling of an Automatic Pallet Changer System by Multi-Objective Evolutionary Algorithm with First Piece Inspection," Sustainability, MDPI, vol. 11(5), pages 1-24, March.
    18. Land, Martin & Gaalman, Gerard, 1996. "Workload control concepts in job shops A critical assessment," International Journal of Production Economics, Elsevier, vol. 46(1), pages 535-548, December.
    19. Drexl, Andreas & Salewski, Frank, 1996. "Distribution Requirements and Compactness Constraints in School Timetabling. Part II: Methods," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 384, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.
    20. G-C Lee & Y-D Kim & J-G Kim & S-H Choi, 2003. "A dispatching rule-based approach to production scheduling in a printed circuit board manufacturing system," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(10), pages 1038-1049, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:11:p:4544-:d:1402992. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.