IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v36y2025i1d10.1007_s10845-023-02227-9.html
   My bibliography  Save this article

Q-learning-based multi-objective particle swarm optimization with local search within factories for energy-efficient distributed flow-shop scheduling problem

Author

Listed:
  • Wenqiang Zhang

    (Henan University of Technology
    Henan University of Technology)

  • Huili Geng

    (Henan University of Technology)

  • Chen Li

    (Henan University of Technology)

  • Mitsuo Gen

    (Tokyo University of Science)

  • Guohui Zhang

    (Zhengzhou University of Aeronautics)

  • Miaolei Deng

    (Henan University of Technology)

Abstract

Given the increasing severity of ecological issues, sustainable development and green manufacturing have emerged as crucial areas of research and practice. The continuous growth of the globalizing economy has led to the prevalence of distributed manufacturing systems. Distributed flow-shop scheduling problem (DFSP) is a complex NP-hard problem that involves two highly coupled sub-problems: job allocating for factories and job sequencing within factories. This paper proposes an efficient Q-learning-based multi-objective particle swarm optimization (QL-MoPSO) to address the DFSP, with the objectives of minimizing makespan and total energy consumption. The particle swarm optimization (PSO) algorithm has been enhanced by dividing particles into three subgroups, enabling faster convergence to three distinct areas of the Pareto Front (PF). Q-learning guides variable neighborhood search (VNS) as a local search strategy, balancing exploration and exploitation capabilities. To make the algorithm more reasonable and efficient for solving DFSP, multi-objective particle swarm optimization (MoPSO) uses the exchange sequence to update the job sequence vector, crossover and mutation to update the factory assignment vector. Computational experiments demonstrate that the proposed algorithm accelerates convergence and ensures good distribution performance and diversity, outperforming traditional multi-objective evolutionary algorithms.

Suggested Citation

  • Wenqiang Zhang & Huili Geng & Chen Li & Mitsuo Gen & Guohui Zhang & Miaolei Deng, 2025. "Q-learning-based multi-objective particle swarm optimization with local search within factories for energy-efficient distributed flow-shop scheduling problem," Journal of Intelligent Manufacturing, Springer, vol. 36(1), pages 185-208, January.
  • Handle: RePEc:spr:joinma:v:36:y:2025:i:1:d:10.1007_s10845-023-02227-9
    DOI: 10.1007/s10845-023-02227-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-023-02227-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10845-023-02227-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Leilei Meng & Chaoyong Zhang & Xinyu Shao & Yaping Ren & Caile Ren, 2019. "Mathematical modelling and optimisation of energy-conscious hybrid flow shop scheduling problem with unrelated parallel machines," International Journal of Production Research, Taylor & Francis Journals, vol. 57(4), pages 1119-1145, February.
    2. Chih, Mingchang, 2023. "Stochastic stability analysis of particle swarm optimization with pseudo random number assignment strategy," European Journal of Operational Research, Elsevier, vol. 305(2), pages 562-593.
    3. Shengluo Yang & Zhigang Xu, 2021. "The distributed assembly permutation flowshop scheduling problem with flexible assembly and batch delivery," International Journal of Production Research, Taylor & Francis Journals, vol. 59(13), pages 4053-4071, July.
    4. Ivona Brajević & Predrag S. Stanimirović & Shuai Li & Xinwei Cao & Ameer Tamoor Khan & Lev A. Kazakovtsev, 2022. "Hybrid Sine Cosine Algorithm for Solving Engineering Optimization Problems," Mathematics, MDPI, vol. 10(23), pages 1-21, December.
    5. Taillard, E., 1993. "Benchmarks for basic scheduling problems," European Journal of Operational Research, Elsevier, vol. 64(2), pages 278-285, January.
    6. Ruiz, Rubén & Pan, Quan-Ke & Naderi, Bahman, 2019. "Iterated Greedy methods for the distributed permutation flowshop scheduling problem," Omega, Elsevier, vol. 83(C), pages 213-222.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perez-Gonzalez, Paz & Framinan, Jose M., 2024. "A review and classification on distributed permutation flowshop scheduling problems," European Journal of Operational Research, Elsevier, vol. 312(1), pages 1-21.
    2. Xiaohui Zhang & Xinhua Liu & Shufeng Tang & Grzegorz Królczyk & Zhixiong Li, 2019. "Solving Scheduling Problem in a Distributed Manufacturing System Using a Discrete Fruit Fly Optimization Algorithm," Energies, MDPI, vol. 12(17), pages 1-24, August.
    3. Mohammad Rostami & Milad Mohammadi, 2024. "Two-machine decentralized flow shop scheduling problem with inter-factory batch delivery system," Operational Research, Springer, vol. 24(3), pages 1-37, September.
    4. He, Xuan & Pan, Quan-Ke & Gao, Liang & Neufeld, Janis S. & Gupta, Jatinder N.D., 2024. "Historical information based iterated greedy algorithm for distributed flowshop group scheduling problem with sequence-dependent setup times," Omega, Elsevier, vol. 123(C).
    5. Shahaboddin Shamshirband & Mohammad Shojafar & A. Hosseinabadi & Maryam Kardgar & M. Nasir & Rodina Ahmad, 2015. "OSGA: genetic-based open-shop scheduling with consideration of machine maintenance in small and medium enterprises," Annals of Operations Research, Springer, vol. 229(1), pages 743-758, June.
    6. Sels, Veronique & Craeymeersch, Kjeld & Vanhoucke, Mario, 2011. "A hybrid single and dual population search procedure for the job shop scheduling problem," European Journal of Operational Research, Elsevier, vol. 215(3), pages 512-523, December.
    7. Hajo Terbrack & Thorsten Claus & Frank Herrmann, 2021. "Energy-Oriented Production Planning in Industry: A Systematic Literature Review and Classification Scheme," Sustainability, MDPI, vol. 13(23), pages 1-32, December.
    8. Pempera, Jaroslaw & Smutnicki, Czeslaw, 2018. "Open shop cyclic scheduling," European Journal of Operational Research, Elsevier, vol. 269(2), pages 773-781.
    9. Shahvari, Omid & Logendran, Rasaratnam, 2016. "Hybrid flow shop batching and scheduling with a bi-criteria objective," International Journal of Production Economics, Elsevier, vol. 179(C), pages 239-258.
    10. Fleming, Christopher L. & Griffis, Stanley E. & Bell, John E., 2013. "The effects of triangle inequality on the vehicle routing problem," European Journal of Operational Research, Elsevier, vol. 224(1), pages 1-7.
    11. Jean-Paul Watson & Laura Barbulescu & L. Darrell Whitley & Adele E. Howe, 2002. "Contrasting Structured and Random Permutation Flow-Shop Scheduling Problems: Search-Space Topology and Algorithm Performance," INFORMS Journal on Computing, INFORMS, vol. 14(2), pages 98-123, May.
    12. Nouha Nouri & Talel Ladhari, 2018. "Evolutionary multiobjective optimization for the multi-machine flow shop scheduling problem under blocking," Annals of Operations Research, Springer, vol. 267(1), pages 413-430, August.
    13. Liaw, Ching-Fang, 2000. "A hybrid genetic algorithm for the open shop scheduling problem," European Journal of Operational Research, Elsevier, vol. 124(1), pages 28-42, July.
    14. Pflughoeft, K. A. & Hutchinson, G. K. & Nazareth, D. L., 1996. "Intelligent decision support for flexible manufacturing: Design and implementation of a knowledge-based simulator," Omega, Elsevier, vol. 24(3), pages 347-360, June.
    15. Pan, Quan-Ke & Gao, Liang & Li, Xin-Yu & Gao, Kai-Zhou, 2017. "Effective metaheuristics for scheduling a hybrid flowshop with sequence-dependent setup times," Applied Mathematics and Computation, Elsevier, vol. 303(C), pages 89-112.
    16. Xiao, Qinge & Li, Congbo & Tang, Ying & Pan, Jian & Yu, Jun & Chen, Xingzheng, 2019. "Multi-component energy modeling and optimization for sustainable dry gear hobbing," Energy, Elsevier, vol. 187(C).
    17. Liu, Jiyin & Reeves, Colin R, 2001. "Constructive and composite heuristic solutions to the P//[summation operator]Ci scheduling problem," European Journal of Operational Research, Elsevier, vol. 132(2), pages 439-452, July.
    18. Zeynep Adak & Mahmure Övül Arıoğlu Akan & Serol Bulkan, 0. "Multiprocessor open shop problem: literature review and future directions," Journal of Combinatorial Optimization, Springer, vol. 0, pages 1-23.
    19. Ben-Daya, M. & Al-Fawzan, M., 1998. "A tabu search approach for the flow shop scheduling problem," European Journal of Operational Research, Elsevier, vol. 109(1), pages 88-95, August.
    20. Yepes-Borrero, Juan C. & Perea, Federico & Ruiz, Rubén & Villa, Fulgencia, 2021. "Bi-objective parallel machine scheduling with additional resources during setups," European Journal of Operational Research, Elsevier, vol. 292(2), pages 443-455.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:36:y:2025:i:1:d:10.1007_s10845-023-02227-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.