IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v35y2024i7d10.1007_s10845-023-02209-x.html
   My bibliography  Save this article

Integrating multi-agent reinforcement learning and 3D A* search for facility layout problem considering connector-assembly

Author

Listed:
  • Qiaoyu Zhang

    (Dalian University of Technology)

  • Yan Lin

    (Dalian University of Technology)

Abstract

The paper proposes an innovation method of integrating a multi-agent reinforcement learning and 3D A* search, , to tackle the facility layout problem with the goal of minimizing connector-assembly cost, including wires and pipes, in a finite three-dimensional space subjected to complex constraints. The mathematical model is established through the bounding boxes and grids, and an improved 3D A* algorithm is used to evaluate the route quality of connectors. After defining facility states in the ranking way, the position and orientation of each facility are iteratively solved by the multi-agent reinforcement learning, Wolf Policy Hill-Climbing (Wolf-PHC), with three actions of horizontal movement, rotation and swap. Then a pure water manufacturing system has been taken as a case to carry out a series of combination comparative experiments with other approaches (Dijkstra; Ant colony optimization; Genetic algorithm) used in the relevant literatures and the parameter values of these approaches have been sampled by Latin Hypercube. The results show that the stability, efficiency and solving quality of are better.

Suggested Citation

  • Qiaoyu Zhang & Yan Lin, 2024. "Integrating multi-agent reinforcement learning and 3D A* search for facility layout problem considering connector-assembly," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3393-3418, October.
    • Handle: RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02209-x
    DOI: 10.1007/s10845-023-02209-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-023-02209-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10845-023-02209-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Saekyeol Kim & Taehyeok Choi & Shinyu Kim & Taejoon Kwon & Tae Hee Lee & Kwangrae Lee, 2021. "Sequential graph-based routing algorithm for electrical harnesses, tubes, and hoses in a commercial vehicle," Journal of Intelligent Manufacturing, Springer, vol. 32(4), pages 917-933, April.
    2. Guan, Jian & Lin, Geng, 2016. "Hybridizing variable neighborhood search with ant colony optimization for solving the single row facility layout problem," European Journal of Operational Research, Elsevier, vol. 248(3), pages 899-909.
    3. Paes, Frederico Galaxe & Pessoa, Artur Alves & Vidal, Thibaut, 2017. "A hybrid genetic algorithm with decomposition phases for the Unequal Area Facility Layout Problem," European Journal of Operational Research, Elsevier, vol. 256(3), pages 742-756.
    4. Yanfeng Qu & Dan Jiang & Qingyan Yang, 2018. "Branch pipe routing based on 3D connection graph and concurrent ant colony optimization algorithm," Journal of Intelligent Manufacturing, Springer, vol. 29(7), pages 1647-1657, October.
    5. Jingyang Zhou & Peter E.D. Love & Kok Lay Teo & Hanbin Luo, 2017. "An exact penalty function method for optimising QAP formulation in facility layout problem," International Journal of Production Research, Taylor & Francis Journals, vol. 55(10), pages 2913-2929, May.
    6. Junqi Liu & Zeqiang Zhang & Feng Chen & Silu Liu & Lixia Zhu, 2022. "A novel hybrid immune clonal selection algorithm for the constrained corridor allocation problem," Journal of Intelligent Manufacturing, Springer, vol. 33(4), pages 953-972, April.
    7. Anjos, Miguel F. & Vieira, Manuel V.C., 2017. "Mathematical optimization approaches for facility layout problems: The state-of-the-art and future research directions," European Journal of Operational Research, Elsevier, vol. 261(1), pages 1-16.
    8. Friedrich, C. & Klausnitzer, A. & Lasch, R., 2018. "Integrated slicing tree approach for solving the facility layout problem with input and output locations based on contour distance," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 94867, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    9. Mariem Besbes & Marc Zolghadri & Roberta Costa Affonso & Faouzi Masmoudi & Mohamed Haddar, 2021. "3D facility layout problem," Journal of Intelligent Manufacturing, Springer, vol. 32(4), pages 1065-1090, April.
    10. Mariem Besbes & Marc Zolghadri & Roberta Costa Affonso & Faouzi Masmoudi & Mohamed Haddar, 2020. "A methodology for solving facility layout problem considering barriers: genetic algorithm coupled with A* search," Journal of Intelligent Manufacturing, Springer, vol. 31(3), pages 615-640, March.
    11. Anirban Kundu & Pranab K. Dan, 2012. "Metaheuristic in facility layout problems: current trend and future direction," International Journal of Industrial and Systems Engineering, Inderscience Enterprises Ltd, vol. 10(2), pages 238-253.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mariem Besbes & Marc Zolghadri & Roberta Costa Affonso & Faouzi Masmoudi & Mohamed Haddar, 2020. "A methodology for solving facility layout problem considering barriers: genetic algorithm coupled with A* search," Journal of Intelligent Manufacturing, Springer, vol. 31(3), pages 615-640, March.
    2. Mariem Besbes & Marc Zolghadri & Roberta Costa Affonso & Faouzi Masmoudi & Mohamed Haddar, 2021. "3D facility layout problem," Journal of Intelligent Manufacturing, Springer, vol. 32(4), pages 1065-1090, April.
    3. Jerzy Grobelny & Rafal Michalski, 2017. "A novel version of simulated annealing based on linguistic patterns for solving facility layout problems," WORking papers in Management Science (WORMS) WORMS/17/07, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    4. Mehmet Burak Şenol & Ekrem Alper Murat, 2023. "A sequential solution heuristic for continuous facility layout problems," Annals of Operations Research, Springer, vol. 320(1), pages 355-377, January.
    5. Vadivel Sengazhani Murugesan & A. H. Sequeira & Deeksha Sanjay Shetty & Sunil Kumar Jauhar, 2020. "Enhancement of mail operational performance of India post facility layout using AHP," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 11(2), pages 261-273, April.
    6. Junqi Liu & Zeqiang Zhang & Feng Chen & Silu Liu & Lixia Zhu, 2022. "A novel hybrid immune clonal selection algorithm for the constrained corridor allocation problem," Journal of Intelligent Manufacturing, Springer, vol. 33(4), pages 953-972, April.
    7. Xinjian Deng & Jianhua Liu & Hao Gong & Jiayu Huang, 2023. "A novel vision-based method for loosening detection of marked T-junction pipe fittings integrating GAN-based segmentation and SVM-based classification algorithms," Journal of Intelligent Manufacturing, Springer, vol. 34(6), pages 2581-2597, August.
    8. Pourvaziri, Hani & Pierreval, Henri & Marian, Helene, 2021. "Integrating facility layout design and aisle structure in manufacturing systems: Formulation and exact solution," European Journal of Operational Research, Elsevier, vol. 290(2), pages 499-513.
    9. Dahlbeck, Mirko, 2021. "A mixed-integer linear programming approach for the T-row and the multi-bay facility layout problem," European Journal of Operational Research, Elsevier, vol. 295(2), pages 443-462.
    10. Xie, Yue & Zhou, Shenghan & Xiao, Yiyong & Kulturel-Konak, Sadan & Konak, Abdullah, 2018. "A β-accurate linearization method of Euclidean distance for the facility layout problem with heterogeneous distance metrics," European Journal of Operational Research, Elsevier, vol. 265(1), pages 26-38.
    11. Dahlbeck, Mirko & Fischer, Anja & Fischer, Frank & Hungerländer, Philipp & Maier, Kerstin, 2023. "Exact approaches for the combined cell layout problem," European Journal of Operational Research, Elsevier, vol. 305(2), pages 530-546.
    12. Zhongwei Zhang & Lihui Wu & Zhaoyun Wu & Wenqiang Zhang & Shun Jia & Tao Peng, 2022. "Energy-Saving Oriented Manufacturing Workshop Facility Layout: A Solution Approach Using Multi-Objective Particle Swarm Optimization," Sustainability, MDPI, vol. 14(5), pages 1-28, February.
    13. Herrán, Alberto & Manuel Colmenar, J. & Duarte, Abraham, 2021. "An efficient variable neighborhood search for the Space-Free Multi-Row Facility Layout problem," European Journal of Operational Research, Elsevier, vol. 295(3), pages 893-907.
    14. Daria Leiber & David Eickholt & Anh-Tu Vuong & Gunther Reinhart, 2022. "Simulation-based layout optimization for multi-station assembly lines," Journal of Intelligent Manufacturing, Springer, vol. 33(2), pages 537-554, February.
    15. Saekyeol Kim & Taehyeok Choi & Shinyu Kim & Taejoon Kwon & Tae Hee Lee & Kwangrae Lee, 2021. "Sequential graph-based routing algorithm for electrical harnesses, tubes, and hoses in a commercial vehicle," Journal of Intelligent Manufacturing, Springer, vol. 32(4), pages 917-933, April.
    16. Karki, Uttam & Guthrie, Bradley & Parikh, Pratik J., 2021. "Joint determination of rack configuration and shelf space allocation for a retailer," International Journal of Production Economics, Elsevier, vol. 234(C).
    17. Weckenborg, Christian & Schumacher, Patrick & Thies, Christian & Spengler, Thomas S., 2024. "Flexibility in manufacturing system design: A review of recent approaches from Operations Research," European Journal of Operational Research, Elsevier, vol. 315(2), pages 413-441.
    18. Hua, Hao & Hovestadt, Ludger & Tang, Peng & Li, Biao, 2019. "Integer programming for urban design," European Journal of Operational Research, Elsevier, vol. 274(3), pages 1125-1137.
    19. Masmoudi, Mohamed Amine & Hosny, Manar & Demir, Emrah & Genikomsakis, Konstantinos N. & Cheikhrouhou, Naoufel, 2018. "The dial-a-ride problem with electric vehicles and battery swapping stations," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 118(C), pages 392-420.
    20. Fu, Yuqiang & Wang, Jun, 2022. "Optimum periodic maintenance policy of repairable multi-component system with component reallocation and system overhaul," Reliability Engineering and System Safety, Elsevier, vol. 219(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02209-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.