IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v180y2018icp39-48.html
   My bibliography  Save this article

Maintenance optimisation of a series production system with intermediate buffers using a multi-agent FMDP

Author

Listed:
  • Zhou, Yifan
  • Guo, Yiming
  • Lin, Tian Ran
  • Ma, Lin

Abstract

Maintenance decision making of a series production system with intermediate buffers is a research topic of practical significance. The Markov decision process (MDP) is an effective tool to undertake maintenance optimisation of a series production system with buffers due to its capacity in dealing with complex structure of maintenance strategies for such systems. However, the MDP has only been employed to analyse small systems due to the “curse of dimensionality†. A multi-agent factored Markov decision process (FMDP) is adopted in this study to remit the “curse of dimensionality†. The series production system considered in the study consists of several subsystems, and each subsystem is managed by an agent. A new method is developed to select maintenance actions in cooperation of different agents. An approximate linear programming algorithm is used to solve the FMDP model efficiently. The numerical study shows that the developed methods can deal with medium-scale series production systems with an insignificant small error in maintenance decision making.

Suggested Citation

  • Zhou, Yifan & Guo, Yiming & Lin, Tian Ran & Ma, Lin, 2018. "Maintenance optimisation of a series production system with intermediate buffers using a multi-agent FMDP," Reliability Engineering and System Safety, Elsevier, vol. 180(C), pages 39-48.
    • Handle: RePEc:eee:reensy:v:180:y:2018:i:c:p:39-48
    DOI: 10.1016/j.ress.2018.07.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832018300061
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2018.07.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hamada, Michael & Martz, Harry F. & Berg, Eric C. & Koehler, Arthur J., 2006. "Optimizing the product-based availability of a buffered industrial process," Reliability Engineering and System Safety, Elsevier, vol. 91(9), pages 1039-1048.
    2. Belmansour, Ahmed-Tidjani & Nourelfath, Mustapha, 2010. "An aggregation method for performance evaluation of a tandem homogenous production line with machines having multiple failure modes," Reliability Engineering and System Safety, Elsevier, vol. 95(11), pages 1193-1201.
    3. Kyriakidis, E.G. & Dimitrakos, T.D., 2006. "Optimal preventive maintenance of a production system with an intermediate buffer," European Journal of Operational Research, Elsevier, vol. 168(1), pages 86-99, January.
    4. Karamatsoukis, C.C. & Kyriakidis, E.G., 2010. "Optimal maintenance of two stochastically deteriorating machines with an intermediate buffer," European Journal of Operational Research, Elsevier, vol. 207(1), pages 297-308, November.
    5. Andrea Matta & Francesca Simone, 2016. "Analysis of two-machine lines with finite buffer, operation-dependent and time-dependent failure modes," International Journal of Production Research, Taylor & Francis Journals, vol. 54(6), pages 1850-1862, March.
    6. Dimitrakos, T.D. & Kyriakidis, E.G., 2008. "A semi-Markov decision algorithm for the maintenance of a production system with buffer capacity and continuous repair times," International Journal of Production Economics, Elsevier, vol. 111(2), pages 752-762, February.
    7. Zhou, Yifan & Lin, Tian Ran & Sun, Yong & Ma, Lin, 2016. "Maintenance optimisation of a parallel-series system with stochastic and economic dependence under limited maintenance capacity," Reliability Engineering and System Safety, Elsevier, vol. 155(C), pages 137-146.
    8. Alrabghi, Abdullah & Tiwari, Ashutosh, 2016. "A novel approach for modelling complex maintenance systems using discrete event simulation," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 160-170.
    9. Shi, Chuan & Gershwin, Stanley B., 2016. "Part sojourn time distribution in a two-machine line," European Journal of Operational Research, Elsevier, vol. 248(1), pages 146-158.
    10. Fitouhi, Mohamed-Chahir & Nourelfath, Mustapha & Gershwin, Stanley B., 2017. "Performance evaluation of a two-machine line with a finite buffer and condition-based maintenance," Reliability Engineering and System Safety, Elsevier, vol. 166(C), pages 61-72.
    11. Cheng, Guo Qing & Zhou, Bing Hai & Li, Ling, 2018. "Integrated production, quality control and condition-based maintenance for imperfect production systems," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 251-264.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Ning & Qi, Faqun & Zhang, Chengjie & Zhou, Hongming, 2022. "Joint optimization of condition-based maintenance policy and buffer capacity for a two-unit series system," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    2. Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
    3. Gao, Kaiye & Peng, Rui & Qu, Li & Wu, Shaomin, 2020. "Jointly optimizing lot sizing and maintenance policy for a production system with two failure modes," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    4. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    5. Yifan Zhou & Chao Yuan & Tian Ran Lin & Lin Ma, 2021. "Maintenance policy structure investigation and optimisation of a complex production system with intermediate buffers," Journal of Risk and Reliability, , vol. 235(3), pages 458-473, June.
    6. Zhou, Yifan & Li, Bangcheng & Lin, Tian Ran, 2022. "Maintenance optimisation of multicomponent systems using hierarchical coordinated reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    7. Xu, Jianyu & Liu, Bin & Zhao, Xiujie & Wang, Xiao-Lin, 2024. "Online reinforcement learning for condition-based group maintenance using factored Markov decision processes," European Journal of Operational Research, Elsevier, vol. 315(1), pages 176-190.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yifan Zhou & Chao Yuan & Tian Ran Lin & Lin Ma, 2021. "Maintenance policy structure investigation and optimisation of a complex production system with intermediate buffers," Journal of Risk and Reliability, , vol. 235(3), pages 458-473, June.
    2. Zhang, Ning & Qi, Faqun & Zhang, Chengjie & Zhou, Hongming, 2022. "Joint optimization of condition-based maintenance policy and buffer capacity for a two-unit series system," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    3. Dehayem Nodem, F.I. & Kenné, J.P. & Gharbi, A., 2011. "Simultaneous control of production, repair/replacement and preventive maintenance of deteriorating manufacturing systems," International Journal of Production Economics, Elsevier, vol. 134(1), pages 271-282, November.
    4. Maria Chiara Magnanini & Tullio Tolio, 2020. "Switching- and hedging- point policy for preventive maintenance with degrading machines: application to a two-machine line," Flexible Services and Manufacturing Journal, Springer, vol. 32(2), pages 241-271, June.
    5. Shuyuan Gan & Bolun Wang & Zhifang Song, 2021. "A Combined Maintenance Strategy Considering Spares, Buffer, and Quality," Journal of Risk and Reliability, , vol. 235(3), pages 431-445, June.
    6. Berthaut, F. & Gharbi, A. & Kenné, J.-P. & Boulet, J.-F., 2010. "Improved joint preventive maintenance and hedging point policy," International Journal of Production Economics, Elsevier, vol. 127(1), pages 60-72, September.
    7. Ait-El-Cadi, Abdessamad & Gharbi, Ali & Dhouib, Karem & Artiba, Abdelhakim, 2021. "Integrated production, maintenance and quality control policy for unreliable manufacturing systems under dynamic inspection," International Journal of Production Economics, Elsevier, vol. 236(C).
    8. Karamatsoukis, C.C. & Kyriakidis, E.G., 2010. "Optimal maintenance of two stochastically deteriorating machines with an intermediate buffer," European Journal of Operational Research, Elsevier, vol. 207(1), pages 297-308, November.
    9. Wei, Shuaichong & Nourelfath, Mustapha & Nahas, Nabil, 2023. "Analysis of a production line subject to degradation and preventive maintenance," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    10. Gia-Shie Liu, 2019. "A Group Replacement Decision Support System Based on Internet of Things," Mathematics, MDPI, vol. 7(9), pages 1-23, September.
    11. Leoni, Leonardo & De Carlo, Filippo & Tucci, Mario, 2023. "Developing a framework for generating production-dependent failure rate through discrete-event simulation," International Journal of Production Economics, Elsevier, vol. 266(C).
    12. Xiao Wang & Hongwei Wang & Chao Qi, 2016. "Multi-agent reinforcement learning based maintenance policy for a resource constrained flow line system," Journal of Intelligent Manufacturing, Springer, vol. 27(2), pages 325-333, April.
    13. Kiesmüller, G.P. & Sachs, F.E., 2020. "Spare parts or buffer? How to design a transfer line with unreliable machines," European Journal of Operational Research, Elsevier, vol. 284(1), pages 121-134.
    14. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    15. Zhou, Yifan & Li, Bangcheng & Lin, Tian Ran, 2022. "Maintenance optimisation of multicomponent systems using hierarchical coordinated reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    16. Karamatsoukis, C.C. & Kyriakidis, E.G., 2009. "Optimal maintenance of a production-inventory system with idle periods," European Journal of Operational Research, Elsevier, vol. 196(2), pages 744-751, July.
    17. Patrick Zschech & Kai Heinrich & Raphael Bink & Janis S. Neufeld, 2019. "Prognostic Model Development with Missing Labels," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(3), pages 327-343, June.
    18. Pan, Zhengqiang & Balakrishnan, Narayanaswamy, 2011. "Reliability modeling of degradation of products with multiple performance characteristics based on gamma processes," Reliability Engineering and System Safety, Elsevier, vol. 96(8), pages 949-957.
    19. Leonid Mylnikov & Martin Kuetz, 2017. "Electric Power Supply Subsystem and its Role in Solving Production System Management and Planning Issues," International Journal of Energy Economics and Policy, Econjournals, vol. 7(5), pages 191-200.
    20. Boardman, Nicholas T. & Sullivan, Kelly M., 2024. "Approximate dynamic programming for condition-based node deployment in a wireless sensor network," Reliability Engineering and System Safety, Elsevier, vol. 243(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:180:y:2018:i:c:p:39-48. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.