IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v305y2023i3p1141-1152.html
   My bibliography  Save this article

Policies for the dynamic traveling maintainer problem with alerts

Author

Listed:
  • da Costa, Paulo
  • Verleijsdonk, Peter
  • Voorberg, Simon
  • Akcay, Alp
  • Kapodistria, Stella
  • van Jaarsveld, Willem
  • Zhang, Yingqian

Abstract

Downtime of industrial assets such as wind turbines and medical imaging devices comes at a sharp cost. To avoid such downtime costs, companies seek to initiate maintenance just before failure. Unfortunately, this is challenging for the following two reasons: On the one hand, because asset failures are notoriously difficult to predict, even in the presence of real-time monitoring devices which signal early degradation. On the other hand, because the available resources to serve a network of geographically dispersed assets are typically limited. In this paper, we propose a novel model referred to as the dynamic traveling maintainer problem with alerts that incorporates these two challenges and we provide three solution approaches on how to dispatch the limited resources. Namely, we propose: (i) Greedy heuristic approaches that rank assets on urgency, proximity and economic risk; (ii) A novel traveling maintainer heuristic approach that optimizes short-term costs; and (iii) A deep reinforcement learning (DRL) approach that optimizes long-term costs. Each approach has different requirements concerning the available alert information. Experiments with small asset networks show that all methods can approximate the optimal policy when given access to complete condition information. For larger networks, the proposed methods yield competitive policies, with DRL consistently achieving the lowest costs.

Suggested Citation

  • da Costa, Paulo & Verleijsdonk, Peter & Voorberg, Simon & Akcay, Alp & Kapodistria, Stella & van Jaarsveld, Willem & Zhang, Yingqian, 2023. "Policies for the dynamic traveling maintainer problem with alerts," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1141-1152.
  • Handle: RePEc:eee:ejores:v:305:y:2023:i:3:p:1141-1152
    DOI: 10.1016/j.ejor.2022.06.044
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221722005185
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2022.06.044?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Akcay, Alp, 2022. "An alert-assisted inspection policy for a production process with imperfect condition signals," European Journal of Operational Research, Elsevier, vol. 298(2), pages 510-525.
    2. Havinga, Maik J.A. & de Jonge, Bram, 2020. "Condition-based maintenance in the cyclic patrolling repairman problem," International Journal of Production Economics, Elsevier, vol. 222(C).
    3. de Jonge, Bram & Klingenberg, Warse & Teunter, Ruud & Tinga, Tiedo, 2016. "Reducing costs by clustering maintenance activities for multiple critical units," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 93-103.
    4. Drent, Collin & Keizer, Minou Olde & Houtum, Geert-Jan van, 2020. "Dynamic dispatching and repositioning policies for fast-response service networks," European Journal of Operational Research, Elsevier, vol. 285(2), pages 583-598.
    5. Topan, E. & Eruguz, A.S. & Ma, W. & van der Heijden, M.C. & Dekker, R., 2020. "A review of operational spare parts service logistics in service control towers," European Journal of Operational Research, Elsevier, vol. 282(2), pages 401-414.
    6. Olde Keizer, Minou C.A. & Flapper, Simme Douwe P. & Teunter, Ruud H., 2017. "Condition-based maintenance policies for systems with multiple dependent components: A review," European Journal of Operational Research, Elsevier, vol. 261(2), pages 405-420.
    7. Fatih Camci, 2014. "The travelling maintainer problem: integration of condition-based maintenance with the travelling salesman problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(9), pages 1423-1436, September.
    8. Liu, Yu & Chen, Yiming & Jiang, Tao, 2020. "Dynamic selective maintenance optimization for multi-state systems over a finite horizon: A deep reinforcement learning approach," European Journal of Operational Research, Elsevier, vol. 283(1), pages 166-181.
    9. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    10. Breton, Simon-Philippe & Moe, Geir, 2009. "Status, plans and technologies for offshore wind turbines in Europe and North America," Renewable Energy, Elsevier, vol. 34(3), pages 646-654.
    11. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    12. van Staden, Heletjé E. & Boute, Robert N., 2021. "The effect of multi-sensor data on condition-based maintenance policies," European Journal of Operational Research, Elsevier, vol. 290(2), pages 585-600.
    13. Wang, Wenbin, 2012. "An overview of the recent advances in delay-time-based maintenance modelling," Reliability Engineering and System Safety, Elsevier, vol. 106(C), pages 165-178.
    14. Bertsimas, Dimitris & Van Ryzin, Garrett., 1989. "The dynamic traveling repairman problem," Working papers 3036-89., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    15. Andriotis, C.P. & Papakonstantinou, K.G., 2021. "Deep reinforcement learning driven inspection and maintenance planning under incomplete information and constraints," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Koen W. de Bock & Kristof Coussement & Arno De Caigny & Roman Slowiński & Bart Baesens & Robert N Boute & Tsan-Ming Choi & Dursun Delen & Mathias Kraus & Stefan Lessmann & Sebastián Maldonado & David , 2023. "Explainable AI for Operational Research: A Defining Framework, Methods, Applications, and a Research Agenda," Post-Print hal-04219546, HAL.
    2. De Bock, Koen W. & Coussement, Kristof & Caigny, Arno De & Słowiński, Roman & Baesens, Bart & Boute, Robert N. & Choi, Tsan-Ming & Delen, Dursun & Kraus, Mathias & Lessmann, Stefan & Maldonado, Sebast, 2024. "Explainable AI for Operational Research: A defining framework, methods, applications, and a research agenda," European Journal of Operational Research, Elsevier, vol. 317(2), pages 249-272.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    2. Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
    3. Zhang, Qin & Liu, Yu & Xiahou, Tangfan & Huang, Hong-Zhong, 2023. "A heuristic maintenance scheduling framework for a military aircraft fleet under limited maintenance capacities," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    4. Azizi, Fariba & Salari, Nooshin, 2023. "A novel condition-based maintenance framework for parallel manufacturing systems based on bivariate birth/birth–death processes," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    5. Uit Het Broek, Michiel A.J. & Teunter, Ruud H. & de Jonge, Bram & Veldman, Jasper, 2021. "Joint condition-based maintenance and load-sharing optimization for two-unit systems with economic dependency," European Journal of Operational Research, Elsevier, vol. 295(3), pages 1119-1131.
    6. Zhang, Fengxia & Liao, Haitao & Shen, Jingyuan & Ma, Yizhong, 2024. "Optimal maintenance over a finite time horizon for a system under imperfect inspection and dynamic working environment," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    7. Liu, Xingchen & Sun, Qiuzhuang & Ye, Zhi-Sheng & Yildirim, Murat, 2021. "Optimal multi-type inspection policy for systems with imperfect online monitoring," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    8. Najafi, Seyedvahid & Lee, Chi-Guhn, 2023. "A deep reinforcement learning approach for repair-based maintenance of multi-unit systems using proportional hazards model," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Mohammadi, Reza & He, Qing, 2022. "A deep reinforcement learning approach for rail renewal and maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    10. Peng, Rui & He, Xiaofeng & Zhong, Chao & Kou, Gang & Xiao, Hui, 2022. "Preventive maintenance for heterogeneous parallel systems with two failure modes," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    11. Ma, Weining & Zhang, Qin & Xiahou, Tangfan & Liu, Yu & Jia, Xisheng, 2023. "Integrated selective maintenance and task assignment optimization for multi-state systems executing multiple missions," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    12. Havinga, Maik J.A. & de Jonge, Bram, 2020. "Condition-based maintenance in the cyclic patrolling repairman problem," International Journal of Production Economics, Elsevier, vol. 222(C).
    13. Liu, Gehui & Chen, Shaokuan & Ho, Tinkin & Ran, Xinchen & Mao, Baohua & Lan, Zhen, 2022. "Optimum opportunistic maintenance schedule over variable horizons considering multi-stage degradation and dynamic strategy," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    14. Dilaver, Halit Metehan & Akçay, Alp & van Houtum, Geert-Jan, 2023. "Integrated planning of asset-use and dry-docking for a fleet of maritime assets," International Journal of Production Economics, Elsevier, vol. 256(C).
    15. Kampitsis, Dimitris & Panagiotidou, Sofia, 2022. "A Bayesian condition-based maintenance and monitoring policy with variable sampling intervals," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    16. Yang, Li & Ye, Zhi-sheng & Lee, Chi-Guhn & Yang, Su-fen & Peng, Rui, 2019. "A two-phase preventive maintenance policy considering imperfect repair and postponed replacement," European Journal of Operational Research, Elsevier, vol. 274(3), pages 966-977.
    17. Liu, Gehui & Chen, Shaokuan & Jin, Hua & Liu, Shuang, 2021. "Optimum opportunistic maintenance schedule incorporating delay time theory with imperfect maintenance," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    18. Zhao, Yunfei & Smidts, Carol, 2022. "Reinforcement learning for adaptive maintenance policy optimization under imperfect knowledge of the system degradation model and partial observability of system states," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    19. Lee, Juseong & Mitici, Mihaela, 2023. "Deep reinforcement learning for predictive aircraft maintenance using probabilistic Remaining-Useful-Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    20. Karabağ, Oktay & Bulut, Önder & Toy, Ayhan Özgür & Fadıloğlu, Mehmet Murat, 2024. "An efficient procedure for optimal maintenance intervention in partially observable multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 244(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:305:y:2023:i:3:p:1141-1152. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.