IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v242y2024ics0951832023006373.html
   My bibliography  Save this article

A metric for assessing and optimizing data-driven prognostic algorithms for predictive maintenance

Author

Listed:
  • Kamariotis, Antonios
  • Tatsis, Konstantinos
  • Chatzi, Eleni
  • Goebel, Kai
  • Straub, Daniel

Abstract

Prognostic Health Management aims to predict the Remaining Useful Life (RUL) of degrading components/systems utilizing monitoring data. These RUL predictions form the basis for optimizing maintenance planning in a Predictive Maintenance (PdM) paradigm. We here propose a metric for assessing data-driven prognostic algorithms based on their impact on downstream PdM decisions. The metric is defined in association with a decision setting and a corresponding PdM policy. We consider two typical PdM decision settings, namely component ordering and/or replacement planning, for which we investigate and improve PdM policies that are commonly utilized in the literature. All policies are evaluated via the data-based estimation of the long-run expected maintenance cost per unit time, using monitored run-to-failure experiments. The policy evaluation enables the estimation of the proposed metric. We employ the metric as an objective function for optimizing heuristic PdM policies and algorithms’ hyperparameters. The effect of different PdM policies on the metric is initially investigated through a theoretical numerical example. Subsequently, we employ four data-driven prognostic algorithms on a simulated turbofan engine degradation problem, and investigate the joint effect of prognostic algorithm and PdM policy on the metric, resulting in a decision-oriented performance assessment of these algorithms.

Suggested Citation

  • Kamariotis, Antonios & Tatsis, Konstantinos & Chatzi, Eleni & Goebel, Kai & Straub, Daniel, 2024. "A metric for assessing and optimizing data-driven prognostic algorithms for predictive maintenance," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    • Handle: RePEc:eee:reensy:v:242:y:2024:i:c:s0951832023006373
    DOI: 10.1016/j.ress.2023.109723
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023006373
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2023.109723?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    2. Zhang, Zhengxin & Si, Xiaosheng & Hu, Changhua & Lei, Yaguo, 2018. "Degradation data analysis and remaining useful life estimation: A review on Wiener-process-based methods," European Journal of Operational Research, Elsevier, vol. 271(3), pages 775-796.
    3. Fauriat, William & Zio, Enrico, 2020. "Optimization of an aperiodic sequential inspection and condition-based maintenance policy driven by value of information," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    4. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    5. Lee, Juseong & Mitici, Mihaela, 2023. "Deep reinforcement learning for predictive aircraft maintenance using probabilistic Remaining-Useful-Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    6. Nguyen, Khanh T.P. & Medjaher, Kamal & Gogu, Christian, 2022. "Probabilistic deep learning methodology for uncertainty quantification of remaining useful lifetime of multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    7. Lewis, Austin D. & Groth, Katrina M., 2022. "Metrics for evaluating the performance of complex engineering system health monitoring models," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    8. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    9. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    10. van Noortwijk, J.M., 2009. "A survey of the application of gamma processes in maintenance," Reliability Engineering and System Safety, Elsevier, vol. 94(1), pages 2-21.
    11. Arcieri, Giacomo & Hoelzl, Cyprien & Schwery, Oliver & Straub, Daniel & Papakonstantinou, Konstantinos G. & Chatzi, Eleni, 2023. "Bridging POMDPs and Bayesian decision making for robust maintenance planning under model uncertainty: An application to railway systems," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    12. Nguyen, Khanh T.P. & Medjaher, Kamal, 2019. "A new dynamic predictive maintenance framework using deep learning for failure prognostics," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 251-262.
    13. Li, Xiang & Zhang, Wei & Ding, Qian, 2019. "Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 208-218.
    14. Mitici, Mihaela & de Pater, Ingeborg & Barros, Anne & Zeng, Zhiguo, 2023. "Dynamic predictive maintenance for multiple components using data-driven probabilistic RUL prognostics: The case of turbofan engines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    15. Kim, Seokgoo & Choi, Joo-Ho & Kim, Nam Ho, 2022. "Inspection schedule for prognostics with uncertainty management," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    16. Papakonstantinou, K.G. & Shinozuka, M., 2014. "Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part II: POMDP implementation," Reliability Engineering and System Safety, Elsevier, vol. 130(C), pages 214-224.
    17. Do, Phuc & Voisin, Alexandre & Levrat, Eric & Iung, Benoit, 2015. "A proactive condition-based maintenance strategy with both perfect and imperfect maintenance actions," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 22-32.
    18. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    19. Memarzadeh, Milad & Pozzi, Matteo, 2016. "Value of information in sequential decision making: Component inspection, permanent monitoring and system-level scheduling," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 137-151.
    20. de Pater, Ingeborg & Mitici, Mihaela, 2021. "Predictive maintenance for multi-component systems of repairables with Remaining-Useful-Life prognostics and a limited stock of spare components," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    21. Mancuso, A. & Compare, M. & Salo, A. & Zio, E., 2021. "Optimal Prognostics and Health Management-driven inspection and maintenance strategies for industrial systems," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    22. Andriotis, C.P. & Papakonstantinou, K.G., 2021. "Deep reinforcement learning driven inspection and maintenance planning under incomplete information and constraints," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Ruixing & An, Liqiang & He, Lun & Yang, Xinmeng & Huang, Zenghao, 2024. "Reliability analysis and inverse optimization method for floating wind turbines driven by dual meta-models combining transient-steady responses," Reliability Engineering and System Safety, Elsevier, vol. 244(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Juseong & Mitici, Mihaela, 2023. "Deep reinforcement learning for predictive aircraft maintenance using probabilistic Remaining-Useful-Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    2. Dehghan Shoorkand, Hassan & Nourelfath, Mustapha & Hajji, Adnène, 2024. "A hybrid CNN-LSTM model for joint optimization of production and imperfect predictive maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    3. Keshun, You & Guangqi, Qiu & Yingkui, Gu, 2024. "Optimizing prior distribution parameters for probabilistic prediction of remaining useful life using deep learning," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    4. Mitici, Mihaela & de Pater, Ingeborg & Barros, Anne & Zeng, Zhiguo, 2023. "Dynamic predictive maintenance for multiple components using data-driven probabilistic RUL prognostics: The case of turbofan engines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    5. Mandelli, Diego & Wang, Congjian & Agarwal, Vivek & Lin, Linyu & Manjunatha, Koushik A., 2024. "Reliability modeling in a predictive maintenance context: A margin-based approach," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    6. Lee, Juseong & Mitici, Mihaela, 2022. "Multi-objective design of aircraft maintenance using Gaussian process learning and adaptive sampling," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    7. Yuan, Xian-Xun & Higo, Eishiro & Pandey, Mahesh D., 2021. "Estimation of the value of an inspection and maintenance program: A Bayesian gamma process model," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    8. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    9. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    10. Zhou, Kai-Li & Cheng, De-Jun & Zhang, Han-Bing & Hu, Zhong-tai & Zhang, Chun-Yan, 2023. "Deep learning-based intelligent multilevel predictive maintenance framework considering comprehensive cost," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    11. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    12. Li, Zhanhang & Zhou, Jian & Nassif, Hani & Coit, David & Bae, Jinwoo, 2023. "Fusing physics-inferred information from stochastic model with machine learning approaches for degradation prediction," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    13. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    14. Andriotis, C.P. & Papakonstantinou, K.G., 2019. "Managing engineering systems with large state and action spaces through deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    15. Kim, Seokgoo & Choi, Joo-Ho & Kim, Nam Ho, 2022. "Inspection schedule for prognostics with uncertainty management," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    16. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    17. Tseremoglou, Iordanis & Santos, Bruno F., 2024. "Condition-Based Maintenance scheduling of an aircraft fleet under partial observability: A Deep Reinforcement Learning approach," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    18. Liu, Biyu & Pang, Jie & Yang, Haidong & Zhao, Yilin, 2024. "Optimal condition-based maintenance policy for leased equipment considering hybrid preventive maintenance and periodic inspection," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    19. Esposito, Nicola & Mele, Agostino & Castanier, Bruno & GIORGIO, Massimiliano, 2023. "A hybrid maintenance policy for a deteriorating unit in the presence of three forms of variability," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    20. Truong-Ba, Huy & Cholette, Michael E. & Rebello, Sinda & Kent, Geoff, 2024. "Joint planning of inspection, replacement, and component decommissioning for a series system with non-identically degrading components," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:242:y:2024:i:c:s0951832023006373. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.