IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v184y2019icp86-100.html
   My bibliography  Save this article

Noise-dependent ranking of prognostics algorithms based on discrepancy without true damage information

Author

Listed:
  • Wang, Yiwei
  • Gogu, Christian
  • Kim, Nam H.
  • Haftka, Raphael T.
  • Binaud, Nicolas
  • Bes, Christian

Abstract

In this paper, an interesting observation on the noise-dependent performance of prognostics algorithms is presented. A method of evaluating the accuracy of prognostics algorithms without having the true degradation model is proposed. This paper compares the four most widely used model-based prognostics algorithms, i.e., Bayesian method, particle filter, Extended Kalman filter, and nonlinear least squares, to illustrate the effect of random noise in data on the performance of prediction. The mean squared error (MSE) that measures the difference between the true damage size and the predicted one is used to rank the four algorithms for each dataset. We found that the randomness in the noise leads to a very different ranking of the algorithms for different datasets, even though they are all from the same damage model. In particular, even for the algorithm that has the best performance on average, poor results can be obtained for some datasets. In absence of true damage information, we propose another metric, mean squared discrepancy (MSD), which measures the difference between the prediction and the data. A correlation study between MSE and MSD indicates that MSD can be used to estimate the ranking of the four prognostics algorithms without having the true damage information. Moreover, the best algorithm selected by MSD has a high probability of also having the smallest prediction error when used for predicting beyond the last measurement. MSD can thus be particularly useful for selecting the best algorithm for predicting into the near future for a given set of measurements.

Suggested Citation

  • Wang, Yiwei & Gogu, Christian & Kim, Nam H. & Haftka, Raphael T. & Binaud, Nicolas & Bes, Christian, 2019. "Noise-dependent ranking of prognostics algorithms based on discrepancy without true damage information," Reliability Engineering and System Safety, Elsevier, vol. 184(C), pages 86-100.
  • Handle: RePEc:eee:reensy:v:184:y:2019:i:c:p:86-100
    DOI: 10.1016/j.ress.2017.09.021
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832017301138
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2017.09.021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. An, Dawn & Kim, Nam H. & Choi, Joo-Ho, 2015. "Practical options for selecting data-driven or physics-based prognostics algorithms with reviews," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 223-236.
    2. Zio, Enrico & Peloni, Giovanni, 2011. "Particle filtering prognostic estimation of the remaining useful life of nonlinear components," Reliability Engineering and System Safety, Elsevier, vol. 96(3), pages 403-409.
    3. An, Dawn & Choi, Joo-Ho & Kim, Nam Ho, 2013. "Prognostics 101: A tutorial for particle filter-based prognostics algorithm using Matlab," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 161-169.
    4. Bressel, Mathieu & Hilairet, Mickael & Hissel, Daniel & Ould Bouamama, Belkacem, 2016. "Extended Kalman Filter for prognostic of Proton Exchange Membrane Fuel Cell," Applied Energy, Elsevier, vol. 164(C), pages 220-227.
    5. Hu, Yang & Baraldi, Piero & Di Maio, Francesco & Zio, Enrico, 2015. "A particle filtering and kernel smoothing-based approach for new design component prognostics," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 19-31.
    6. M Dalal & J Ma & D He, 2011. "Lithium-ion battery life prognostic health management system using particle filtering framework," Journal of Risk and Reliability, , vol. 225(1), pages 81-90, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zang, Yu & Shangguan, Wei & Cai, Baigen & Wang, Huasheng & Pecht, Michael. G., 2021. "Hybrid remaining useful life prediction method. A case study on railway D-cables," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    2. Park, Hyung Jun & Kim, Nam H. & Choi, Joo-Ho, 2024. "A robust health prediction using Bayesian approach guided by physical constraints," Reliability Engineering and System Safety, Elsevier, vol. 244(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Hai-Kun & Li, Yan-Feng & Huang, Hong-Zhong & Jin, Tongdan, 2017. "Near-extreme system condition and near-extreme remaining useful time for a group of products," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 103-110.
    2. Chen, Jian & Yuan, Shenfang & Sbarufatti, Claudio & Jin, Xin, 2021. "Dual crack growth prognosis by using a mixture proposal particle filter and on-line crack monitoring," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    3. Hu, Yang & Baraldi, Piero & Di Maio, Francesco & Zio, Enrico, 2015. "A particle filtering and kernel smoothing-based approach for new design component prognostics," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 19-31.
    4. Xiangang Cao & Pengfei Li & Song Ming, 2021. "Remaining Useful Life Prediction-Based Maintenance Decision Model for Stochastic Deterioration Equipment under Data-Driven," Sustainability, MDPI, vol. 13(15), pages 1-19, July.
    5. Pradeep Kundu & Makarand S.Kulkarni & Ashish K.Darpe, 2023. "A hybrid prognosis approach for life prediction of gears subjected to progressive pitting failure mode," Journal of Intelligent Manufacturing, Springer, vol. 34(3), pages 1325-1346, March.
    6. Hai-Kun Wang & Yan-Feng Li & Yu Liu & Yuan-Jian Yang & Hong-Zhong Huang, 2015. "Remaining useful life estimation under degradation and shock damage," Journal of Risk and Reliability, , vol. 229(3), pages 200-208, June.
    7. Kim, Hyeonmin & Kim, Jung Taek & Heo, Gyunyoung, 2018. "Failure rate updates using condition-based prognostics in probabilistic safety assessments," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 225-233.
    8. Jinjiang Wang & Robert X. Gao & Zhuang Yuan & Zhaoyan Fan & Laibin Zhang, 2019. "A joint particle filter and expectation maximization approach to machine condition prognosis," Journal of Intelligent Manufacturing, Springer, vol. 30(2), pages 605-621, February.
    9. Mishra, Madhav & Martinsson, Jesper & Rantatalo, Matti & Goebel, Kai, 2018. "Bayesian hierarchical model-based prognostics for lithium-ion batteries," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 25-35.
    10. Prakash, Om & Samantaray, Arun Kumar, 2021. "Prognosis of Dynamical System Components with Varying Degradation Patterns using model–data–fusion," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    11. Wei Teng & Xiaolong Zhang & Yibing Liu & Andrew Kusiak & Zhiyong Ma, 2016. "Prognosis of the Remaining Useful Life of Bearings in a Wind Turbine Gearbox," Energies, MDPI, vol. 10(1), pages 1-16, December.
    12. Chiachío, Manuel & Chiachío, Juan & Sankararaman, Shankar & Goebel, Kai & Andrews, John, 2017. "A new algorithm for prognostics using Subset Simulation," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 189-199.
    13. Faisal Khan & Omer F. Eker & Atif Khan & Wasim Orfali, 2018. "Adaptive Degradation Prognostic Reasoning by Particle Filter with a Neural Network Degradation Model for Turbofan Jet Engine," Data, MDPI, vol. 3(4), pages 1-21, November.
    14. Hachem, Hassan & Vu, Hai Canh & Fouladirad, Mitra, 2024. "Different methods for RUL prediction considering sensor degradation," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    15. Jaehyeok Doh, 2023. "Bayesian inference-based prognosis of fatigue damage for MPPO polymer using Zhurkov fatigue life model," Journal of Risk and Reliability, , vol. 237(4), pages 636-653, August.
    16. Roy Assaf & Phuc Do & Samia Nefti-Meziani & Philip Scarf, 2018. "Wear rate–state interactions within a multi-component system: a study of a gearbox-accelerated life testing platform," Journal of Risk and Reliability, , vol. 232(4), pages 425-434, August.
    17. Asadzadeh, S.M. & Azadeh, A., 2014. "An integrated systemic model for optimization of condition-based maintenance with human error," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 117-131.
    18. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    19. Li, Yi & Liu, Kailong & Foley, Aoife M. & Zülke, Alana & Berecibar, Maitane & Nanini-Maury, Elise & Van Mierlo, Joeri & Hoster, Harry E., 2019. "Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 113(C), pages 1-1.
    20. Barzegari, Mohammad M. & Dardel, Morteza & Alizadeh, Ebrahim & Ramiar, Abas, 2016. "Dynamic modeling and validation studies of dead-end cascade H2/O2 PEM fuel cell stack with integrated humidifier and separator," Applied Energy, Elsevier, vol. 177(C), pages 298-308.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:184:y:2019:i:c:p:86-100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.