IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v184y2019icp123-136.html
   My bibliography  Save this article

Hidden Markov model with auto-correlated observations for remaining useful life prediction and optimal maintenance policy

Author

Listed:
  • Chen, Zhen
  • Li, Yaping
  • Xia, Tangbin
  • Pan, Ershun

Abstract

In this paper, a hidden Markov model with auto-correlated observations (HMM-AO) is developed to handle the degradation modeling of manufacturing systems. Unlike the standard hidden Markov models (HMMs), the current observation in the HMM-AO model not only depends on the corresponding hidden system state, but also on the previous observations. A novel algorithm using the expectation maximum is presented to estimate the unknown parameters. Furthermore, missing data and noise that accumulate over time are also considered by modifying the proposed model. Then two remaining useful life prediction methods based on the HMM-AO model are developed. Predictive values of more accuracy can be obtained, since the autocorrelation of observations has been considered and the temporal evolution of degradation processes has been described properly. A case study is illustrated to highlight the advantages of HMM-AO and demonstrate the accuracy and efficiency of the prediction methods. Furthermore, an improved maintenance policy is developed based on the results of remaining useful life prediction. Finally, a comparison with a conventional condition-based maintenance policy is provided to prove the performance of this proposed policy.

Suggested Citation

  • Chen, Zhen & Li, Yaping & Xia, Tangbin & Pan, Ershun, 2019. "Hidden Markov model with auto-correlated observations for remaining useful life prediction and optimal maintenance policy," Reliability Engineering and System Safety, Elsevier, vol. 184(C), pages 123-136.
  • Handle: RePEc:eee:reensy:v:184:y:2019:i:c:p:123-136
    DOI: 10.1016/j.ress.2017.09.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832017301710
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2017.09.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peng, Weiwen & Li, Yan-Feng & Mi, Jinhua & Yu, Le & Huang, Hong-Zhong, 2016. "Reliability of complex systems under dynamic conditions: A Bayesian multivariate degradation perspective," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 75-87.
    2. Michael E. Cholette & Dragan Djurdjanovic, 2014. "Degradation modeling and monitoring of machines using operation-specific hidden Markov models," IISE Transactions, Taylor & Francis Journals, vol. 46(10), pages 1107-1123, October.
    3. Alaswad, Suzan & Xiang, Yisha, 2017. "A review on condition-based maintenance optimization models for stochastically deteriorating system," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 54-63.
    4. Hamidi, Maryam & Szidarovszky, Ferenc & Szidarovszky, Miklos, 2016. "New one cycle criteria for optimizing preventive replacement policies," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 42-48.
    5. Son, Junbo & Zhou, Shiyu & Sankavaram, Chaitanya & Du, Xinyu & Zhang, Yilu, 2016. "Remaining useful life prediction based on noisy condition monitoring signals using constrained Kalman filter," Reliability Engineering and System Safety, Elsevier, vol. 152(C), pages 38-50.
    6. Le Son, Khanh & Fouladirad, Mitra & Barros, Anne, 2016. "Remaining useful lifetime estimation and noisy gamma deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 149(C), pages 76-87.
    7. Zhao, Zeqi & Bin Liang, & Wang, Xueqian & Lu, Weining, 2017. "Remaining useful life prediction of aircraft engine based on degradation pattern learning," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 74-83.
    8. Thanh Trung Le & Florent Chatelain & Christophe Bérenguer, 2016. "Multi-branch hidden Markov models for remaining useful life estimation of systems under multiple deterioration modes," Journal of Risk and Reliability, , vol. 230(5), pages 473-484, October.
    9. Fort, A. & Mugnaini, M. & Vignoli, V., 2015. "Hidden Markov Models approach used for life parameters estimations," Reliability Engineering and System Safety, Elsevier, vol. 136(C), pages 85-91.
    10. Tang, Diyin & Makis, Viliam & Jafari, Leila & Yu, Jinsong, 2015. "Optimal maintenance policy and residual life estimation for a slowly degrading system subject to condition monitoring," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 198-207.
    11. Khorasgani, Hamed & Biswas, Gautam & Sankararaman, Shankar, 2016. "Methodologies for system-level remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 8-18.
    12. Zhen Chen & Tangbin Xia & Ershun Pan, 2017. "Optimal multi-level classification and preventive maintenance policy for highly reliable products," International Journal of Production Research, Taylor & Francis Journals, vol. 55(8), pages 2232-2250, April.
    13. Xia, Tangbin & Jin, Xiaoning & Xi, Lifeng & Ni, Jun, 2015. "Production-driven opportunistic maintenance for batch production based on MAM–APB scheduling," European Journal of Operational Research, Elsevier, vol. 240(3), pages 781-790.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cai, Xiao & Li, Naipeng & Xie, Min, 2024. "RUL prediction for two-phase degrading systems considering physical damage observations," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    2. Miao, Mengqi & Yu, Jianbo & Zhao, Zhihong, 2022. "A sparse domain adaption network for remaining useful life prediction of rolling bearings under different working conditions," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    3. Deep, Akash & Zhou, Shiyu & Veeramani, Dharmaraj & Chen, Yong, 2023. "Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations," European Journal of Operational Research, Elsevier, vol. 311(2), pages 533-544.
    4. Wang, Jingjing & Miao, Yonghao, 2021. "Optimal preventive maintenance policy of the balanced system under the semi-Markov model," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    5. Zhao, Yunfei & Smidts, Carol, 2022. "Reinforcement learning for adaptive maintenance policy optimization under imperfect knowledge of the system degradation model and partial observability of system states," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    6. Marcin Witczak & Marcin Mrugalski & Bogdan Lipiec, 2021. "Remaining Useful Life Prediction of MOSFETs via the Takagi–Sugeno Framework," Energies, MDPI, vol. 14(8), pages 1-23, April.
    7. Guo, Chunhui & Liang, Zhenglin, 2022. "A predictive Markov decision process for optimizing inspection and maintenance strategies of partially observable multi-state systems," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    8. Yaping Li & Enrico Zio & Ershun Pan, 2021. "An MEWMA-based segmental multivariate hidden Markov model for degradation assessment and prediction," Journal of Risk and Reliability, , vol. 235(5), pages 831-844, October.
    9. Lin, Mingqiang & You, Yuqiang & Wang, Wei & Wu, Ji, 2023. "Battery health prognosis with gated recurrent unit neural networks and hidden Markov model considering uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    10. Arpad Gellert & Stefan-Alexandru Precup & Alexandru Matei & Bogdan-Constantin Pirvu & Constantin-Bala Zamfirescu, 2022. "Real-Time Assembly Support System with Hidden Markov Model and Hybrid Extensions," Mathematics, MDPI, vol. 10(15), pages 1-21, August.
    11. Gámiz, M.L. & Navas-Gómez, F. & Raya-Miranda, R. & Segovia-García, M.C., 2023. "Dynamic reliability and sensitivity analysis based on HMM models with Markovian signal process," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    12. Zhang, Jinchun & Xv, Feiyu & Hou, Jinxiu, 2023. "Degradation recognition and residual life analysis of gasifier firebrick in service using Hidden Semi-Markov Model," Energy, Elsevier, vol. 264(C).
    13. Zhao, Yunfei & Gao, Wei & Smidts, Carol, 2021. "Sequential Bayesian inference of transition rates in the hidden Markov model for multi-state system degradation," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    14. Tao, Xin & Mårtensson, Jonas & Warnquist, Håkan & Pernestål, Anna, 2022. "Short-term maintenance planning of autonomous trucks for minimizing economic risk," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    15. Li, Yaping & Xia, Tangbin & Chen, Zhen & Pan, Ershun, 2023. "Multiple degradation-driven preventive maintenance policy for serial-parallel multi-station manufacturing systems," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    16. Ding, Yifei & Jia, Minping & Miao, Qiuhua & Huang, Peng, 2021. "Remaining useful life estimation using deep metric transfer learning for kernel regression," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    17. Wang, Chao & Zhu, Tao & Yang, Bing & Yin, Minxuan & Xiao, Shoune & Yang, Guangwu, 2023. "Remaining useful life prediction framework for crack propagation with a case study of railway heavy duty coupler condition monitoring," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Han, Xiao & Wang, Zili & Xie, Min & He, Yihai & Li, Yao & Wang, Wenzhuo, 2021. "Remaining useful life prediction and predictive maintenance strategies for multi-state manufacturing systems considering functional dependence," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    19. Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    20. Chen, Zhen & Li, Yaping & Zhou, Di & Xia, Tangbin & Pan, Ershun, 2021. "Two-phase degradation data analysis with change-point detection based on Gaussian process degradation model," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xia, Tangbin & Dong, Yifan & Xiao, Lei & Du, Shichang & Pan, Ershun & Xi, Lifeng, 2018. "Recent advances in prognostics and health management for advanced manufacturing paradigms," Reliability Engineering and System Safety, Elsevier, vol. 178(C), pages 255-268.
    2. Finkelstein, Maxim & Cha, Ji Hwan & Langston, Amy, 2023. "Improving classical optimal age-replacement policies for degrading items," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    3. Liu, Xingheng & Matias, José & Jäschke, Johannes & Vatn, Jørn, 2022. "Gibbs sampler for noisy Transformed Gamma process: Inference and remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    4. Wang, Naichao & Hu, Jiawen & Ma, Lin & Xiao, Boping & Liao, Haitao, 2020. "Availability Analysis and Preventive Maintenance Planning for Systems with General Time Distributions," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    5. Deep, Akash & Zhou, Shiyu & Veeramani, Dharmaraj & Chen, Yong, 2023. "Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations," European Journal of Operational Research, Elsevier, vol. 311(2), pages 533-544.
    6. Zhang, Zhengxin & Si, Xiaosheng & Hu, Changhua & Lei, Yaguo, 2018. "Degradation data analysis and remaining useful life estimation: A review on Wiener-process-based methods," European Journal of Operational Research, Elsevier, vol. 271(3), pages 775-796.
    7. Chen, Gaige & Chen, Jinglong & Zi, Yanyang & Miao, Huihui, 2017. "Hyper-parameter optimization based nonlinear multistate deterioration modeling for deterioration level assessment and remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 517-526.
    8. Dourado, Arinan & Viana, Felipe A.C., 2021. "Early life failures and services of industrial asset fleets," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    9. Chatenet, Q. & Remy, E. & Gagnon, M. & Fouladirad, M. & Tahan, A.S., 2021. "Modeling cavitation erosion using non-homogeneous gamma process," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    10. Finkelstein, Maxim & Cha, Ji Hwan & Bedford, Tim, 2023. "Optimal preventive maintenance strategy for populations of systems that generate outputs," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    11. Li, Jing & Stones, Rebecca J. & Wang, Gang & Liu, Xiaoguang & Li, Zhongwei & Xu, Ming, 2017. "Hard drive failure prediction using Decision Trees," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 55-65.
    12. Zhu, Ying & Xia, Tangbin & Chen, Zhen & Pan, Ershun & Xi, Lifeng, 2022. "Optimal maintenance service strategy for OEM entering competitive MRO market under opposite patterns," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    13. Chen, Jinglong & Jing, Hongjie & Chang, Yuanhong & Liu, Qian, 2019. "Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 372-382.
    14. Ji Hwan Cha & Maxim Finkelstein & Gregory Levitin, 2022. "Replacement Policy for Heterogeneous Items Subject to Gamma Degradation Processes," Methodology and Computing in Applied Probability, Springer, vol. 24(3), pages 1323-1340, September.
    15. Aizpurua, J.I. & Catterson, V.M. & Papadopoulos, Y. & Chiacchio, F. & D'Urso, D., 2017. "Supporting group maintenance through prognostics-enhanced dynamic dependability prediction," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 171-188.
    16. Lee, Juseong & Mitici, Mihaela, 2022. "Multi-objective design of aircraft maintenance using Gaussian process learning and adaptive sampling," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    17. Li, Rui & Verhagen, Wim J.C. & Curran, Richard, 2020. "A systematic methodology for Prognostic and Health Management system architecture definition," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    18. Dong, Qinglai & Cui, Lirong, 2019. "A study on stochastic degradation process models under different types of failure Thresholds," Reliability Engineering and System Safety, Elsevier, vol. 181(C), pages 202-212.
    19. Azar, Kamyar & Hajiakhondi-Meybodi, Zohreh & Naderkhani, Farnoosh, 2022. "Semi-supervised clustering-based method for fault diagnosis and prognosis: A case study," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    20. Moradi, Ramin & Groth, Katrina M., 2020. "Modernizing risk assessment: A systematic integration of PRA and PHM techniques," Reliability Engineering and System Safety, Elsevier, vol. 204(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:184:y:2019:i:c:p:123-136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.