IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v304y2023i3p1242-1255.html
   My bibliography  Save this article

Hidden markov models in reliability and maintenance

Author

Listed:
  • Gámiz, María Luz
  • Limnios, Nikolaos
  • Segovia-García, María del Carmen

Abstract

Although the hidden Markov models (HMM) are very popular in many applied areas their use in reliability engineering is limited. Problems such as the selection of the HMM model by choosing the appropriate number of states, or problems of prediction of failures have not been widely covered in the literature. This paper is concerned with the use of HMMs where the state of the system is not directly observable and instead certain indicators of the true situation are provided via a control system. A hidden model can provide key information about the system dependability such as the failed component of the system, the reliability of the system and related measures. A maximum-likelihood estimator of the system reliability is obtained and its asymptotic properties are studied. Finally, the maintenance of the system is considered in this context and new preventive maintenance strategies are defined and their efficiency is measured in terms of expected cost. To prove the finite sample performance of the methodology, an extensive simulation study is developed.

Suggested Citation

  • Gámiz, María Luz & Limnios, Nikolaos & Segovia-García, María del Carmen, 2023. "Hidden markov models in reliability and maintenance," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1242-1255.
    • Handle: RePEc:eee:ejores:v:304:y:2023:i:3:p:1242-1255
    DOI: 10.1016/j.ejor.2022.05.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221722003642
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2022.05.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. M. Boussemart & T. Bickard & N. Limnios, 2001. "Markov Decision Processes with a Constraint on the Asymptotic Failure Rate," Methodology and Computing in Applied Probability, Springer, vol. 3(2), pages 199-214, June.
    2. Pham, Hoang & Wang, Hongzhou, 1996. "Imperfect maintenance," European Journal of Operational Research, Elsevier, vol. 94(3), pages 425-438, November.
    3. Wang, Hongzhou, 2002. "A survey of maintenance policies of deteriorating systems," European Journal of Operational Research, Elsevier, vol. 139(3), pages 469-489, June.
    4. Fort, A. & Mugnaini, M. & Vignoli, V., 2015. "Hidden Markov Models approach used for life parameters estimations," Reliability Engineering and System Safety, Elsevier, vol. 136(C), pages 85-91.
    5. Votsi, I. & Limnios, N. & Tsaklidis, G. & Papadimitriou, E., 2013. "Hidden Markov models revealing the stress field underlying the earthquake generation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(13), pages 2868-2885.
    6. Landon, Joshua & Özekici, Süleyman & Soyer, Refik, 2013. "A Markov modulated Poisson model for software reliability," European Journal of Operational Research, Elsevier, vol. 229(2), pages 404-410.
    7. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    8. Zhou, Zhi-Jie & Hu, Chang-Hua & Xu, Dong-Ling & Chen, Mao-Yin & Zhou, Dong-Hua, 2010. "A model for real-time failure prognosis based on hidden Markov model and belief rule base," European Journal of Operational Research, Elsevier, vol. 207(1), pages 269-283, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. María Luz Gámiz & Nikolaos Limnios & Mari Carmen Segovia-García, 2023. "The continuous-time hidden Markov model based on discretization. Properties of estimators and applications," Statistical Inference for Stochastic Processes, Springer, vol. 26(3), pages 525-550, October.
    2. Arafat, M.Y. & Hossain, M.J. & Alam, Md Morshed, 2024. "Machine learning scopes on microgrid predictive maintenance: Potential frameworks, challenges, and prospects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 190(PA).
    3. Gámiz, M.L. & Navas-Gómez, F. & Raya-Miranda, R. & Segovia-García, M.C., 2023. "Dynamic reliability and sensitivity analysis based on HMM models with Markovian signal process," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    4. Xu, Jianyu & Liu, Bin & Zhao, Xiujie & Wang, Xiao-Lin, 2024. "Online reinforcement learning for condition-based group maintenance using factored Markov decision processes," European Journal of Operational Research, Elsevier, vol. 315(1), pages 176-190.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Toon Vanderschueren & Robert Boute & Tim Verdonck & Bart Baesens & Wouter Verbeke, 2022. "Prescriptive maintenance with causal machine learning," Papers 2206.01562, arXiv.org.
    2. Vanderschueren, Toon & Boute, Robert & Verdonck, Tim & Baesens, Bart & Verbeke, Wouter, 2023. "Optimizing the preventive maintenance frequency with causal machine learning," International Journal of Production Economics, Elsevier, vol. 258(C).
    3. Xiang, Yisha, 2013. "Joint optimization of X¯ control chart and preventive maintenance policies: A discrete-time Markov chain approach," European Journal of Operational Research, Elsevier, vol. 229(2), pages 382-390.
    4. Seyed Habib A. Rahmati & Abbas Ahmadi & Kannan Govindan, 2018. "A novel integrated condition-based maintenance and stochastic flexible job shop scheduling problem: simulation-based optimization approach," Annals of Operations Research, Springer, vol. 269(1), pages 583-621, October.
    5. Zhengxin Zhang & Xiaosheng Si & Changhua Hu & Xiangyu Kong, 2015. "Degradation modeling–based remaining useful life estimation: A review on approaches for systems with heterogeneity," Journal of Risk and Reliability, , vol. 229(4), pages 343-355, August.
    6. Liu, Gehui & Chen, Shaokuan & Ho, Tinkin & Ran, Xinchen & Mao, Baohua & Lan, Zhen, 2022. "Optimum opportunistic maintenance schedule over variable horizons considering multi-stage degradation and dynamic strategy," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    7. Belyi, Dmitriy & Popova, Elmira & Morton, David P. & Damien, Paul, 2017. "Bayesian failure-rate modeling and preventive maintenance optimization," European Journal of Operational Research, Elsevier, vol. 262(3), pages 1085-1093.
    8. Kurt, Murat & Kharoufeh, Jeffrey P., 2010. "Optimally maintaining a Markovian deteriorating system with limited imperfect repairs," European Journal of Operational Research, Elsevier, vol. 205(2), pages 368-380, September.
    9. Jyrki Savolainen & Michele Urbani, 2021. "Maintenance optimization for a multi-unit system with digital twin simulation," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1953-1973, October.
    10. Alaswad, Suzan & Xiang, Yisha, 2017. "A review on condition-based maintenance optimization models for stochastically deteriorating system," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 54-63.
    11. Nguyen, Kim-Anh & Do, Phuc & Grall, Antoine, 2017. "Joint predictive maintenance and inventory strategy for multi-component systems using Birnbaum’s structural importance," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 249-261.
    12. Badía, F.G. & Berrade, M.D. & Cha, Ji Hwan & Lee, Hyunju, 2018. "Optimal replacement policy under a general failure and repair model: Minimal versus worse than old repair," Reliability Engineering and System Safety, Elsevier, vol. 180(C), pages 362-372.
    13. Zio, Enrico & Compare, Michele, 2013. "Evaluating maintenance policies by quantitative modeling and analysis," Reliability Engineering and System Safety, Elsevier, vol. 109(C), pages 53-65.
    14. Carpitella, Silvia & Mzougui, Ilyas & Benítez, Julio & Carpitella, Fortunato & Certa, Antonella & Izquierdo, Joaquín & La Cascia, Marco, 2021. "A risk evaluation framework for the best maintenance strategy: The case of a marine salt manufacture firm," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    15. Wang, Xiaolin & Balakrishnan, Narayanaswamy & Guo, Bo, 2014. "Residual life estimation based on a generalized Wiener degradation process," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 13-23.
    16. Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
    17. Francesco Corman & Sander Kraijema & Milinko Godjevac & Gabriel Lodewijks, 2017. "Optimizing preventive maintenance policy: A data-driven application for a light rail braking system," Journal of Risk and Reliability, , vol. 231(5), pages 534-545, October.
    18. Zitrou, A. & Bedford, T. & Daneshkhah, A., 2013. "Robustness of maintenance decisions: Uncertainty modelling and value of information," Reliability Engineering and System Safety, Elsevier, vol. 120(C), pages 60-71.
    19. Shafiee, Mahmood & Chukova, Stefanka, 2013. "Maintenance models in warranty: A literature review," European Journal of Operational Research, Elsevier, vol. 229(3), pages 561-572.
    20. Kenné, Jean-Pierre & Gharbi, Ali, 2018. "Production and replacement policies for a deteriorating manufacturing system under random demand and qualityAuthor-Name: Ouaret, Samir," European Journal of Operational Research, Elsevier, vol. 264(2), pages 623-636.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:304:y:2023:i:3:p:1242-1255. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.