IDEAS home Printed from https://ideas.repec.org/a/sae/risrel/v232y2018i6p677-689.html
   My bibliography  Save this article

A Markov decision process framework for optimal operation of monitored multi-state systems

Author

Listed:
  • Michele Compare
  • Paolo Marelli
  • Piero Baraldi
  • Enrico Zio

Abstract

We develop a decision support framework based on Markov decision processes to maximize the profit from the operation of a multi-state system. This framework enables a comprehensive management of the multi-state system, which considers the maintenance decisions together with those on the multi-state system operation setting, that is, its loading condition and configuration. The decisions are informed by a condition monitoring system, which estimates the health state of the multi-state system components. The approach is shown with reference to a mechanical system made up of components affected by fatigue.

Suggested Citation

  • Michele Compare & Paolo Marelli & Piero Baraldi & Enrico Zio, 2018. "A Markov decision process framework for optimal operation of monitored multi-state systems," Journal of Risk and Reliability, , vol. 232(6), pages 677-689, December.
    • Handle: RePEc:sae:risrel:v:232:y:2018:i:6:p:677-689
    DOI: 10.1177/1748006X18757077
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1748006X18757077
    Download Restriction: no
    File URL: https://libkey.io/10.1177/1748006X18757077?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wallace J. Hopp & Yar‐Lin Kuo, 1998. "An optimal structured policy for maintenance of partially observable aircraft engine components," Naval Research Logistics (NRL), John Wiley & Sons, vol. 45(4), pages 335-352, June.
    2. Linkan Bian & Nagi Gebraeel, 2014. "Stochastic modeling and real-time prognostics for multi-component systems with degradation rate interactions," IISE Transactions, Taylor & Francis Journals, vol. 46(5), pages 470-482.
    3. Olde Keizer, Minou C.A. & Teunter, Ruud H. & Veldman, Jasper, 2017. "Joint condition-based maintenance and inventory optimization for systems with multiple components," European Journal of Operational Research, Elsevier, vol. 257(1), pages 209-222.
    4. Wijnmalen, Diederik J. D. & Hontelez, Jan A. M., 1997. "Coordinated condition-based repair strategies for components of a multi-component maintenance system with discounts," European Journal of Operational Research, Elsevier, vol. 98(1), pages 52-63, April.
    5. Zio, Enrico & Compare, Michele, 2013. "Evaluating maintenance policies by quantitative modeling and analysis," Reliability Engineering and System Safety, Elsevier, vol. 109(C), pages 53-65.
    6. Memarzadeh, Milad & Pozzi, Matteo, 2016. "Value of information in sequential decision making: Component inspection, permanent monitoring and system-level scheduling," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 137-151.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mancuso, A. & Compare, M. & Salo, A. & Zio, E., 2021. "Optimal Prognostics and Health Management-driven inspection and maintenance strategies for industrial systems," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    2. Zhang, Xiaohong & Zeng, Jianchao, 2017. "Joint optimization of condition-based opportunistic maintenance and spare parts provisioning policy in multiunit systems," European Journal of Operational Research, Elsevier, vol. 262(2), pages 479-498.
    3. Olde Keizer, Minou C.A. & Flapper, Simme Douwe P. & Teunter, Ruud H., 2017. "Condition-based maintenance policies for systems with multiple dependent components: A review," European Journal of Operational Research, Elsevier, vol. 261(2), pages 405-420.
    4. Zou, Guang & Kolios, Athanasios, 2022. "Quantifying the value of negative inspection outcomes in fatigue maintenance planning: Cost reduction, risk mitigation and reliability growth," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    5. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    6. Asadzadeh, S.M. & Azadeh, A., 2014. "An integrated systemic model for optimization of condition-based maintenance with human error," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 117-131.
    7. Chang, Miaoxin & Huang, Xianzhen & Coolen, Frank P.A. & Coolen-Maturi, Tahani, 2021. "Reliability analysis for systems based on degradation rates and hard failure thresholds changing with degradation levels," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    8. Azizi, Fariba & Salari, Nooshin, 2023. "A novel condition-based maintenance framework for parallel manufacturing systems based on bivariate birth/birth–death processes," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    9. Guo R. & Ascher H. & Love E., 2001. "Towards Practical and Synthetical Modelling of Repairable Systems," Stochastics and Quality Control, De Gruyter, vol. 16(1), pages 147-182, January.
    10. Liang, Zhenglin & Li, Yan-Fu, 2023. "Holistic Resilience and Reliability Measures for Cellular Telecommunication Networks," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    11. Zhu, Mixin & Zhou, Xiaojun, 2023. "Hybrid opportunistic maintenance policy for serial-parallel multi-station manufacturing systems with spare part overlap," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    12. Salari, Nooshin & Makis, Viliam, 2017. "Comparison of two maintenance policies for a multi-unit system considering production and demand rates," International Journal of Production Economics, Elsevier, vol. 193(C), pages 381-391.
    13. Michele Compare & Francesco Di Maio & Enrico Zio & Fausto Carlevaro & Sara Mattafirri, 2016. "Improving scheduled maintenance by missing data reconstruction: A double-loop Monte Carlo approach," Journal of Risk and Reliability, , vol. 230(5), pages 502-511, October.
    14. Kapoor, Medha & Christensen, Christian Overgaard & Schmidt, Jacob Wittrup & Sørensen, John Dalsgaard & Thöns, Sebastian, 2023. "Decision analytic approach for the reclassification of concrete bridges by using elastic limit information from proof loading," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    15. Zhang, Jian-Xun & Si, Xiao-Sheng & Du, Dang-Bo & Hu, Chang-Hua & Hu, Chen, 2020. "A novel iterative approach of lifetime estimation for standby systems with deteriorating spare parts," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    16. Liu, Xinbao & Yang, Tianji & Pei, Jun & Liao, Haitao & Pohl, Edward A., 2019. "Replacement and inventory control for a multi-customer product service system with decreasing replacement costs," European Journal of Operational Research, Elsevier, vol. 273(2), pages 561-574.
    17. Ali Salmasnia & Ali Talesh-Kazemi, 2022. "Integrating inventory planning, pricing and maintenance for perishable products in a two-component parallel manufacturing system with common cause failures," Operational Research, Springer, vol. 22(2), pages 1235-1265, April.
    18. Lin, Boliang & Zhao, Yinan, 2021. "Synchronized optimization of EMU train assignment and second-level preventive maintenance scheduling," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    19. Sima Rastayesh & Lijia Long & John Dalsgaard Sørensen & Sebastian Thöns, 2019. "Risk Assessment and Value of Action Analysis for Icing Conditions of Wind Turbines Close to Highways," Energies, MDPI, vol. 12(14), pages 1-15, July.
    20. Zhu, Mixin & Zhou, Xiaojun, 2024. "Maintenance modeling of serial-parallel multi-station manufacturing system with failure-induced damage and assembly parts," Reliability Engineering and System Safety, Elsevier, vol. 249(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:risrel:v:232:y:2018:i:6:p:677-689. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.