IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v301y2022i3p1007-1020.html
   My bibliography  Save this article

Age-based maintenance under population heterogeneity: Optimal exploration and exploitation

Author

Listed:
  • Dursun, İpek
  • Akçay, Alp
  • van Houtum, Geert-Jan

Abstract

We consider a system with a finite lifespan and a single critical component that is subject to random failures. An age-based replacement policy is applied to preventively replace the component before its failure. The components used for replacement come from either a weak population or a strong population, referred to as population heterogeneity. However, the true population type is unknown to the decision maker. By considering that the decision maker has a belief on the probability of having a weak population, we build a partially observable Markov decision process model with the objective of minimizing the total cost over the lifespan of the system. The resulting optimal policy updates the belief variable in a Bayesian fashion by using the data obtained over the course of the system lifespan, and it denotes when to execute preventive replacement. It optimally balances the trade-off between the cost of learning the true population type (via deliberately delaying the preventive replacement time to better learn the population type) and the cost of maintenance activities. By addressing this so-called exploration-exploitation trade-off, we generate insights on the optimal policy and compare its performance with existing heuristic approaches from the literature. We also characterize a lower bound to the optimal cost, allowing us to determine the value of resolving the uncertainty on the population type.

Suggested Citation

  • Dursun, İpek & Akçay, Alp & van Houtum, Geert-Jan, 2022. "Age-based maintenance under population heterogeneity: Optimal exploration and exploitation," European Journal of Operational Research, Elsevier, vol. 301(3), pages 1007-1020.
  • Handle: RePEc:eee:ejores:v:301:y:2022:i:3:p:1007-1020
    DOI: 10.1016/j.ejor.2021.11.038
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721009899
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2021.11.038?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Coolen-Schrijner, P. & Coolen, F.P.A., 2007. "Nonparametric adaptive age replacement with a one-cycle criterion," Reliability Engineering and System Safety, Elsevier, vol. 92(1), pages 74-84.
    2. Cavalcante, C.A.V. & Lopes, R.S. & Scarf, P.A., 2018. "A general inspection and opportunistic replacement policy for one-component systems of variable quality," European Journal of Operational Research, Elsevier, vol. 266(3), pages 911-919.
    3. Enrique López Droguett & Ali Mosleh, 2008. "Bayesian Methodology for Model Uncertainty Using Model Performance Data," Risk Analysis, John Wiley & Sons, vol. 28(5), pages 1457-1476, October.
    4. Fouladirad, Mitra & Paroissin, Christian & Grall, Antoine, 2018. "Sensitivity of optimal replacement policies to lifetime parameter estimates," European Journal of Operational Research, Elsevier, vol. 266(3), pages 963-975.
    5. Laggoune, Radouane & Chateauneuf, Alaa & Aissani, Djamil, 2010. "Impact of few failure data on the opportunistic replacement policy for multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 95(2), pages 108-119.
    6. Nakagawa, T. & Mizutani, S., 2009. "A summary of maintenance policies for a finite interval," Reliability Engineering and System Safety, Elsevier, vol. 94(1), pages 89-96.
    7. P Coolen-Schrijner & F P A Coolen, 2004. "Adaptive age replacement strategies based on nonparametric predictive inference," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(12), pages 1281-1297, December.
    8. Richard Barlow & Larry Hunter, 1960. "Optimum Preventive Maintenance Policies," Operations Research, INFORMS, vol. 8(1), pages 90-100, February.
    9. de Jonge, Bram & Klingenberg, Warse & Teunter, Ruud & Tinga, Tiedo, 2015. "Optimum maintenance strategy under uncertainty in the lifetime distribution," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 59-67.
    10. Scarf, Philip A. & Cavalcante, Cristiano A.V., 2010. "Hybrid block replacement and inspection policies for a multi-component system with heterogeneous component lives," European Journal of Operational Research, Elsevier, vol. 206(2), pages 384-394, October.
    11. de Jonge, Bram & Dijkstra, Arjan S. & Romeijnders, Ward, 2015. "Cost benefits of postponing time-based maintenance under lifetime distribution uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 140(C), pages 15-21.
    12. David T. Abdul‐Malak & Jeffrey P. Kharoufeh & Lisa M. Maillart, 2019. "Maintaining systems with heterogeneous spare parts," Naval Research Logistics (NRL), John Wiley & Sons, vol. 66(6), pages 485-501, September.
    13. D Lugtigheid & X Jiang & A K S Jardine, 2008. "A finite horizon model for repairable systems with repair restrictions," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(10), pages 1321-1331, October.
    14. Jiang, R., 2009. "An accurate approximate solution of optimal sequential age replacement policy for a finite-time horizon," Reliability Engineering and System Safety, Elsevier, vol. 94(8), pages 1245-1250.
    15. Belyi, Dmitriy & Popova, Elmira & Morton, David P. & Damien, Paul, 2017. "Bayesian failure-rate modeling and preventive maintenance optimization," European Journal of Operational Research, Elsevier, vol. 262(3), pages 1085-1093.
    16. Walter, Gero & Flapper, Simme Douwe, 2017. "Condition-based maintenance for complex systems based on current component status and Bayesian updating of component reliability," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 227-239.
    17. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    18. Cheng, Tianjin & Pandey, Mahesh D. & van der Weide, J.A.M., 2012. "The probability distribution of maintenance cost of a system affected by the gamma process of degradation: Finite time solution," Reliability Engineering and System Safety, Elsevier, vol. 108(C), pages 65-76.
    19. Scarf, Philip A. & Cavalcante, Cristiano A.V., 2012. "Modelling quality in replacement and inspection maintenance," International Journal of Production Economics, Elsevier, vol. 135(1), pages 372-381.
    20. Savaş Dayanik & Ülkü Gürler, 2002. "An Adaptive Bayesian Replacement Policy with Minimal Repair," Operations Research, INFORMS, vol. 50(3), pages 552-558, June.
    21. Chiel van Oosterom & Hao Peng & Geert-Jan van Houtum, 2017. "Maintenance optimization for a Markovian deteriorating system with population heterogeneity," IISE Transactions, Taylor & Francis Journals, vol. 49(1), pages 96-109, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pinciroli, Luca & Baraldi, Piero & Zio, Enrico, 2023. "Maintenance optimization in industry 4.0," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    2. Dursun, İpek & Akçay, Alp & van Houtum, Geert-Jan, 2022. "Data pooling for multiple single-component systems under population heterogeneity," International Journal of Production Economics, Elsevier, vol. 250(C).
    3. Cai, Yue & Teunter, Ruud H. & de Jonge, Bram, 2023. "A data-driven approach for condition-based maintenance optimization," European Journal of Operational Research, Elsevier, vol. 311(2), pages 730-738.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    2. Dursun, İpek & Akçay, Alp & van Houtum, Geert-Jan, 2022. "Data pooling for multiple single-component systems under population heterogeneity," International Journal of Production Economics, Elsevier, vol. 250(C).
    3. de Jonge, Bram & Dijkstra, Arjan S. & Romeijnders, Ward, 2015. "Cost benefits of postponing time-based maintenance under lifetime distribution uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 140(C), pages 15-21.
    4. Cavalcante, Cristiano A.V. & Lopes, Rodrigo S. & Scarf, Philip A., 2021. "Inspection and replacement policy with a fixed periodic schedule," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    5. Zhao, Yunfei & Smidts, Carol, 2022. "Reinforcement learning for adaptive maintenance policy optimization under imperfect knowledge of the system degradation model and partial observability of system states," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    6. Vanderschueren, Toon & Boute, Robert & Verdonck, Tim & Baesens, Bart & Verbeke, Wouter, 2023. "Optimizing the preventive maintenance frequency with causal machine learning," International Journal of Production Economics, Elsevier, vol. 258(C).
    7. Briš, Radim & Byczanski, Petr & Goňo, Radomír & Rusek, Stanislav, 2017. "Discrete maintenance optimization of complex multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 80-89.
    8. Santos, Augusto César de Jesus & Cavalcante, Cristiano Alexandre Virgínio, 2022. "A study on the economic and environmental viability of second-hand items in maintenance policies," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    9. de Jonge, Bram & Teunter, Ruud & Tinga, Tiedo, 2017. "The influence of practical factors on the benefits of condition-based maintenance over time-based maintenance," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 21-30.
    10. Scarf, P.A. & Cavalcante, C.A.V. & Lopes, R.S., 2019. "Delay-time modelling of a critical system subject to random inspections," European Journal of Operational Research, Elsevier, vol. 278(3), pages 772-782.
    11. Li, Mingxin & Jiang, Xiaoli & Carroll, James & Negenborn, Rudy R., 2022. "A multi-objective maintenance strategy optimization framework for offshore wind farms considering uncertainty," Applied Energy, Elsevier, vol. 321(C).
    12. Insua, David Rios & Ruggeri, Fabrizio & Soyer, Refik & Wilson, Simon, 2020. "Advances in Bayesian decision making in reliability," European Journal of Operational Research, Elsevier, vol. 282(1), pages 1-18.
    13. Yang, Li & Ma, Xiaobing & Zhai, Qingqing & Zhao, Yu, 2016. "A delay time model for a mission-based system subject to periodic and random inspection and postponed replacement," Reliability Engineering and System Safety, Elsevier, vol. 150(C), pages 96-104.
    14. Zhao, Xufeng & Al-Khalifa, Khalifa N. & Magid Hamouda, Abdel & Nakagawa, Toshio, 2017. "Age replacement models: A summary with new perspectives and methods," Reliability Engineering and System Safety, Elsevier, vol. 161(C), pages 95-105.
    15. Fouladirad, Mitra & Paroissin, Christian & Grall, Antoine, 2018. "Sensitivity of optimal replacement policies to lifetime parameter estimates," European Journal of Operational Research, Elsevier, vol. 266(3), pages 963-975.
    16. Alotaibi, Naif M. & Scarf, Philip & Cavalcante, Cristiano A.V. & Lopes, Rodrigo S. & de Oliveira e Silva, André Luiz & Rodrigues, Augusto J.S. & Alyami, Salem A., 2023. "Modified-opportunistic inspection and the case of remote, groundwater well-heads," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    17. Sánchez-Herguedas, Antonio & Mena-Nieto, Angel & Rodrigo-Muñoz, Francisco, 2021. "A new analytical method to optimise the preventive maintenance interval by using a semi-Markov process and z-transform with an application to marine diesel engines," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    18. de Jonge, Bram & Jakobsons, Edgars, 2018. "Optimizing block-based maintenance under random machine usage," European Journal of Operational Research, Elsevier, vol. 265(2), pages 703-709.
    19. Truong Ba, H. & Cholette, M.E. & Borghesani, P. & Zhou, Y. & Ma, L., 2017. "Opportunistic maintenance considering non-homogenous opportunity arrivals and stochastic opportunity durations," Reliability Engineering and System Safety, Elsevier, vol. 160(C), pages 151-161.
    20. Jiang, R., 2018. "Performance evaluation of seven optimization models of age replacement policy," Reliability Engineering and System Safety, Elsevier, vol. 180(C), pages 302-311.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:301:y:2022:i:3:p:1007-1020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.