IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v236y2023ics0951832023002120.html
   My bibliography  Save this article

A Q-learning guided search for developing a hybrid of mixed redundancy strategies to improve system reliability

Author

Listed:
  • Hsieh, Tsung-Jung

Abstract

Mixed redundancy strategies (MRSs) are based on leveraging a diverse combination of active and cold-standby components to improve system reliability. This study integrates three designed MRSs and employs them to develop a hybrid model to solve redundancy allocation problems (RAPs) and reliability-RAPs (RRAPs). The MRS best suited for a specific subsystem is difficult to determine. To resolve this issue, in the process of system reliability optimization, the state of limited resource utilization (e.g., cost, weight, and volume) in each subsystem facilitates the adoption of MRSs and is used as a learnable factor. To realize this learning process, Q-learning is used in this study to build a knowledge library (i.e., a Q-table) of MRS usage, where the Q-table guides the main optimization technique, the artificial bee colony algorithm (ABC), to expedite the convergence in searching for near-optimal solutions. For convenience, the Q-learning-guided ABC search method is abbreviated as QABCS, and the new MRSs obtained by QABCS are called Q-mixed. The experimental results show that Q-mixed not only improves system reliability but also reveals the preferences of each subsystem for the MRSs.

Suggested Citation

  • Hsieh, Tsung-Jung, 2023. "A Q-learning guided search for developing a hybrid of mixed redundancy strategies to improve system reliability," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    • Handle: RePEc:eee:reensy:v:236:y:2023:i:c:s0951832023002120
    DOI: 10.1016/j.ress.2023.109297
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023002120
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2023.109297?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Abouei Ardakan, Mostafa & Zeinal Hamadani, Ali, 2014. "Reliability optimization of series–parallel systems with mixed redundancy strategy in subsystems," Reliability Engineering and System Safety, Elsevier, vol. 130(C), pages 132-139.
    2. Hsieh, Tsung-Jung, 2023. "Performance indicator-based multi-objective reliability optimization for multi-type production systems with heterogeneous machines," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    3. Gholinezhad, Hadi & Zeinal Hamadani, Ali, 2017. "A new model for the redundancy allocation problem with component mixing and mixed redundancy strategy," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 66-73.
    4. Ouyang, Zhiyuan & Liu, Yu & Ruan, Sheng-Jia & Jiang, Tao, 2019. "An improved particle swarm optimization algorithm for reliability-redundancy allocation problem with mixed redundancy strategy and heterogeneous components," Reliability Engineering and System Safety, Elsevier, vol. 181(C), pages 62-74.
    5. Mellal, Mohamed Arezki & Zio, Enrico, 2016. "A penalty guided stochastic fractal search approach for system reliability optimization," Reliability Engineering and System Safety, Elsevier, vol. 152(C), pages 213-227.
    6. Mostafa Abouei Ardakan & Mohammad Sima & Ali Zeinal Hamadani & David W. Coit, 2016. "A novel strategy for redundant components in reliability--redundancy allocation problems," IISE Transactions, Taylor & Francis Journals, vol. 48(11), pages 1043-1057, November.
    7. Kim, Heungseob & Kim, Pansoo, 2017. "Reliability–redundancy allocation problem considering optimal redundancy strategy using parallel genetic algorithm," Reliability Engineering and System Safety, Elsevier, vol. 159(C), pages 153-160.
    8. Guilani, Pardis Pourkarim & Ardakan, Mostafa Abouei & Dobani, Ehsan Ramezani, 2022. "Optimal component sequence in heterogeneous 1-out-of-N mixed RRAPs," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    9. Ardakan, Mostafa Abouei & Talkhabi, Sajjad & Juybari, Mohammad N., 2022. "Optimal activation order vs. redundancy strategies in reliability optimization problems," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    10. Juan Li & Hong Lei & Amir H. Alavi & Gai-Ge Wang, 2020. "Elephant Herding Optimization: Variants, Hybrids, and Applications," Mathematics, MDPI, vol. 8(9), pages 1-25, August.
    11. Peiravi, Abdossaber & Karbasian, Mahdi & Ardakan, Mostafa Abouei & Coit, David W., 2019. "Reliability optimization of series-parallel systems with K-mixed redundancy strategy," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 17-28.
    12. Sedaghat, Niloofar & Ardakan, Mostafa Abouei, 2021. "G-mixed: A new strategy for redundant components in reliability optimization problems," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    13. Feizabadi, Mohammad & Jahromi, Abdolhamid Eshraghniaye, 2017. "A new model for reliability optimization of series-parallel systems with non-homogeneous components," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 101-112.
    14. Ardakan, Mostafa Abouei & Amini, Hanieh & Juybari, Mohammad N., 2022. "Prescheduled switching time: A new strategy for systems with standby components," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    15. Golmohammadi, Elnaz & Ardakan, Mostafa Abouei, 2022. "Reliability optimization problem with the mixed strategy, degrading components, and a periodic inspection and maintenance policy," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    16. Wang, Wei & Lin, Mingqiang & Fu, Yongnian & Luo, Xiaoping & Chen, Hanghang, 2020. "Multi-objective optimization of reliability-redundancy allocation problem for multi-type production systems considering redundancy strategies," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    17. Dobani, Ehsan Ramezani & Ardakan, Mostafa Abouei & Davari-Ardakani, Hamed & Juybari, Mohammad N., 2019. "RRAP-CM: A new reliability-redundancy allocation problem with heterogeneous components," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    18. Yeh, Wei-Chang, 2022. "BAT-based algorithm for finding all Pareto solutions of the series-parallel redundancy allocation problem with mixed components," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    19. Yeh, Wei-Chang & Zhu, Wenbo & Tan, Shi-Yi & Wang, Gai-Ge & Yeh, Yuan-Hui, 2022. "Novel general active reliability redundancy allocation problems and algorithm," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    20. Nath, Rahul & Muhuri, Pranab K., 2022. "Evolutionary Optimization based Solution approaches for Many Objective Reliability-Redundancy Allocation Problem," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    21. Li, Shuai & Chi, Xuefen & Yu, Baozhu, 2022. "An improved particle swarm optimization algorithm for the reliability–redundancy allocation problem with global reliability," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    22. Zhang, Jinchun & Lv, Hang & Hou, Jinxiu, 2023. "A novel general model for RAP and RRAP optimization of k-out-of-n:G systems with mixed redundancy strategy," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    23. Saeideh Sheikhpour & Amin Kargar-Barzi & Ali Mahani, 2022. "A novel component mixing and mixed redundancy strategy for reliability optimization," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(1), pages 328-346, February.
    24. Hsieh, Tsung-Jung, 2021. "Component mixing with a cold standby strategy for the redundancy allocation problem," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Juybari, Mohammad N. & Hamadani, Ali Zeinal & Ardakan, Mostafa Abouei, 2023. "Availability analysis and cost optimization of a repairable system with a mix of active and warm-standby components in a shock environment," Reliability Engineering and System Safety, Elsevier, vol. 237(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Shuai & Chi, Xuefen & Yu, Baozhu, 2022. "An improved particle swarm optimization algorithm for the reliability–redundancy allocation problem with global reliability," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Zhang, Hanxiao & Sun, Muxia & Li, Yan-Fu, 2022. "Reliability–redundancy allocation problem in multi-state flow network: Minimal cut-based approximation scheme," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    3. Chowdury, Md. Abdul Malek & Nath, Rahul & Shukla, Amit K. & Rauniyar, Amit & Muhuri, Pranab K., 2024. "Multi-task optimization in reliability redundancy allocation problem: A multifactorial evolutionary-based approach," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    4. Yeh, Wei-Chang, 2022. "BAT-based algorithm for finding all Pareto solutions of the series-parallel redundancy allocation problem with mixed components," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    5. Nath, Rahul & Muhuri, Pranab K., 2024. "A novel evolutionary solution approach for many-objective reliability-redundancy allocation problem based on objective prioritization and constraint optimization," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    6. Peiravi, Abdossaber & Nourelfath, Mustapha & Zanjani, Masoumeh Kazemi, 2022. "Universal redundancy strategy for system reliability optimization," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    7. Zhang, Zixuan & Yang, Lin & Xu, Youwei & Zhu, Ran & Cao, Yining, 2023. "A novel reliability redundancy allocation problem formulation for complex systems," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    8. Guilani, Pardis Pourkarim & Ardakan, Mostafa Abouei & Dobani, Ehsan Ramezani, 2022. "Optimal component sequence in heterogeneous 1-out-of-N mixed RRAPs," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    9. Levitin, Gregory & Xing, Liudong & Dai, Yuanshun, 2023. "Optimizing partial component activation policy in multi-attempt missions," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    10. Soheil Azizi & Milad Mohammadi, 2023. "Strategy selection for multi-objective redundancy allocation problem in a k-out-of-n system considering the mean time to failure," OPSEARCH, Springer;Operational Research Society of India, vol. 60(2), pages 1021-1044, June.
    11. Gholinezhad, Hadi, 2024. "A new model for reliability redundancy allocation problem with component mixing," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    12. Levitin, Gregory & Xing, Liudong & Dai, Yuanshun, 2024. "Optimal tasks assignment policy in multi-task multi-attempt missions," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    13. Hsieh, Tsung-Jung, 2023. "Performance indicator-based multi-objective reliability optimization for multi-type production systems with heterogeneous machines," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    14. Peiravi, Abdossaber & Ardakan, Mostafa Abouei & Zio, Enrico, 2020. "A new Markov-based model for reliability optimization problems with mixed redundancy strategy," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    15. Wang, Wei & Lin, Mingqiang & Fu, Yongnian & Luo, Xiaoping & Chen, Hanghang, 2020. "Multi-objective optimization of reliability-redundancy allocation problem for multi-type production systems considering redundancy strategies," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    16. Dobani, Ehsan Ramezani & Ardakan, Mostafa Abouei & Davari-Ardakani, Hamed & Juybari, Mohammad N., 2019. "RRAP-CM: A new reliability-redundancy allocation problem with heterogeneous components," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    17. Myung-Ki Baek & Heungseob Kim, 2024. "Lifetime Distribution for a Mixed Redundant System with Imperfect Switch and Components Having Phase–Type Time-to-Failure Distribution," Mathematics, MDPI, vol. 12(8), pages 1-17, April.
    18. Hsieh, Tsung-Jung, 2021. "Component mixing with a cold standby strategy for the redundancy allocation problem," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    19. Saeideh Sheikhpour & Amin Kargar-Barzi & Ali Mahani, 2022. "A novel component mixing and mixed redundancy strategy for reliability optimization," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(1), pages 328-346, February.
    20. Zhang, Jinchun & Lv, Hang & Hou, Jinxiu, 2023. "A novel general model for RAP and RRAP optimization of k-out-of-n:G systems with mixed redundancy strategy," Reliability Engineering and System Safety, Elsevier, vol. 229(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:236:y:2023:i:c:s0951832023002120. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.