IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v252y2024ics0951832024005040.html
   My bibliography  Save this article

Bayesian improved cross entropy method with categorical mixture models for network reliability assessment

Author

Listed:
  • Chan, Jianpeng
  • Papaioannou, Iason
  • Straub, Daniel

Abstract

We employ the Bayesian improved cross entropy (BiCE) method for rare event estimation in static networks and choose the categorical mixture (CM) as the parametric family to capture the dependence among network components. The proposed method is termed BiCE-CM. At each iteration of BiCE-CM, the mixture parameters are updated through the weighted maximum a posteriori (MAP) estimate, which mitigates the overfitting issue of the standard improved cross entropy (iCE) method through a novel balanced prior, and we propose a generalized version of the expectation–maximization (EM) algorithm to approximate this weighted MAP estimate. The resulting importance sampling distribution is proved to be unbiased. For choosing a proper number of components K in the mixture, we compute the Bayesian information criterion (BIC) of each candidate K as a by-product of the generalized EM algorithm. The performance of the proposed method is investigated through a simple illustration, a benchmark study, and a practical application. In all these numerical examples, the BiCE-CM method results in an efficient and accurate estimator that significantly outperforms the standard iCE method and the BiCE method with the independent categorical distribution.

Suggested Citation

  • Chan, Jianpeng & Papaioannou, Iason & Straub, Daniel, 2024. "Bayesian improved cross entropy method with categorical mixture models for network reliability assessment," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
  • Handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005040
    DOI: 10.1016/j.ress.2024.110432
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024005040
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110432?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. H. Cancela & M. Khadiri & G. Rubino, 2012. "A new simulation method based on the RVR principle for the rare event network reliability problem," Annals of Operations Research, Springer, vol. 196(1), pages 111-136, July.
    2. Zio, Enrico & Podofillini, Luca, 2006. "Accounting for components interactions in the differential importance measure," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1163-1174.
    3. George S. Fishman, 1986. "A Monte Carlo Sampling Plan for Estimating Network Reliability," Operations Research, INFORMS, vol. 34(4), pages 581-594, August.
    4. Chan, Jianpeng & Papaioannou, Iason & Straub, Daniel, 2022. "An adaptive subset simulation algorithm for system reliability analysis with discontinuous limit states," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    5. J. Scott Provan & Michael O. Ball, 1984. "Computing Network Reliability in Time Polynomial in the Number of Cuts," Operations Research, INFORMS, vol. 32(3), pages 516-526, June.
    6. Paredes, R. & Dueñas-Osorio, L. & Meel, K.S. & Vardi, M.Y., 2019. "Principled network reliability approximation: A counting-based approach," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    7. Dehghani, Nariman L. & Zamanian, Soroush & Shafieezadeh, Abdollah, 2021. "Adaptive network reliability analysis: Methodology and applications to power grid," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    8. Michael O. Ball & J. Scott Provan, 1988. "Disjoint Products and Efficient Computation of Reliability," Operations Research, INFORMS, vol. 36(5), pages 703-715, October.
    9. Enrico Zio, 2013. "Monte Carlo Simulation: The Method," Springer Series in Reliability Engineering, in: The Monte Carlo Simulation Method for System Reliability and Risk Analysis, edition 127, chapter 0, pages 19-58, Springer.
    10. Pieter-Tjerk de Boer & Dirk Kroese & Shie Mannor & Reuven Rubinstein, 2005. "A Tutorial on the Cross-Entropy Method," Annals of Operations Research, Springer, vol. 134(1), pages 19-67, February.
    11. Jensen, H.A. & Jerez, D.J., 2018. "A Stochastic Framework for Reliability and Sensitivity Analysis of Large Scale Water Distribution Networks," Reliability Engineering and System Safety, Elsevier, vol. 176(C), pages 80-92.
    12. Kang, Won-Hee & Song, Junho & Gardoni, Paolo, 2008. "Matrix-based system reliability method and applications to bridge networks," Reliability Engineering and System Safety, Elsevier, vol. 93(11), pages 1584-1593.
    13. Cadini, Francesco & Agliardi, Gian Luca & Zio, Enrico, 2017. "Estimation of rare event probabilities in power transmission networks subject to cascading failures," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 9-20.
    14. Kaynar, Bahar & Ridder, Ad, 2010. "The cross-entropy method with patching for rare-event simulation of large Markov chains," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1380-1397, December.
    15. K.-P. Hui & N. Bean & M. Kraetzl & Dirk Kroese, 2005. "The Cross-Entropy Method for Network Reliability Estimation," Annals of Operations Research, Springer, vol. 134(1), pages 101-118, February.
    16. Papaioannou, Iason & Geyer, Sebastian & Straub, Daniel, 2019. "Improved cross entropy-based importance sampling with a flexible mixture model," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chan, Jianpeng & Papaioannou, Iason & Straub, Daniel, 2022. "An adaptive subset simulation algorithm for system reliability analysis with discontinuous limit states," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Monfared, M.A.S. & Rezazadeh, Masoumeh & Alipour, Zohreh, 2022. "Road networks reliability estimations and optimizations: A Bi-directional bottom-up, top-down approach," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    3. Mehni, Moien Barkhori & Mehni, Mohammad Barkhori, 2023. "Reliability analysis with cross-entropy based adaptive Markov chain importance sampling and control variates," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    4. Kin-Ping Hui, 2011. "Cooperative Cross-Entropy method for generating entangled networks," Annals of Operations Research, Springer, vol. 189(1), pages 205-214, September.
    5. Di Maio, Francesco & Pettorossi, Chiara & Zio, Enrico, 2023. "Entropy-driven Monte Carlo simulation method for approximating the survival signature of complex infrastructures," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    6. El Masri, Maxime & Morio, Jérôme & Simatos, Florian, 2021. "Improvement of the cross-entropy method in high dimension for failure probability estimation through a one-dimensional projection without gradient estimation," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    7. Zdravko I. Botev & Pierre L'Ecuyer & Gerardo Rubino & Richard Simard & Bruno Tuffin, 2013. "Static Network Reliability Estimation via Generalized Splitting," INFORMS Journal on Computing, INFORMS, vol. 25(1), pages 56-71, February.
    8. Li, Jian & Dueñas-Osorio, Leonardo & Chen, Changkun & Shi, Congling, 2016. "Connectivity reliability and topological controllability of infrastructure networks: A comparative assessment," Reliability Engineering and System Safety, Elsevier, vol. 156(C), pages 24-33.
    9. Ali Kadhem, Athraa & Abdul Wahab, Noor Izzri & Aris, Ishak & Jasni, Jasronita & Abdalla, Ahmed N., 2017. "Computational techniques for assessing the reliability and sustainability of electrical power systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 80(C), pages 1175-1186.
    10. Turati, Pietro & Pedroni, Nicola & Zio, Enrico, 2016. "Advanced RESTART method for the estimation of the probability of failure of highly reliable hybrid dynamic systems," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 117-126.
    11. Futalef, Juan-Pablo & Di Maio, Francesco & Zio, Enrico, 2025. "A dynamic importance function for accidental scenarios generation by RESTART in the computational risk assessment of cyber-physical infrastructures," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    12. H. Cancela & M. Khadiri & G. Rubino, 2012. "A new simulation method based on the RVR principle for the rare event network reliability problem," Annals of Operations Research, Springer, vol. 196(1), pages 111-136, July.
    13. Li, Shunlong & Wang, Jie & He, Shaoyang, 2023. "Connectivity probability evaluation of a large-scale highway bridge network using network decomposition," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    14. Su, Huai & Zio, Enrico & Zhang, Jinjun & Li, Xueyi, 2018. "A systematic framework of vulnerability analysis of a natural gas pipeline network," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 79-91.
    15. Zhou, Xingyuan & van Gelder, P.H.A.J.M. & Liang, Yongtu & Zhang, Haoran, 2020. "An integrated methodology for the supply reliability analysis of multi-product pipeline systems under pumps failure," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    16. Hao Su & Qun Niu & Zhile Yang, 2023. "Optimal Power Flow Using Improved Cross-Entropy Method," Energies, MDPI, vol. 16(14), pages 1-33, July.
    17. Sahar Abbas & Fahimeh Moosavi, 2012. "Finding shortest path in static networks: using a modified algorithm," International Journal of Finance & Banking Studies, Center for the Strategic Studies in Business and Finance, vol. 1(1), pages 29-34, January.
    18. Cadini, F. & Santos, F. & Zio, E., 2014. "An improved adaptive kriging-based importance technique for sampling multiple failure regions of low probability," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 109-117.
    19. Zheng, Xiaoyu & Tamaki, Hitoshi & Sugiyama, Tomoyuki & Maruyama, Yu, 2022. "Dynamic probabilistic risk assessment of nuclear power plants using multi-fidelity simulations," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    20. Dehghani, Nariman L. & Zamanian, Soroush & Shafieezadeh, Abdollah, 2021. "Adaptive network reliability analysis: Methodology and applications to power grid," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005040. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.