IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v186y2019icp24-36.html
   My bibliography  Save this article

Comparison of automatic and guided learning for Bayesian networks to analyse pipe failures in the water distribution system

Author

Listed:
  • Tang, Kayu
  • Parsons, David J.
  • Jude, Simon

Abstract

The reliability of the water distribution system is critical to maintaining a secure supply for the population, industry and agriculture, so there is a need for proactive maintenance to help reduce water loss and down times. Bayesian networks are one approach to modelling the complexity of water mains, to assist water utility companies in planning maintenance. This paper compares and analyses how accurately the Bayesian network structure can be derived given a large and highly variable dataset. Method one involved using automated learning algorithms to build the Bayesian network, while method two involved a guided method using a combination of historic failure data, prior knowledge and pre-modelling data exploration of the water mains. By understanding common failure types (circumferential, longitudinal, pinhole and joint), the guided learning Bayesian Network was able to capture the interactions of the surrounding soil environment with the physical properties of pipes. The Bayesian network built using data exploration and literature was able to achieve an overall accuracy of 81.2% when predicting the specific type of water mains failure compared to the 84.4% for the automated method. The slightly greater accuracy from the automated method was traded for a sparser Bayes net where the interpretation of the interactions between the variables was clearer and more meaningful.

Suggested Citation

  • Tang, Kayu & Parsons, David J. & Jude, Simon, 2019. "Comparison of automatic and guided learning for Bayesian networks to analyse pipe failures in the water distribution system," Reliability Engineering and System Safety, Elsevier, vol. 186(C), pages 24-36.
    • Handle: RePEc:eee:reensy:v:186:y:2019:i:c:p:24-36
    DOI: 10.1016/j.ress.2019.02.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832017309377
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2019.02.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kabir, Golam & Tesfamariam, Solomon & Sadiq, Rehan, 2015. "Predicting water main failures using Bayesian model averaging and survival modelling approach," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 498-514.
    2. Scutari, Marco, 2010. "Learning Bayesian Networks with the bnlearn R Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 35(i03).
    3. Francis, Royce A. & Guikema, Seth D. & Henneman, Lucas, 2014. "Bayesian Belief Networks for predicting drinking water distribution system pipe breaks," Reliability Engineering and System Safety, Elsevier, vol. 130(C), pages 1-11.
    4. Kuhn, Max, 2008. "Building Predictive Models in R Using the caret Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i05).
    5. M. Islam & Rehan Sadiq & Manuel Rodriguez & Homayoun Najjaran & Alex Francisque & Mina Hoorfar, 2013. "Evaluating Water Quality Failure Potential in Water Distribution Systems: A Fuzzy-TOPSIS-OWA-based Methodology," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 27(7), pages 2195-2216, May.
    6. Mingfeng Lin & Henry C. Lucas & Galit Shmueli, 2013. "Research Commentary ---Too Big to Fail: Large Samples and the p -Value Problem," Information Systems Research, INFORMS, vol. 24(4), pages 906-917, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jia, Rui & Du, Kun & Song, Zhigang & Xu, Wei & Zheng, Feifei, 2024. "Scenario reduction-based simulation method for efficient serviceability assessment of earthquake-damaged water distribution systems," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    2. Li, Xiaoyue & Yang, Yinfei & Li, Liang & Zhao, Guolong & He, Ning, 2020. "Uncertainty quantification in machining deformation based on Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    3. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    4. Fan, Xudong & Wang, Xiaowei & Zhang, Xijin & ASCE Xiong (Bill) Yu, P.E.F., 2022. "Machine learning based water pipe failure prediction: The effects of engineering, geology, climate and socio-economic factors," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    5. Dawid Szpak, 2020. "Method for Determining the Probability of a Lack of Water Supply to Consumers," Energies, MDPI, vol. 13(20), pages 1-16, October.
    6. Wu, Jiansong & Bai, Yiping & Fang, Weipeng & Zhou, Rui & Reniers, Genserik & Khakzad, Nima, 2021. "An Integrated Quantitative Risk Assessment Method for Urban Underground Utility Tunnels," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    7. Robles-Velasco, Alicia & Cortés, Pablo & Muñuzuri, Jesús & Onieva, Luis, 2020. "Prediction of pipe failures in water supply networks using logistic regression and support vector classification," Reliability Engineering and System Safety, Elsevier, vol. 196(C).
    8. Zhang, Qiongfang & Xu, Nan & Ersoy, Daniel & Liu, Yongming, 2022. "Manifold-based Conditional Bayesian network for aging pipe yield strength estimation with non-destructive measurements," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    9. Rifaai, Talha M. & Abokifa, Ahmed A. & Sela, Lina, 2022. "Integrated approach for pipe failure prediction and condition scoring in water infrastructure systems," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    10. Wei Liu & Binhao Wang & Zhaoyang Song, 2022. "Failure Prediction of Municipal Water Pipes Using Machine Learning Algorithms," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(4), pages 1271-1285, March.
    11. Wang, Run-Zi & Gu, Hang-Hang & Zhu, Shun-Peng & Li, Kai-Shang & Wang, Ji & Wang, Xiao-Wei & Hideo, Miura & Zhang, Xian-Cheng & Tu, Shan-Tung, 2022. "A data-driven roadmap for creep-fatigue reliability assessment and its implementation in low-pressure turbine disk at elevated temperatures," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    12. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    13. Yaser Amiri-Ardakani & Mohammad Najafzadeh, 2021. "Pipe Break Rate Assessment While Considering Physical and Operational Factors: A Methodology based on Global Positioning System and Data-Driven Techniques," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(11), pages 3703-3720, September.
    14. Yaxin Shi & Suning Liu & Haiyun Shi, 2022. "Analysis of the Water-Food-Energy Nexus and Water Competition Based on a Bayesian Network," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(9), pages 3349-3366, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Prabal Das & D. A. Sachindra & Kironmala Chanda, 2022. "Machine Learning-Based Rainfall Forecasting with Multiple Non-Linear Feature Selection Algorithms," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(15), pages 6043-6071, December.
    2. Robles-Velasco, Alicia & Cortés, Pablo & Muñuzuri, Jesús & Onieva, Luis, 2020. "Prediction of pipe failures in water supply networks using logistic regression and support vector classification," Reliability Engineering and System Safety, Elsevier, vol. 196(C).
    3. Yu, Jin-Zhu & Whitman, Mackenzie & Kermanshah, Amirhassan & Baroud, Hiba, 2021. "A hierarchical Bayesian approach for assessing infrastructure networks serviceability under uncertainty: A case study of water distribution systems," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    4. Hsin-Han Chen & Hui-Ling Chen & Yi-Tien Lin & Chaou-Wen Lin & Chien-Chang Ho & Hsueh-Yi Lin & Po-Fu Lee, 2020. "The Associations between Functional Fitness Test Performance and Abdominal Obesity in Healthy Elderly People: Results from the National Physical Fitness Examination Survey in Taiwan," IJERPH, MDPI, vol. 18(1), pages 1-14, December.
    5. Jie Zhao & Ji Chen & Damien Beillouin & Hans Lambers & Yadong Yang & Pete Smith & Zhaohai Zeng & Jørgen E. Olesen & Huadong Zang, 2022. "Global systematic review with meta-analysis reveals yield advantage of legume-based rotations and its drivers," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    6. Piaopiao Chen & Agnès H. Michel & Jianzhi Zhang, 2022. "Transposon insertional mutagenesis of diverse yeast strains suggests coordinated gene essentiality polymorphisms," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    7. Paulo Infante & Gonçalo Jacinto & Anabela Afonso & Leonor Rego & Pedro Nogueira & Marcelo Silva & Vitor Nogueira & José Saias & Paulo Quaresma & Daniel Santos & Patrícia Góis & Paulo Rebelo Manuel, 2023. "Factors That Influence the Type of Road Traffic Accidents: A Case Study in a District of Portugal," Sustainability, MDPI, vol. 15(3), pages 1-16, January.
    8. Vuong, Quan-Hoang & La, Viet-Phuong, 2019. "The bayesvl R package. User guide v0.8.1," OSF Preprints w5dx6, Center for Open Science.
    9. Thomas Görzen, 2019. "Can Experience be Trusted? Investigating the Effect of Experience on Decision Biases in Crowdworking Platforms," Working Papers Dissertations 55, Paderborn University, Faculty of Business Administration and Economics.
    10. Ephrem Habyarimana & Faheem S Baloch, 2021. "Machine learning models based on remote and proximal sensing as potential methods for in-season biomass yields prediction in commercial sorghum fields," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-23, March.
    11. Banks, Jonathan & Rabbani, Arif & Nadkarni, Kabir & Renaud, Evan, 2020. "Estimating parasitic loads related to brine production from a hot sedimentary aquifer geothermal project: A case study from the Clarke Lake gas field, British Columbia," Renewable Energy, Elsevier, vol. 153(C), pages 539-552.
    12. F. Cugnata & G. Perucca & S. Salini, 2017. "Bayesian networks and the assessment of universities' value added," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(10), pages 1785-1806, July.
    13. Yi Yang & Kunpeng Zhang & Yangyang Fan, 2023. "sDTM: A Supervised Bayesian Deep Topic Model for Text Analytics," Information Systems Research, INFORMS, vol. 34(1), pages 137-156, March.
    14. Evangelista, Rui & Ramalho, Esmeralda A. & Andrade e Silva, João, 2020. "On the use of hedonic regression models to measure the effect of energy efficiency on residential property transaction prices: Evidence for Portugal and selected data issues," Energy Economics, Elsevier, vol. 86(C).
    15. Crespo, Cristian, 2020. "Two become one: improving the targeting of conditional cash transfers with a predictive model of school dropout," LSE Research Online Documents on Economics 123139, London School of Economics and Political Science, LSE Library.
    16. Yen-Chun Chou & Howard Hao-Chun Chuang, 2018. "A predictive investigation of first-time customer retention in online reservation services," Service Business, Springer;Pan-Pacific Business Association, vol. 12(4), pages 685-699, December.
    17. Zheng Tang & Yijia Li & Xiaofeng Hu & Huanggang Wu, 2019. "Risk Analysis of Urban Dirty Bomb Attacking Based on Bayesian Network," Sustainability, MDPI, vol. 11(2), pages 1-12, January.
    18. Roland R. Ramsahai, 2020. "Connecting actuarial judgment to probabilistic learning techniques with graph theory," Papers 2007.15475, arXiv.org.
    19. Alexander Wettstein & Gabriel Jenni & Ida Schneider & Fabienne Kühne & Martin grosse Holtforth & Roberto La Marca, 2023. "Predictors of Psychological Strain and Allostatic Load in Teachers: Examining the Long-Term Effects of Biopsychosocial Risk and Protective Factors Using a LASSO Regression Approach," IJERPH, MDPI, vol. 20(10), pages 1-20, May.
    20. Sujin Park & Ali Tafti & Galit Shmueli, 2024. "Transporting Causal Effects Across Populations Using Structural Causal Modeling: An Illustration to Work-from-Home Productivity," Information Systems Research, INFORMS, vol. 35(2), pages 686-705, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:186:y:2019:i:c:p:24-36. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.