IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v254y2025ipas0951832024006252.html
   My bibliography  Save this article

Machine learning-based outlier detection for pipeline in-line inspection data

Author

Listed:
  • Hussain, Muhammad
  • Zhang, Tieling

Abstract

Pipeline companies are facing challenges in maintaining the integrity and reliability of their pipelines. They are working towards predictive maintenance using machine learning-based approaches to predicting anomalies. Training machine learning models requires sufficient data. Data quality is therefore becoming important because inaccurate data will lead to an inaccurate or wrong decision on pipeline condition assessment and the following management. This research paper intends to address the data quality issues of pipeline inspection data such as in-line inspection (ILI) data using machine learning models. Different machine learning models developed by random forest regression, linear regression, and nearest neighbors’ methods were tested to detect outliers in the ILI data. In this paper, the ILI data collected from an oil pipeline over a period of 22 years was applied to testing and analysis. To verify the outlier detection results of machine learning models, we used statistical analysis including Z-score method to check and find if there are any gaps in the analysis. It verifies that all these methods show almost the same or very similar results for the detection of the outliers. Hence, this study presents a robust method for the field applications in the pipeline industry.

Suggested Citation

  • Hussain, Muhammad & Zhang, Tieling, 2025. "Machine learning-based outlier detection for pipeline in-line inspection data," Reliability Engineering and System Safety, Elsevier, vol. 254(PA).
  • Handle: RePEc:eee:reensy:v:254:y:2025:i:pa:s0951832024006252
    DOI: 10.1016/j.ress.2024.110553
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024006252
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110553?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Berke Ogulcan Parlak & Huseyin Ayhan Yavasoglu, 2023. "A Comprehensive Analysis of In-Line Inspection Tools and Technologies for Steel Oil and Gas Pipelines," Sustainability, MDPI, vol. 15(3), pages 1-25, February.
    2. Wei, Ning & Lu, Zhenzhou & Hu, Yingshi, 2023. "Stochastic collocation enhanced line sampling method for reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 240(C).
    3. Li, Qilin & Wang, Yang & Chen, Wensu & Li, Ling & Hao, Hong, 2024. "Machine learning prediction of BLEVE loading with graph neural networks," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    4. Hassan, Shamsu & Wang, Jin & Kontovas, Christos & Bashir, Musa, 2022. "An assessment of causes and failure likelihood of cross-country pipelines under uncertainty using bayesian networks," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    5. Xie, Mingjiang & Wang, Yifei & Zhao, Jianli & Pei, Xianjun & Zhang, Tairui, 2024. "Prediction of pipeline fatigue crack propagation under rockfall impact based on multilayer perceptron," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    6. Rimkevicius, Sigitas & Kaliatka, Algirdas & Valincius, Mindaugas & Dundulis, Gintautas & Janulionis, Remigijus & Grybenas, Albertas & Zutautaite, Inga, 2012. "Development of approach for reliability assessment of pipeline network systems," Applied Energy, Elsevier, vol. 94(C), pages 22-33.
    7. Yazdi, Mohammad & Khan, Faisal & Abbassi, Rouzbeh & Quddus, Noor & Castaneda-Lopez, Homero, 2022. "A review of risk-based decision-making models for microbiologically influenced corrosion (MIC) in offshore pipelines," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    8. Li, Pengyu & Wang, Xiufang & Jiang, Chunlei & Bi, Hongbo & Liu, Yongzhi & Yan, Wendi & Zhang, Cong & Dong, Taiji & Sun, Yu, 2024. "Advanced transformer model for simultaneous leakage aperture recognition and localization in gas pipelines," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    9. Homam Nikpey Somehsaraei & Susmita Ghosh & Sayantan Maity & Payel Pramanik & Sudipta De & Mohsen Assadi, 2020. "Automated Data Filtering Approach for ANN Modeling of Distributed Energy Systems: Exploring the Application of Machine Learning," Energies, MDPI, vol. 13(14), pages 1-15, July.
    10. Dann, Markus R. & Dann, Christoph, 2017. "Automated matching of pipeline corrosion features from in-line inspection data," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 40-50.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tan, Qiong & Fu, Ming & Wang, Zhengxing & Yuan, Hongyong & Sun, Jinhua, 2024. "A real-time early warning classification method for natural gas leakage based on random forest," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    2. Zhang, Xiaolei & Hu, Longhua & Delichatsios, Michael A. & Zhang, Jianping, 2019. "Experimental study on flame morphologic characteristics of wall attached non-premixed buoyancy driven turbulent flames," Applied Energy, Elsevier, vol. 254(C).
    3. Xuejie Li & Yuan Xue & Yuxing Li & Qingshan Feng, 2022. "An Optimization Method for a Compressor Standby Scheme Based on Reliability Analysis," Energies, MDPI, vol. 15(21), pages 1-16, November.
    4. Talha Ahmed & Yasir Mahmood & Nita Yodo & Ying Huang, 2024. "Weather-Related Combined Effect on Failure Propagation and Maintenance Procedures towards Sustainable Gas Pipeline Infrastructure," Sustainability, MDPI, vol. 16(13), pages 1-30, July.
    5. Badami, Marco & Fonti, Antonio & Carpignano, Andrea & Grosso, Daniele, 2018. "Design of district heating networks through an integrated thermo-fluid dynamics and reliability modelling approach," Energy, Elsevier, vol. 144(C), pages 826-838.
    6. ValinÄ ius, Mindaugas & ŽutautaitÄ—, Inga & Dundulis, Gintautas & RimkeviÄ ius, Sigitas & Janulionis, Remigijus & Bakas, Rimantas, 2015. "Integrated assessment of failure probability of the district heating network," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 314-322.
    7. Shi, Jihao & Li, Junjie & Zhang, Haoran & Xie, Bin & Xie, Zonghao & Yu, Qing & Yan, Jinyue, 2025. "Real-time gas explosion prediction at urban scale by GIS and graph neural network," Applied Energy, Elsevier, vol. 377(PC).
    8. Song, Houde & Liu, Xiaojing & Song, Meiqi, 2023. "Comparative study of data-driven and model-driven approaches in prediction of nuclear power plants operating parameters," Applied Energy, Elsevier, vol. 341(C).
    9. Postnikov, Ivan & Stennikov, Valery & Mednikova, Ekaterina & Penkovskii, Andrey, 2018. "Methodology for optimization of component reliability of heat supply systems," Applied Energy, Elsevier, vol. 227(C), pages 365-374.
    10. Amaya-Gómez, Rafael & Schoefs, Franck & Sánchez-Silva, Mauricio & Muñoz, Felipe & Bastidas-Arteaga, Emilio, 2022. "Matching of corroded defects in onshore pipelines based on In-Line Inspections and Voronoi partitions," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    11. Su, Qingyu & Chen, Cong & Huang, Xin & Li, Jian, 2022. "Interval TrendRank method for grid node importance assessment considering new energy," Applied Energy, Elsevier, vol. 324(C).
    12. Seyed Mohammad Asadzadeh & Hadi Maleki & Mehrab Tanhaeean, 2020. "A resilience engineering-based approach to improving service reliability in maintenance organizations," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 11(5), pages 909-922, October.
    13. Sun, Bin & Li, Yan & Zhang, Yangyang & Guo, Tong, 2024. "Multi-source heterogeneous data fusion prediction technique for the utility tunnel fire detection," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    14. Shan, Xiaofang & Wang, Peng & Lu, Weizhen, 2017. "The reliability and availability evaluation of repairable district heating networks under changeable external conditions," Applied Energy, Elsevier, vol. 203(C), pages 686-695.
    15. Hui Zhou & Zesen Gui & Jiang Zhang & Qun Zhou & Xueshan Liu & Xiaoyang Ma, 2021. "A Quantification Method for Supraharmonic Emissions Based on Outlier Detection Algorithms," Energies, MDPI, vol. 14(19), pages 1-18, October.
    16. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zio, Enrico & Yuan, Chengwei & Wang, Taorui & Jiang, Jianjun, 2022. "A Bayesian belief network framework for nuclear power plant human reliability analysis accounting for dependencies among performance shaping factors," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    17. Cabrales, Sergio & Valencia, Carlos & Ramírez, Carlos & Ramírez, Andrés & Herrera, Juan & Cadena, Angela, 2022. "Stochastic cost-benefit analysis to assess new infrastructure to improve the reliability of the natural gas supply," Energy, Elsevier, vol. 246(C).
    18. Mortensen, Lasse Kappel & Shaker, Hamid Reza & Veje, Christian T., 2022. "Relative fault vulnerability prediction for energy distribution networks," Applied Energy, Elsevier, vol. 322(C).
    19. Dao, Uyen & Sajid, Zaman & Khan, Faisal & Zhang, Yahui, 2023. "Dynamic Bayesian network model to study under-deposit corrosion," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    20. Babiarz, Bożena & Blokus, Agnieszka, 2020. "Dependency of technological lines in reliability analysis of heat production," Energy, Elsevier, vol. 211(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:254:y:2025:i:pa:s0951832024006252. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.