IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v254y2025ipas0951832024006252.html
   My bibliography  Save this article

Machine learning-based outlier detection for pipeline in-line inspection data

Author

Listed:
  • Hussain, Muhammad
  • Zhang, Tieling

Abstract

Pipeline companies are facing challenges in maintaining the integrity and reliability of their pipelines. They are working towards predictive maintenance using machine learning-based approaches to predicting anomalies. Training machine learning models requires sufficient data. Data quality is therefore becoming important because inaccurate data will lead to an inaccurate or wrong decision on pipeline condition assessment and the following management. This research paper intends to address the data quality issues of pipeline inspection data such as in-line inspection (ILI) data using machine learning models. Different machine learning models developed by random forest regression, linear regression, and nearest neighbors’ methods were tested to detect outliers in the ILI data. In this paper, the ILI data collected from an oil pipeline over a period of 22 years was applied to testing and analysis. To verify the outlier detection results of machine learning models, we used statistical analysis including Z-score method to check and find if there are any gaps in the analysis. It verifies that all these methods show almost the same or very similar results for the detection of the outliers. Hence, this study presents a robust method for the field applications in the pipeline industry.

Suggested Citation

  • Hussain, Muhammad & Zhang, Tieling, 2025. "Machine learning-based outlier detection for pipeline in-line inspection data," Reliability Engineering and System Safety, Elsevier, vol. 254(PA).
  • Handle: RePEc:eee:reensy:v:254:y:2025:i:pa:s0951832024006252
    DOI: 10.1016/j.ress.2024.110553
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024006252
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110553?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yazdi, Mohammad & Khan, Faisal & Abbassi, Rouzbeh & Quddus, Noor & Castaneda-Lopez, Homero, 2022. "A review of risk-based decision-making models for microbiologically influenced corrosion (MIC) in offshore pipelines," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    2. Berke Ogulcan Parlak & Huseyin Ayhan Yavasoglu, 2023. "A Comprehensive Analysis of In-Line Inspection Tools and Technologies for Steel Oil and Gas Pipelines," Sustainability, MDPI, vol. 15(3), pages 1-25, February.
    3. Li, Pengyu & Wang, Xiufang & Jiang, Chunlei & Bi, Hongbo & Liu, Yongzhi & Yan, Wendi & Zhang, Cong & Dong, Taiji & Sun, Yu, 2024. "Advanced transformer model for simultaneous leakage aperture recognition and localization in gas pipelines," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    4. Wei, Ning & Lu, Zhenzhou & Hu, Yingshi, 2023. "Stochastic collocation enhanced line sampling method for reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 240(C).
    5. Li, Qilin & Wang, Yang & Chen, Wensu & Li, Ling & Hao, Hong, 2024. "Machine learning prediction of BLEVE loading with graph neural networks," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    6. Hassan, Shamsu & Wang, Jin & Kontovas, Christos & Bashir, Musa, 2022. "An assessment of causes and failure likelihood of cross-country pipelines under uncertainty using bayesian networks," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    7. Xie, Mingjiang & Wang, Yifei & Zhao, Jianli & Pei, Xianjun & Zhang, Tairui, 2024. "Prediction of pipeline fatigue crack propagation under rockfall impact based on multilayer perceptron," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    8. Homam Nikpey Somehsaraei & Susmita Ghosh & Sayantan Maity & Payel Pramanik & Sudipta De & Mohsen Assadi, 2020. "Automated Data Filtering Approach for ANN Modeling of Distributed Energy Systems: Exploring the Application of Machine Learning," Energies, MDPI, vol. 13(14), pages 1-15, July.
    9. Dann, Markus R. & Dann, Christoph, 2017. "Automated matching of pipeline corrosion features from in-line inspection data," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 40-50.
    10. Rimkevicius, Sigitas & Kaliatka, Algirdas & Valincius, Mindaugas & Dundulis, Gintautas & Janulionis, Remigijus & Grybenas, Albertas & Zutautaite, Inga, 2012. "Development of approach for reliability assessment of pipeline network systems," Applied Energy, Elsevier, vol. 94(C), pages 22-33.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tan, Qiong & Fu, Ming & Wang, Zhengxing & Yuan, Hongyong & Sun, Jinhua, 2024. "A real-time early warning classification method for natural gas leakage based on random forest," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    2. Zhang, Xiaolei & Hu, Longhua & Delichatsios, Michael A. & Zhang, Jianping, 2019. "Experimental study on flame morphologic characteristics of wall attached non-premixed buoyancy driven turbulent flames," Applied Energy, Elsevier, vol. 254(C).
    3. Xuejie Li & Yuan Xue & Yuxing Li & Qingshan Feng, 2022. "An Optimization Method for a Compressor Standby Scheme Based on Reliability Analysis," Energies, MDPI, vol. 15(21), pages 1-16, November.
    4. Badami, Marco & Fonti, Antonio & Carpignano, Andrea & Grosso, Daniele, 2018. "Design of district heating networks through an integrated thermo-fluid dynamics and reliability modelling approach," Energy, Elsevier, vol. 144(C), pages 826-838.
    5. Shi, Jihao & Li, Junjie & Zhang, Haoran & Xie, Bin & Xie, Zonghao & Yu, Qing & Yan, Jinyue, 2025. "Real-time gas explosion prediction at urban scale by GIS and graph neural network," Applied Energy, Elsevier, vol. 377(PC).
    6. Amaya-Gómez, Rafael & Schoefs, Franck & Sánchez-Silva, Mauricio & Muñoz, Felipe & Bastidas-Arteaga, Emilio, 2022. "Matching of corroded defects in onshore pipelines based on In-Line Inspections and Voronoi partitions," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    7. Shan, Xiaofang & Wang, Peng & Lu, Weizhen, 2017. "The reliability and availability evaluation of repairable district heating networks under changeable external conditions," Applied Energy, Elsevier, vol. 203(C), pages 686-695.
    8. Hui Zhou & Zesen Gui & Jiang Zhang & Qun Zhou & Xueshan Liu & Xiaoyang Ma, 2021. "A Quantification Method for Supraharmonic Emissions Based on Outlier Detection Algorithms," Energies, MDPI, vol. 14(19), pages 1-18, October.
    9. Babiarz, Bożena & Blokus, Agnieszka, 2020. "Dependency of technological lines in reliability analysis of heat production," Energy, Elsevier, vol. 211(C).
    10. Seyed Mohammad Asadzadeh & Hadi Maleki & Mehrab Tanhaeean, 0. "A resilience engineering-based approach to improving service reliability in maintenance organizations," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 0, pages 1-14.
    11. Ji, Ziguang & Chen, Yi & Ma, Xiaobing & Cai, Yikun & Yang, Li, 2024. "Hierarchical condition-based maintenance planning for corrosion process considering natural environmental impact," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    12. Su, Huai & Zhang, Jinjun & Zio, Enrico & Yang, Nan & Li, Xueyi & Zhang, Zongjie, 2018. "An integrated systemic method for supply reliability assessment of natural gas pipeline networks," Applied Energy, Elsevier, vol. 209(C), pages 489-501.
    13. He, Guoxi & Li, Yansong & Huang, Yuanjie & Sun, Liying & Liao, Kexi, 2019. "A framework of smart pipeline system and its application on multiproduct pipeline leakage handling," Energy, Elsevier, vol. 188(C).
    14. Mohd Fadly Hisham Ismail & Zazilah May & Vijanth Sagayan Asirvadam & Nazrul Anuar Nayan, 2023. "Machine-Learning-Based Classification for Pipeline Corrosion with Monte Carlo Probabilistic Analysis," Energies, MDPI, vol. 16(8), pages 1-13, April.
    15. Liu, Kai & Wang, Ming & Zhu, Weihua & Wu, Jinshan & Yan, Xiaoyong, 2018. "Vulnerability analysis of an urban gas pipeline network considering pipeline-road dependency," International Journal of Critical Infrastructure Protection, Elsevier, vol. 23(C), pages 79-89.
    16. Wang, Mengmeng & Incecik, Atilla & Feng, Shizhe & Gupta, M.K. & Królczyk, Grzegorz & Li, Z, 2023. "Damage identification of offshore jacket platforms in a digital twin framework considering optimal sensor placement," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    17. Fu, Xueqian & Zhang, Xiurong & Qiao, Zheng & Li, Gengyin, 2019. "Estimating the failure probability in an integrated energy system considering correlations among failure patterns," Energy, Elsevier, vol. 178(C), pages 656-666.
    18. Martí de Castro-Cros & Manel Velasco & Cecilio Angulo, 2021. "Machine-Learning-Based Condition Assessment of Gas Turbines—A Review," Energies, MDPI, vol. 14(24), pages 1-27, December.
    19. Mohsin, R. & Majid, Z.A. & Yusof, M.Z., 2014. "Safety distance between underground natural gas and water pipeline facilities," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 53-60.
    20. Elidolu, Gizem & Sezer, Sukru Ilke & Akyuz, Emre & Arslan, Ozcan & Arslanoglu, Yasin, 2023. "Operational risk assessment of ballasting and de-ballasting on-board tanker ship under FMECA extended Evidential Reasoning (ER) and Rule-based Bayesian Network (RBN) approach," Reliability Engineering and System Safety, Elsevier, vol. 231(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:254:y:2025:i:pa:s0951832024006252. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.