IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v238y2022ipbs0360544221017643.html
   My bibliography  Save this article

VideoGasNet: Deep learning for natural gas methane leak classification using an infrared camera

Author

Listed:
  • Wang, Jingfan
  • Ji, Jingwei
  • Ravikumar, Arvind P.
  • Savarese, Silvio
  • Brandt, Adam R.

Abstract

Mitigating methane leakage from the natural gas system has become an increasing concern for climate change. Efficacious methane leak detection and classification can make mitigation more efficient and cost effective. Optical gas imaging (OGI) is widely used for the purpose of leak detection, but it does not directly provide quantitative detection results and leak sizes. In this study, we consider methane leak size classification as a video classification problem and develop deep learning models to classify the videos by leak volume. Firstly we collected the first methane leak video dataset - GasVid, which has ∼0.7 M frames of labeled videos of methane leaks from different leaking equipment, covering a wide range of leak sizes (5.3–2051.6 gCH4/h) and imaging distances (4.6–15.6 m). Secondly, we studied three deep learning algorithms, including 2D Convolutional Neural Networks (CNN) model, 3D CNN and the Convolutional Long Short Term Memory (ConvLSTM). We find that 3D CNN is the most accurate and robust architecture, and we name it VideoGasNet. The leak/non-leak binary detection accuracy approaches nearly 100%, and the highest small-medium-large classification accuracy is 78.2% with our 3D CNN network. In eight-class classification, accuracy drops to 39.1%, as this is a more challenging task. In summary, VideoGasNet greatly extends the capabilities of IR camera-based leak monitoring system from leak detection only to automated leak classification, and shows high accuracy for binary and three-class classification.

Suggested Citation

  • Wang, Jingfan & Ji, Jingwei & Ravikumar, Arvind P. & Savarese, Silvio & Brandt, Adam R., 2022. "VideoGasNet: Deep learning for natural gas methane leak classification using an infrared camera," Energy, Elsevier, vol. 238(PB).
  • Handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221017643
    DOI: 10.1016/j.energy.2021.121516
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221017643
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2021.121516?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Jingfan & Tchapmi, Lyne P. & Ravikumar, Arvind P. & McGuire, Mike & Bell, Clay S. & Zimmerle, Daniel & Savarese, Silvio & Brandt, Adam R., 2020. "Machine vision for natural gas methane emissions detection using an infrared camera," Applied Energy, Elsevier, vol. 257(C).
    2. Zhang, Xiaochun & Myhrvold, Nathan P. & Hausfather, Zeke & Caldeira, Ken, 2016. "Climate benefits of natural gas as a bridge fuel and potential delay of near-zero energy systems," Applied Energy, Elsevier, vol. 167(C), pages 317-322.
    3. Magnus Gålfalk & Göran Olofsson & Patrick Crill & David Bastviken, 2016. "Making methane visible," Nature Climate Change, Nature, vol. 6(4), pages 426-430, April.
    4. Tom Wigley, 2011. "Coal to gas: the influence of methane leakage," Climatic Change, Springer, vol. 108(3), pages 601-608, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Niu, Wente & Lu, Jialiang & Sun, Yuping & Zhang, Xiaowei & Li, Qiaojing & Cao, Xu & Liang, Pingping & Zhan, Hongming, 2024. "Techno-economic integration evaluation in shale gas development based on ensemble learning," Applied Energy, Elsevier, vol. 357(C).
    2. Dai Geng & Di Wang & Yushuang Li & Wei Zhou & Hanbing Qi, 2023. "Detection Stability Improvement of Near-Infrared Laser Telemetry for Methane Emission from Oil/Gas Station Using a Catadioptric Optical Receiver," Energies, MDPI, vol. 16(9), pages 1-16, April.
    3. Bi, Yubo & Wu, Qiulan & Wang, Shilu & Shi, Jihao & Cong, Haiyong & Ye, Lili & Gao, Wei & Bi, Mingshu, 2023. "Hydrogen leakage location prediction at hydrogen refueling stations based on deep learning," Energy, Elsevier, vol. 284(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Jingfan & Tchapmi, Lyne P. & Ravikumar, Arvind P. & McGuire, Mike & Bell, Clay S. & Zimmerle, Daniel & Savarese, Silvio & Brandt, Adam R., 2020. "Machine vision for natural gas methane emissions detection using an infrared camera," Applied Energy, Elsevier, vol. 257(C).
    2. Titchener, James & Millington-Smith, Doug & Goldsack, Chris & Harrison, George & Dunning, Alexander & Ai, Xiao & Reed, Murray, 2022. "Single photon Lidar gas imagers for practical and widespread continuous methane monitoring," Applied Energy, Elsevier, vol. 306(PB).
    3. Jeffrey C. Peters & Thomas W. Hertel, 2017. "Achieving the Clean Power Plan 2030 CO2 Target with the New Normal in Natural Gas Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 5).
    4. Lueken, Roger & Klima, Kelly & Griffin, W. Michael & Apt, Jay, 2016. "The climate and health effects of a USA switch from coal to gas electricity generation," Energy, Elsevier, vol. 109(C), pages 1160-1166.
    5. Dr Barry Naughten, 2013. "Emissions Pricing, 'Complementary Policies' and 'Direct Action' in the Australian Electricity Supply Sector: 'Lock-in' and Investment," CCEP Working Papers 1304, Centre for Climate & Energy Policy, Crawford School of Public Policy, The Australian National University.
    6. Jaszczur, Marek & Hassan, Qusay & Palej, Patryk & Abdulateef, Jasim, 2020. "Multi-Objective optimisation of a micro-grid hybrid power system for household application," Energy, Elsevier, vol. 202(C).
    7. Solomon Hsiang & Robert E. Kopp, 2018. "An Economist's Guide to Climate Change Science," Journal of Economic Perspectives, American Economic Association, vol. 32(4), pages 3-32, Fall.
    8. Makena Coffman & Paul Bernstein & Sherilyn Wee & Clarice Schafer, 2014. "An Economic and GHG Analysis of LNG in Hawaii," Working Papers 2014-10, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    9. Kemfert, Claudia & Präger, Fabian & Braunger, Isabell & Hoffart, Franziska M. & Brauers, Hanna, 2022. "The expansion of natural gas infrastructure puts energy transitions at risk," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 7, pages 582-587.
    10. Kis, Zoltán & Pandya, Nikul & Koppelaar, Rembrandt H.E.M., 2018. "Electricity generation technologies: Comparison of materials use, energy return on investment, jobs creation and CO2 emissions reduction," Energy Policy, Elsevier, vol. 120(C), pages 144-157.
    11. Liu, Liuchen & Zhu, Tong & Pan, Yu & Wang, Hai, 2017. "Multiple energy complementation based on distributed energy systems – Case study of Chongming county, China," Applied Energy, Elsevier, vol. 192(C), pages 329-336.
    12. Umeozor, Evar C. & Jordaan, Sarah M. & Gates, Ian D., 2018. "On methane emissions from shale gas development," Energy, Elsevier, vol. 152(C), pages 594-600.
    13. Morgan R. Edwards & Jessika E. Trancik, 2022. "Consequences of equivalency metric design for energy transitions and climate change," Climatic Change, Springer, vol. 175(1), pages 1-27, November.
    14. Jennifer A. Caldwell & Christopher K. Williams & Margaret C. Brittingham & Thomas J. Maier, 2022. "A Consideration of Wildlife in the Benefit-Costs of Hydraulic Fracturing: Expanding to an E3 Analysis," Sustainability, MDPI, vol. 14(8), pages 1-17, April.
    15. Olfati, Mohammad & Bahiraei, Mehdi & Veysi, Farzad, 2019. "A novel modification on preheating process of natural gas in pressure reduction stations to improve energy consumption, exergy destruction and CO2 emission: Preheating based on real demand," Energy, Elsevier, vol. 173(C), pages 598-609.
    16. Guanglin Pi & Xiucheng Dong & Cong Dong & Jie Guo & Zhengwei Ma, 2015. "The Status, Obstacles and Policy Recommendations of Shale Gas Development in China," Sustainability, MDPI, vol. 7(3), pages 1-20, February.
    17. Zeng, Jingjing & Bao, Rui & McFarland, Michael, 2022. "Clean energy substitution: The effect of transitioning from coal to gas on air pollution," Energy Economics, Elsevier, vol. 107(C).
    18. Jenner, Steffen & Lamadrid, Alberto J., 2013. "Shale gas vs. coal: Policy implications from environmental impact comparisons of shale gas, conventional gas, and coal on air, water, and land in the United States," Energy Policy, Elsevier, vol. 53(C), pages 442-453.
    19. Valadkhani, Abbas & Nguyen, Jeremy & Bowden, Mark, 2019. "Pathways to reduce CO2 emissions as countries proceed through stages of economic development," Energy Policy, Elsevier, vol. 129(C), pages 268-278.
    20. Abbasi, Tasneem & Tauseef, S.M. & Abbasi, S.A., 2012. "Anaerobic digestion for global warming control and energy generation—An overview," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(5), pages 3228-3242.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221017643. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.