IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v360y2024ics0306261924000795.html
   My bibliography  Save this article

A U-net convolutional neural network deep learning model application for identification of energy loss in infrared thermographic images

Author

Listed:
  • Gertsvolf, David
  • Horvat, Miljana
  • Aslam, Danesh
  • Khademi, April
  • Berardi, Umberto

Abstract

The possibility of obtaining large data set of infrared images during building and urban envelope surveys require the development of fast and effective ways to process their content. This study presents a novel U-NET convolution neural network (CNN) deep learning (DL) model for the identification of envelope deficiencies on a data set of infrared (IR) thermographic images of building envelopes. A data set of images acquired with an unmanned aerial vehicle (UAV) were used with supplementary segmentation masks created for appropriate U-NET modelling application. This data preparation process is presented followed by an in-depth review of the CNN architecture used for the segmentation process. The Python3 code developed for this study is simplified for easier application by non-data-science researchers. The results of this research show high accuracy. However, large data set are needed to better train the CNN-DL model.

Suggested Citation

  • Gertsvolf, David & Horvat, Miljana & Aslam, Danesh & Khademi, April & Berardi, Umberto, 2024. "A U-net convolutional neural network deep learning model application for identification of energy loss in infrared thermographic images," Applied Energy, Elsevier, vol. 360(C).
    • Handle: RePEc:eee:appene:v:360:y:2024:i:c:s0306261924000795
    DOI: 10.1016/j.apenergy.2024.122696
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924000795
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.122696?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lee, Won-Yong & House, John M. & Kyong, Nam-Ho, 2004. "Subsystem level fault diagnosis of a building's air-handling unit using general regression neural networks," Applied Energy, Elsevier, vol. 77(2), pages 153-170, February.
    2. Thrampoulidis, Emmanouil & Mavromatidis, Georgios & Lucchi, Aurelien & Orehounig, Kristina, 2021. "A machine learning-based surrogate model to approximate optimal building retrofit solutions," Applied Energy, Elsevier, vol. 281(C).
    3. Fox, Matthew & Coley, David & Goodhew, Steve & de Wilde, Pieter, 2014. "Thermography methodologies for detecting energy related building defects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 40(C), pages 296-310.
    4. Zhao, Yang & Li, Tingting & Zhang, Xuejun & Zhang, Chaobo, 2019. "Artificial intelligence-based fault detection and diagnosis methods for building energy systems: Advantages, challenges and the future," Renewable and Sustainable Energy Reviews, Elsevier, vol. 109(C), pages 85-101.
    5. Mayer, Kevin & Haas, Lukas & Huang, Tianyuan & Bernabé-Moreno, Juan & Rajagopal, Ram & Fischer, Martin, 2023. "Estimating building energy efficiency from street view imagery, aerial imagery, and land surface temperature data," Applied Energy, Elsevier, vol. 333(C).
    6. Berardi, Umberto, 2015. "The development of a monolithic aerogel glazed window for an energy retrofitting project," Applied Energy, Elsevier, vol. 154(C), pages 603-615.
    7. Lucchi, Elena, 2018. "Applications of the infrared thermography in the energy audit of buildings: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 82(P3), pages 3077-3090.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shariq, M. Hasan & Hughes, Ben Richard, 2020. "Revolutionising building inspection techniques to meet large-scale energy demands: A review of the state-of-the-art," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    2. Chen, Jianli & Zhang, Liang & Li, Yanfei & Shi, Yifu & Gao, Xinghua & Hu, Yuqing, 2022. "A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    3. Martin, Miguel & Chong, Adrian & Biljecki, Filip & Miller, Clayton, 2022. "Infrared thermography in the built environment: A multi-scale review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 165(C).
    4. William Nelson & Charles Culp, 2023. "FDD in Building Systems Based on Generalized Machine Learning Approaches," Energies, MDPI, vol. 16(4), pages 1-16, February.
    5. Ren, Haoshan & Xu, Chengliang & Lyu, Yuanli & Ma, Zhenjun & Sun, Yongjun, 2023. "A thermodynamic-law-integrated deep learning method for high-dimensional sensor fault detection in diverse complex HVAC systems," Applied Energy, Elsevier, vol. 351(C).
    6. Zhang, Jian & Zhang, Chaobo & Lu, Jie & Zhao, Yang, 2025. "Domain-specific large language models for fault diagnosis of heating, ventilation, and air conditioning systems by labeled-data-supervised fine-tuning," Applied Energy, Elsevier, vol. 377(PA).
    7. William Nelson & Charles Culp, 2022. "Machine Learning Methods for Automated Fault Detection and Diagnostics in Building Systems—A Review," Energies, MDPI, vol. 15(15), pages 1-20, July.
    8. Sukjoon Oh & Suyeon Ham & Seongjin Lee, 2021. "Drone-Assisted Image Processing Scheme using Frame-Based Location Identification for Crack and Energy Loss Detection in Building Envelopes," Energies, MDPI, vol. 14(19), pages 1-19, October.
    9. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    10. Zhou, Yuekuan & Zheng, Siqian, 2020. "Uncertainty study on thermal and energy performances of a deterministic parameters based optimal aerogel glazing system using machine-learning method," Energy, Elsevier, vol. 193(C).
    11. Zoe Mayer & Julia Heuer & Rebekka Volk & Frank Schultmann, 2021. "Aerial Thermographic Image-Based Assessment of Thermal Bridges Using Representative Classifications and Calculations," Energies, MDPI, vol. 14(21), pages 1-43, November.
    12. Rongjiang Ma & Xianlin Wang & Ming Shan & Nanyang Yu & Shen Yang, 2020. "Recognition of Variable-Speed Equipment in an Air-Conditioning System Using Numerical Analysis of Energy-Consumption Data," Energies, MDPI, vol. 13(18), pages 1-14, September.
    13. Zhao, Qian & Wang, Lu & Stan, Sebastian-Emanuel & Mirza, Nawazish, 2024. "Can artificial intelligence help accelerate the transition to renewable energy?," Energy Economics, Elsevier, vol. 134(C).
    14. Rongjiang Ma & Shen Yang & Xianlin Wang & Xi-Cheng Wang & Ming Shan & Nanyang Yu & Xudong Yang, 2020. "Systematic Method for the Energy-Saving Potential Calculation of Air-Conditioning Systems via Data Mining. Part I: Methodology," Energies, MDPI, vol. 14(1), pages 1-15, December.
    15. Antonio Rosato & Francesco Guarino & Mohammad El Youssef & Alfonso Capozzoli & Massimiliano Masullo & Luigi Maffei, 2022. "Faulty Operation of Coils’ and Humidifier Valves in a Typical Air-Handling Unit: Experimental Impact Assessment of Indoor Comfort and Patterns of Operating Parameters under Mediterranean Climatic Cond," Energies, MDPI, vol. 15(18), pages 1-38, September.
    16. Francesco Braggiotti & Nicola Chiarini & Giulio Dondi & Luciano Lavecchia & Valeria Lionetti & Juri Marcucci & Riccardo Russo, 2024. "Predicting buildings' EPC in Italy: a machine learning based-approach," Questioni di Economia e Finanza (Occasional Papers) 850, Bank of Italy, Economic Research and International Relations Area.
    17. Blanca Tejedor & Eva Barreira & Vasco Peixoto de Freitas & Tomasz Kisilewicz & Katarzyna Nowak-Dzieszko & Umberto Berardi, 2020. "Impact of Stationary and Dynamic Conditions on the U-Value Measurements of Heavy-Multi Leaf Walls by Quantitative IRT," Energies, MDPI, vol. 13(24), pages 1-19, December.
    18. Liang, Xinbin & Liu, Zhuoxuan & Wang, Jie & Jin, Xinqiao & Du, Zhimin, 2023. "Uncertainty quantification-based robust deep learning for building energy systems considering distribution shift problem," Applied Energy, Elsevier, vol. 337(C).
    19. Rasooli, Arash & Itard, Laure, 2019. "In-situ rapid determination of walls’ thermal conductivity, volumetric heat capacity, and thermal resistance, using response factors," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    20. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:360:y:2024:i:c:s0306261924000795. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.