IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v193y2022icp941-962.html
   My bibliography  Save this article

A multi-stage model based on YOLOv3 for defect detection in PV panels based on IR and visible imaging by unmanned aerial vehicle

Author

Listed:
  • Di Tommaso, Antonio
  • Betti, Alessandro
  • Fontanelli, Giacomo
  • Michelozzi, Benedetto

Abstract

As solar capacity installed worldwide continues to grow, there is an increasing awareness that advanced inspection systems are becoming of utmost importance to schedule smart interventions and minimize downtime likelihood. In this work we propose a novel automatic multi-stage model to detect panel defects on aerial images captured by unmanned aerial vehicle by using the YOLOv3 network and Computer Vision techniques. The model combines detections of panels and defects to refine its accuracy and exhibits an average inference time per image of 0.98 s. The main novelties are represented by its versatility to process either thermographic or visible images and detect a large variety of defects, to prescript recommended actions to O&M crew to give a more efficient data-driven maintenance strategy and its portability to both rooftop and ground-mounted PV systems and different panel types. The proposed model has been validated on two big PV plants in the south of Italy with an outstanding AP@0.5 exceeding 98% for panel detection, a remarkable AP@0.4 (AP@0.5) of roughly 88.3% (66.9%) for hotspots by means of infrared termography and a mAP@0.5 of almost 70% in the visible spectrum for detection of anomalies including panel shading induced by soiling and bird dropping, delamination, presence of puddles and raised rooftop panels. The model predicts also the severity of hotspot areas based on the estimated temperature gradients, as well as it computes the soiling coverage based on visual images. Finally an analysis of the influence of the different YOLOv3's output scales on the detection is discussed.

Suggested Citation

  • Di Tommaso, Antonio & Betti, Alessandro & Fontanelli, Giacomo & Michelozzi, Benedetto, 2022. "A multi-stage model based on YOLOv3 for defect detection in PV panels based on IR and visible imaging by unmanned aerial vehicle," Renewable Energy, Elsevier, vol. 193(C), pages 941-962.
    • Handle: RePEc:eee:renene:v:193:y:2022:i:c:p:941-962
    DOI: 10.1016/j.renene.2022.04.046
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122005079
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2022.04.046?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Roberto Pierdicca & Marina Paolanti & Andrea Felicetti & Fabio Piccinini & Primo Zingaretti, 2020. "Automatic Faults Detection of Photovoltaic Farms: solAIr, a Deep Learning-Based System for Thermal Images," Energies, MDPI, vol. 13(24), pages 1-17, December.
    2. Chandel, S.S. & Nagaraju Naik, M. & Sharma, Vikrant & Chandel, Rahul, 2015. "Degradation analysis of 28 year field exposed mono-c-Si photovoltaic modules of a direct coupled solar water pumping system in western Himalayan region of India," Renewable Energy, Elsevier, vol. 78(C), pages 193-202.
    3. Huerta Herraiz, Álvaro & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2020. "Photovoltaic plant condition monitoring using thermal images analysis by convolutional neural network-based structure," Renewable Energy, Elsevier, vol. 153(C), pages 334-348.
    4. Martin Libra & Milan Daneček & Jan Lešetický & Vladislav Poulek & Jan Sedláček & Václav Beránek, 2019. "Monitoring of Defects of a Photovoltaic Power Plant Using a Drone," Energies, MDPI, vol. 12(5), pages 1-9, February.
    5. Gaur, Ankita & Tiwari, G.N., 2014. "Performance of a-Si thin film PV modules with and without water flow: An experimental validation," Applied Energy, Elsevier, vol. 128(C), pages 184-191.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kellil, N. & Aissat, A. & Mellit, A., 2023. "Fault diagnosis of photovoltaic modules using deep neural networks and infrared images under Algerian climatic conditions," Energy, Elsevier, vol. 263(PC).
    2. Guo, Zhiling & Zhuang, Zhan & Tan, Hongjun & Liu, Zhengguang & Li, Peiran & Lin, Zhengyuan & Shang, Wen-Long & Zhang, Haoran & Yan, Jinyue, 2023. "Accurate and generalizable photovoltaic panel segmentation using deep learning for imbalanced datasets," Renewable Energy, Elsevier, vol. 219(P1).
    3. Tang, Wuqin & Yang, Qiang & Dai, Zhou & Yan, Wenjun, 2024. "Module defect detection and diagnosis for intelligent maintenance of solar photovoltaic plants: Techniques, systems and perspectives," Energy, Elsevier, vol. 297(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waqar Akram, M. & Li, Guiqiang & Jin, Yi & Chen, Xiao, 2022. "Failures of Photovoltaic modules and their Detection: A Review," Applied Energy, Elsevier, vol. 313(C).
    2. Peinado Gonzalo, Alfredo & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2020. "Survey of maintenance management for photovoltaic power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    3. Segovia Ramírez, Isaac & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2022. "A novel approach to optimize the positioning and measurement parameters in photovoltaic aerial inspections," Renewable Energy, Elsevier, vol. 187(C), pages 371-389.
    4. Wu, Jinshun & Zhang, Xingxing & Shen, Jingchun & Wu, Yupeng & Connelly, Karen & Yang, Tong & Tang, Llewellyn & Xiao, Manxuan & Wei, Yixuan & Jiang, Ke & Chen, Chao & Xu, Peng & Wang, Hong, 2017. "A review of thermal absorbers and their integration methods for the combined solar photovoltaic/thermal (PV/T) modules," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 839-854.
    5. Mohammed Wazed, Saeed & Hughes, Ben Richard & O’Connor, Dominic & Kaiser Calautit, John, 2018. "A review of sustainable solar irrigation systems for Sub-Saharan Africa," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1206-1225.
    6. Mahmoud Dhimish & Pavlos I. Lazaridis, 2022. "Approximating Shading Ratio Using the Total-Sky Imaging System: An Application for Photovoltaic Systems," Energies, MDPI, vol. 15(21), pages 1-16, November.
    7. Guo, Zhiling & Zhuang, Zhan & Tan, Hongjun & Liu, Zhengguang & Li, Peiran & Lin, Zhengyuan & Shang, Wen-Long & Zhang, Haoran & Yan, Jinyue, 2023. "Accurate and generalizable photovoltaic panel segmentation using deep learning for imbalanced datasets," Renewable Energy, Elsevier, vol. 219(P1).
    8. Rediske, Graciele & Michels, Leandro & Siluk, Julio Cezar Mairesse & Rigo, Paula Donaduzzi & Rosa, Carmen Brum & Lima, Andrei Cunha, 2024. "A proposed set of indicators for evaluating the performance of the operation and maintenance of photovoltaic plants," Applied Energy, Elsevier, vol. 354(PA).
    9. Cheng Yang & Fuhao Sun & Yujie Zou & Zhipeng Lv & Liang Xue & Chao Jiang & Shuangyu Liu & Bochao Zhao & Haoyang Cui, 2024. "A Survey of Photovoltaic Panel Overlay and Fault Detection Methods," Energies, MDPI, vol. 17(4), pages 1-37, February.
    10. Thiago B. Murari & Aloisio S. Nascimento Filho & Marcelo A. Moret & Sergio Pitombo & Alex A. B. Santos, 2020. "Self-Affine Analysis of ENSO in Solar Radiation," Energies, MDPI, vol. 13(18), pages 1-17, September.
    11. Han, Changwoon & Lee, Hyeonseok, 2018. "Investigation and modeling of long-term mismatch loss of photovoltaic array," Renewable Energy, Elsevier, vol. 121(C), pages 521-527.
    12. Pavel Kuznetsov & Dmitry Kotelnikov & Leonid Yuferev & Vladimir Panchenko & Vadim Bolshev & Marek Jasiński & Aymen Flah, 2022. "Method for the Automated Inspection of the Surfaces of Photovoltaic Modules," Sustainability, MDPI, vol. 14(19), pages 1-16, September.
    13. Kumar, Manish & Kumar, Arun, 2017. "Performance assessment and degradation analysis of solar photovoltaic technologies: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 78(C), pages 554-587.
    14. Castanheira, André F.A. & Fernandes, João F.P. & Branco, P.J. Costa, 2018. "Demonstration project of a cooling system for existing PV power plants in Portugal," Applied Energy, Elsevier, vol. 211(C), pages 1297-1307.
    15. Mireille B. Tadie Fogaing & Arman Hemmati & Carlos F. Lange & Brian A. Fleck, 2019. "Performance of Turbulence Models in Simulating Wind Loads on Photovoltaics Modules," Energies, MDPI, vol. 12(17), pages 1-16, August.
    16. Meena, Roopmati & Pareek, Arti & Gupta, Rajesh, 2024. "A comprehensive Review on interfacial delamination in photovoltaic modules," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    17. Hu, Jianhui & Chen, Wujun & Yang, Deqing & Zhao, Bing & Song, Hao & Ge, Binbin, 2016. "Energy performance of ETFE cushion roof integrated photovoltaic/thermal system on hot and cold days," Applied Energy, Elsevier, vol. 173(C), pages 40-51.
    18. Odysseas Tsafarakis & Kostas Sinapis & Wilfried G. J. H. M. van Sark, 2019. "A Time-Series Data Analysis Methodology for Effective Monitoring of Partially Shaded Photovoltaic Systems," Energies, MDPI, vol. 12(9), pages 1-18, May.
    19. Fonseca Alves, Ricardo Henrique & Deus Júnior, Getúlio Antero de & Marra, Enes Gonçalves & Lemos, Rodrigo Pinto, 2021. "Automatic fault classification in photovoltaic modules using Convolutional Neural Networks," Renewable Energy, Elsevier, vol. 179(C), pages 502-516.
    20. Abdulla, Hind & Sleptchenko, Andrei & Nayfeh, Ammar, 2024. "Photovoltaic systems operation and maintenance: A review and future directions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 195(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:193:y:2022:i:c:p:941-962. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.