IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v193y2022icp941-962.html
   My bibliography  Save this article

A multi-stage model based on YOLOv3 for defect detection in PV panels based on IR and visible imaging by unmanned aerial vehicle

Author

Listed:
  • Di Tommaso, Antonio
  • Betti, Alessandro
  • Fontanelli, Giacomo
  • Michelozzi, Benedetto

Abstract

As solar capacity installed worldwide continues to grow, there is an increasing awareness that advanced inspection systems are becoming of utmost importance to schedule smart interventions and minimize downtime likelihood. In this work we propose a novel automatic multi-stage model to detect panel defects on aerial images captured by unmanned aerial vehicle by using the YOLOv3 network and Computer Vision techniques. The model combines detections of panels and defects to refine its accuracy and exhibits an average inference time per image of 0.98 s. The main novelties are represented by its versatility to process either thermographic or visible images and detect a large variety of defects, to prescript recommended actions to O&M crew to give a more efficient data-driven maintenance strategy and its portability to both rooftop and ground-mounted PV systems and different panel types. The proposed model has been validated on two big PV plants in the south of Italy with an outstanding AP@0.5 exceeding 98% for panel detection, a remarkable AP@0.4 (AP@0.5) of roughly 88.3% (66.9%) for hotspots by means of infrared termography and a mAP@0.5 of almost 70% in the visible spectrum for detection of anomalies including panel shading induced by soiling and bird dropping, delamination, presence of puddles and raised rooftop panels. The model predicts also the severity of hotspot areas based on the estimated temperature gradients, as well as it computes the soiling coverage based on visual images. Finally an analysis of the influence of the different YOLOv3's output scales on the detection is discussed.

Suggested Citation

  • Di Tommaso, Antonio & Betti, Alessandro & Fontanelli, Giacomo & Michelozzi, Benedetto, 2022. "A multi-stage model based on YOLOv3 for defect detection in PV panels based on IR and visible imaging by unmanned aerial vehicle," Renewable Energy, Elsevier, vol. 193(C), pages 941-962.
    • Handle: RePEc:eee:renene:v:193:y:2022:i:c:p:941-962
    DOI: 10.1016/j.renene.2022.04.046
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122005079
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2022.04.046?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Huerta Herraiz, Álvaro & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2020. "Photovoltaic plant condition monitoring using thermal images analysis by convolutional neural network-based structure," Renewable Energy, Elsevier, vol. 153(C), pages 334-348.
    2. Martin Libra & Milan Daneček & Jan Lešetický & Vladislav Poulek & Jan Sedláček & Václav Beránek, 2019. "Monitoring of Defects of a Photovoltaic Power Plant Using a Drone," Energies, MDPI, vol. 12(5), pages 1-9, February.
    3. Gaur, Ankita & Tiwari, G.N., 2014. "Performance of a-Si thin film PV modules with and without water flow: An experimental validation," Applied Energy, Elsevier, vol. 128(C), pages 184-191.
    4. Roberto Pierdicca & Marina Paolanti & Andrea Felicetti & Fabio Piccinini & Primo Zingaretti, 2020. "Automatic Faults Detection of Photovoltaic Farms: solAIr, a Deep Learning-Based System for Thermal Images," Energies, MDPI, vol. 13(24), pages 1-17, December.
    5. Chandel, S.S. & Nagaraju Naik, M. & Sharma, Vikrant & Chandel, Rahul, 2015. "Degradation analysis of 28 year field exposed mono-c-Si photovoltaic modules of a direct coupled solar water pumping system in western Himalayan region of India," Renewable Energy, Elsevier, vol. 78(C), pages 193-202.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guo, Zhiling & Zhuang, Zhan & Tan, Hongjun & Liu, Zhengguang & Li, Peiran & Lin, Zhengyuan & Shang, Wen-Long & Zhang, Haoran & Yan, Jinyue, 2023. "Accurate and generalizable photovoltaic panel segmentation using deep learning for imbalanced datasets," Renewable Energy, Elsevier, vol. 219(P1).
    2. Tang, Wuqin & Yang, Qiang & Dai, Zhou & Yan, Wenjun, 2024. "Module defect detection and diagnosis for intelligent maintenance of solar photovoltaic plants: Techniques, systems and perspectives," Energy, Elsevier, vol. 297(C).
    3. Kellil, N. & Aissat, A. & Mellit, A., 2023. "Fault diagnosis of photovoltaic modules using deep neural networks and infrared images under Algerian climatic conditions," Energy, Elsevier, vol. 263(PC).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waqar Akram, M. & Li, Guiqiang & Jin, Yi & Chen, Xiao, 2022. "Failures of Photovoltaic modules and their Detection: A Review," Applied Energy, Elsevier, vol. 313(C).
    2. Peinado Gonzalo, Alfredo & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2020. "Survey of maintenance management for photovoltaic power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    3. Segovia Ramírez, Isaac & Pliego Marugán, Alberto & García Márquez, Fausto Pedro, 2022. "A novel approach to optimize the positioning and measurement parameters in photovoltaic aerial inspections," Renewable Energy, Elsevier, vol. 187(C), pages 371-389.
    4. Wu, Jinshun & Zhang, Xingxing & Shen, Jingchun & Wu, Yupeng & Connelly, Karen & Yang, Tong & Tang, Llewellyn & Xiao, Manxuan & Wei, Yixuan & Jiang, Ke & Chen, Chao & Xu, Peng & Wang, Hong, 2017. "A review of thermal absorbers and their integration methods for the combined solar photovoltaic/thermal (PV/T) modules," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 839-854.
    5. Mahmoud Dhimish & Pavlos I. Lazaridis, 2022. "Approximating Shading Ratio Using the Total-Sky Imaging System: An Application for Photovoltaic Systems," Energies, MDPI, vol. 15(21), pages 1-16, November.
    6. Cheng Yang & Fuhao Sun & Yujie Zou & Zhipeng Lv & Liang Xue & Chao Jiang & Shuangyu Liu & Bochao Zhao & Haoyang Cui, 2024. "A Survey of Photovoltaic Panel Overlay and Fault Detection Methods," Energies, MDPI, vol. 17(4), pages 1-37, February.
    7. Thiago B. Murari & Aloisio S. Nascimento Filho & Marcelo A. Moret & Sergio Pitombo & Alex A. B. Santos, 2020. "Self-Affine Analysis of ENSO in Solar Radiation," Energies, MDPI, vol. 13(18), pages 1-17, September.
    8. Pavel Kuznetsov & Dmitry Kotelnikov & Leonid Yuferev & Vladimir Panchenko & Vadim Bolshev & Marek Jasiński & Aymen Flah, 2022. "Method for the Automated Inspection of the Surfaces of Photovoltaic Modules," Sustainability, MDPI, vol. 14(19), pages 1-16, September.
    9. Castanheira, André F.A. & Fernandes, João F.P. & Branco, P.J. Costa, 2018. "Demonstration project of a cooling system for existing PV power plants in Portugal," Applied Energy, Elsevier, vol. 211(C), pages 1297-1307.
    10. Hu, Jianhui & Chen, Wujun & Yang, Deqing & Zhao, Bing & Song, Hao & Ge, Binbin, 2016. "Energy performance of ETFE cushion roof integrated photovoltaic/thermal system on hot and cold days," Applied Energy, Elsevier, vol. 173(C), pages 40-51.
    11. Fonseca Alves, Ricardo Henrique & Deus Júnior, Getúlio Antero de & Marra, Enes Gonçalves & Lemos, Rodrigo Pinto, 2021. "Automatic fault classification in photovoltaic modules using Convolutional Neural Networks," Renewable Energy, Elsevier, vol. 179(C), pages 502-516.
    12. Sampaio, Priscila Gonçalves Vasconcelos & González, Mario Orestes Aguirre, 2017. "Photovoltaic solar energy: Conceptual framework," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 590-601.
    13. Santhakumari, Manju & Sagar, Netramani, 2019. "A review of the environmental factors degrading the performance of silicon wafer-based photovoltaic modules: Failure detection methods and essential mitigation techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 110(C), pages 83-100.
    14. Rajput, Pramod & Tiwari, G.N. & Sastry, O.S., 2017. "Thermal modelling with experimental validation and economic analysis of mono crystalline silicon photovoltaic module on the basis of degradation study," Energy, Elsevier, vol. 120(C), pages 731-739.
    15. Habibollahzade, Ali, 2019. "Employing photovoltaic/thermal panels as a solar chimney roof: 3E analyses and multi-objective optimization," Energy, Elsevier, vol. 166(C), pages 118-130.
    16. Kichou, Sofiane & Silvestre, Santiago & Nofuentes, Gustavo & Torres-Ramírez, Miguel & Chouder, Aissa & Guasch, Daniel, 2016. "Characterization of degradation and evaluation of model parameters of amorphous silicon photovoltaic modules under outdoor long term exposure," Energy, Elsevier, vol. 96(C), pages 231-241.
    17. Mohamed Benghanem & Adel Mellit & Chourouk Moussaoui, 2023. "Embedded Hybrid Model (CNN–ML) for Fault Diagnosis of Photovoltaic Modules Using Thermographic Images," Sustainability, MDPI, vol. 15(10), pages 1-20, May.
    18. Montero, Francisco J. & Kumar, Ramesh & Lamba, Ravita & Escobar, Rodrigo A. & Vashishtha, Manish & Upadhyaya, Sushant & Guzmán, Amador M., 2022. "Hybrid photovoltaic-thermoelectric system: Economic feasibility analysis in the Atacama Desert, Chile," Energy, Elsevier, vol. 239(PB).
    19. Gianfranco Di Lorenzo & Erika Stracqualursi & Leonardo Micheli & Salvatore Celozzi & Rodolfo Araneo, 2022. "Prognostic Methods for Photovoltaic Systems’ Underperformance and Degradation: Status, Perspectives, and Challenges," Energies, MDPI, vol. 15(17), pages 1-6, September.
    20. Tuhibur Rahman & Ahmed Al Mansur & Molla Shahadat Hossain Lipu & Md. Siddikur Rahman & Ratil H. Ashique & Mohamad Abou Houran & Rajvikram Madurai Elavarasan & Eklas Hossain, 2023. "Investigation of Degradation of Solar Photovoltaics: A Review of Aging Factors, Impacts, and Future Directions toward Sustainable Energy Management," Energies, MDPI, vol. 16(9), pages 1-30, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:193:y:2022:i:c:p:941-962. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.