IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2022i1p186-d1019444.html
   My bibliography  Save this article

VPP: Visual Pollution Prediction Framework Based on a Deep Active Learning Approach Using Public Road Images

Author

Listed:
  • Mohammad AlElaiwi

    (Computer Science Department, College of Computer Sciences and Information Technology (CCSIT), King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia)

  • Mugahed A. Al-antari

    (Department of Artificial Intelligence, College of Software & Convergence Technology, Daeyang AI Center, Sejong University, Seoul 05006, Republic of Korea)

  • Hafiz Farooq Ahmad

    (Computer Science Department, College of Computer Sciences and Information Technology (CCSIT), King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia)

  • Areeba Azhar

    (Department of Mathematics, College of Natural & Agricultural Sciences, University of California-Riverside (UCR), Riverside, CA 92521, USA)

  • Badar Almarri

    (Computer Science Department, College of Computer Sciences and Information Technology (CCSIT), King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia)

  • Jamil Hussain

    (Department of Data Science, College of Software & Convergence Technology, Daeyang AI Center, Sejong University, Seoul 05006, Republic of Korea)

Abstract

Visual pollution (VP) is the deterioration or disruption of natural and man-made landscapes that ruins the aesthetic appeal of an area. It also refers to physical elements that limit the movability of people on public roads, such as excavation barriers, potholes, and dilapidated sidewalks. In this paper, an end-to-end visual pollution prediction (VPP) framework based on a deep active learning (DAL) approach is proposed to simultaneously detect and classify visual pollutants from whole public road images. The proposed framework is architected around the following steps: real VP dataset collection, pre-processing, a DAL approach for automatic data annotation, data splitting as well as augmentation, and simultaneous VP detection and classification. This framework is designed to predict VP localization and classify it into three categories: excavation barriers, potholes, and dilapidated sidewalks. A real dataset with 34,460 VP images was collected from various regions across the Kingdom of Saudi Arabia (KSA) via the Ministry of Municipal and Rural Affairs and Housing (MOMRAH), and this was used to develop and fine-tune the proposed artificial intelligence (AI) framework via the use of five AI predictors: MobileNetSSDv2, EfficientDet, Faster RCNN, Detectron2, and YOLO. The proposed VPP-based YOLO framework outperforms competitor AI predictors with superior prediction performance at 89 % precision, 88% recall, 89% F1-score, and 93% mAP. The DAL approach plays a crucial role in automatically annotating the VP images and supporting the VPP framework to improve prediction performance by 18% precision, 27% recall, and 25% mAP. The proposed VPP framework is able to simultaneously detect and classify distinct visual pollutants from annotated images via the DAL strategy. This technique is applicable for real-time monitoring applications.

Suggested Citation

  • Mohammad AlElaiwi & Mugahed A. Al-antari & Hafiz Farooq Ahmad & Areeba Azhar & Badar Almarri & Jamil Hussain, 2022. "VPP: Visual Pollution Prediction Framework Based on a Deep Active Learning Approach Using Public Road Images," Mathematics, MDPI, vol. 11(1), pages 1-26, December.
    • Handle: RePEc:gam:jmathe:v:11:y:2022:i:1:p:186-:d:1019444
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/1/186/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/11/1/186/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wang, Xuechao & Chen, Jinzhou & Quan, Shengwei & Wang, Ya-Xiong & He, Hongwen, 2020. "Hierarchical model predictive control via deep learning vehicle speed predictions for oxygen stoichiometry regulation of fuel cells," Applied Energy, Elsevier, vol. 276(C).
    2. Khydija Wakil & Malik Asghar Naeem & Ghulam Abbas Anjum & Abdul Waheed & Muhammad Jamaluddin Thaheem & Muhammad Qadeer ul Hussnain & Raheel Nawaz, 2019. "A Hybrid Tool for Visual Pollution Assessment in Urban Environments," Sustainability, MDPI, vol. 11(8), pages 1-16, April.
    3. Szymon Chmielewski, 2020. "Chaos in Motion: Measuring Visual Pollution with Tangential View Landscape Metrics," Land, MDPI, vol. 9(12), pages 1-21, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Jian & Zhang, Tiezhu & Hong, Jichao & Zhang, Hongxin & Zhao, Qinghai & Meng, Zewen, 2021. "Research on driving control strategy and Fuzzy logic optimization of a novel mechatronics-electro-hydraulic power coupling electric vehicle," Energy, Elsevier, vol. 233(C).
    2. Hu, Haowen & Ou, Kai & Yuan, Wei-Wei, 2023. "Fused multi-model predictive control with adaptive compensation for proton exchange membrane fuel cell air supply system," Energy, Elsevier, vol. 284(C).
    3. Urszula Forczek-Brataniec, 2021. "Assessment of Visual Values as a Tool Supporting the Design Decisions of the Cultural Park Protection Plan. The Case of Kazimierz and Stradom in Kraków," Sustainability, MDPI, vol. 13(13), pages 1-23, June.
    4. Haubensak, Lukas & Strahl, Stephan & Braun, Jochen & Faulwasser, Timm, 2024. "Towards real-time capable optimal control for fuel cell vehicles using hierarchical economic MPC," Applied Energy, Elsevier, vol. 366(C).
    5. Sylvain Rigal & Amine Jaafar & Christophe Turpin & Théophile Hordé & Jean-Baptiste Jollys & Paul Kreczanik, 2024. "Steady-State Voltage Modelling of a HT-PEMFC under Various Operating Conditions," Energies, MDPI, vol. 17(3), pages 1-18, January.
    6. Quan, Shengwei & Wang, Ya-Xiong & Xiao, Xuelian & He, Hongwen & Sun, Fengchun, 2021. "Feedback linearization-based MIMO model predictive control with defined pseudo-reference for hydrogen regulation of automotive fuel cells," Applied Energy, Elsevier, vol. 293(C).
    7. Liu, Ze & Zhang, Baitao & Xu, Sichuan, 2022. "Research on air mass flow-pressure combined control and dynamic performance of fuel cell system for vehicles application," Applied Energy, Elsevier, vol. 309(C).
    8. Dong, Peng & Zhao, Junwei & Liu, Xuewu & Wu, Jian & Xu, Xiangyang & Liu, Yanfang & Wang, Shuhan & Guo, Wei, 2022. "Practical application of energy management strategy for hybrid electric vehicles based on intelligent and connected technologies: Development stages, challenges, and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    9. Sylvain Rigal & Amine Jaafar & Christophe Turpin & Théophile Hordé & Jean-Baptiste Jollys & Paul Kreczanik, 2024. "An Air Over-Stoichiometry Dependent Voltage Model for HT-PEMFC MEAs," Energies, MDPI, vol. 17(12), pages 1-17, June.
    10. Zhang, Zhendong & Wang, Ya-Xiong & He, Hongwen & Sun, Fengchun, 2021. "A short- and long-term prognostic associating with remaining useful life estimation for proton exchange membrane fuel cell," Applied Energy, Elsevier, vol. 304(C).
    11. Yuguo Xu & Enyong Xu & Weiguang Zheng & Qibai Huang, 2023. "Hierarchical Model-Predictive-Control-Based Energy Management Strategy for Fuel Cell Hybrid Commercial Vehicles Incorporating Traffic Information," Sustainability, MDPI, vol. 15(17), pages 1-21, August.
    12. Messner, Wolfgang, 2024. "Exploring multilevel data with deep learning and XAI: The effect of personal-care advertising spending on subjective happiness," International Business Review, Elsevier, vol. 33(1).
    13. Liu, Zhaoming & Chang, Guofeng & Yuan, Hao & Tang, Wei & Xie, Jiaping & Wei, Xuezhe & Dai, Haifeng, 2023. "Adaptive look-ahead model predictive control strategy of vehicular PEMFC thermal management," Energy, Elsevier, vol. 285(C).
    14. Min, Dehao & Song, Zhen & Chen, Huicui & Wang, Tianxiang & Zhang, Tong, 2022. "Genetic algorithm optimized neural network based fuel cell hybrid electric vehicle energy management strategy under start-stop condition," Applied Energy, Elsevier, vol. 306(PB).
    15. Mahsa Farahani & Seyed Vahid Razavi-Termeh & Abolghasem Sadeghi-Niaraki & Soo-Mi Choi, 2023. "A Hybridization of Spatial Modeling and Deep Learning for People’s Visual Perception of Urban Landscapes," Sustainability, MDPI, vol. 15(13), pages 1-30, July.
    16. Przemysław Śleszyński, 2021. "Multi-Item Assessment of Physiognomic Diversity of Geocomplexes as a Comprehensive Method of Visual-Aesthetic Landscape Assessment," Geographies, MDPI, vol. 1(1), pages 1-25, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2022:i:1:p:186-:d:1019444. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.