IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i22p2984-d685213.html
   My bibliography  Save this article

Ensemble of Deep Learning-Based Multimodal Remote Sensing Image Classification Model on Unmanned Aerial Vehicle Networks

Author

Listed:
  • Gyanendra Prasad Joshi

    (Department of Computer Science and Engineering, Sejong University, Seoul 05006, Korea)

  • Fayadh Alenezi

    (Department of Electrical Engineering, College of Engineering, Jouf University, Sakakah 72388, Saudi Arabia)

  • Gopalakrishnan Thirumoorthy

    (School of Computer Science and Engineering, Vellore Institute of Technology, Vellore 632014, India)

  • Ashit Kumar Dutta

    (Department of Computer Science and Information Systems, College of Applied Sciences, Al Maarefa University, Ad Diriyah, Riyadh 13713, Saudi Arabia)

  • Jinsang You

    (Seculayer Company, Ltd., Seongsuil-ro 4-gil, 25, Kolon Digital Tower, Seongdong-gu, Seoul 04784, Korea)

Abstract

Recently, unmanned aerial vehicles (UAVs) have been used in several applications of environmental modeling and land use inventories. At the same time, the computer vision-based remote sensing image classification models are needed to monitor the modifications over time such as vegetation, inland water, bare soil or human infrastructure regardless of spectral, spatial, temporal, and radiometric resolutions. In this aspect, this paper proposes an ensemble of DL-based multimodal land cover classification (EDL-MMLCC) models using remote sensing images. The EDL-MMLCC technique aims to classify remote sensing images into the different cloud, shades, and land cover classes. Primarily, median filtering-based preprocessing and data augmentation techniques take place. In addition, an ensemble of DL models, namely VGG-19, Capsule Network (CapsNet), and MobileNet, is used for feature extraction. In addition, the training process of the DL models can be enhanced by the use of hosted cuckoo optimization (HCO) algorithm. Finally, the salp swarm algorithm (SSA) with regularized extreme learning machine (RELM) classifier is applied for land cover classification. The design of the HCO algorithm for hyperparameter optimization and SSA for parameter tuning of the RELM model helps to increase the classification outcome to a maximum level considerably. The proposed EDL-MMLCC technique is tested using an Amazon dataset from the Kaggle repository. The experimental results pointed out the promising performance of the EDL-MMLCC technique over the recent state of art approaches.

Suggested Citation

  • Gyanendra Prasad Joshi & Fayadh Alenezi & Gopalakrishnan Thirumoorthy & Ashit Kumar Dutta & Jinsang You, 2021. "Ensemble of Deep Learning-Based Multimodal Remote Sensing Image Classification Model on Unmanned Aerial Vehicle Networks," Mathematics, MDPI, vol. 9(22), pages 1-17, November.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:22:p:2984-:d:685213
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/22/2984/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/22/2984/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tim Newbold & Lawrence N. Hudson & Samantha L. L. Hill & Sara Contu & Igor Lysenko & Rebecca A. Senior & Luca Börger & Dominic J. Bennett & Argyrios Choimes & Ben Collen & Julie Day & Adriana De Palma, 2015. "Global effects of land use on local terrestrial biodiversity," Nature, Nature, vol. 520(7545), pages 45-50, April.
    2. Mellal, Mohamed Arezki & Al-Dahidi, Sameer & Williams, Edward J., 2020. "System reliability optimization with heterogeneous components using hosted cuckoo optimization algorithm," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yifan Da & Zhiyuan Ji & Yongsheng Zhou, 2022. "Building Damage Assessment Based on Siamese Hierarchical Transformer Framework," Mathematics, MDPI, vol. 10(11), pages 1-23, June.
    2. Iftikhar Ahmad & Abdul Qayyum & Brij B. Gupta & Madini O. Alassafi & Rayed A. AlGhamdi, 2022. "Ensemble of 2D Residual Neural Networks Integrated with Atrous Spatial Pyramid Pooling Module for Myocardium Segmentation of Left Ventricle Cardiac MRI," Mathematics, MDPI, vol. 10(4), pages 1-23, February.
    3. David Álvarez Gutiérrez & Fernando Sánchez Lasheras & Vicente Martín Sánchez & Sergio Luis Suárez Gómez & Víctor Moreno & Ferrán Moratalla-Navarro & Antonio José Molina de la Torre, 2022. "A New Algorithm for Multivariate Genome Wide Association Studies Based on Differential Evolution and Extreme Learning Machines," Mathematics, MDPI, vol. 10(7), pages 1-21, March.
    4. Boris V. Rumiantsev & Rasul A. Kochkarov & Azret A. Kochkarov, 2023. "Graph-Clustering Method for Construction of the Optimal Movement Trajectory under the Terrain Patrolling," Mathematics, MDPI, vol. 11(1), pages 1-13, January.
    5. Abhijeet Ainapure & Shahin Siahpour & Xiang Li & Faray Majid & Jay Lee, 2022. "Intelligent Robust Cross-Domain Fault Diagnostic Method for Rotating Machines Using Noisy Condition Labels," Mathematics, MDPI, vol. 10(3), pages 1-17, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuxin Qi & Yuandong Hu, 2024. "Spatiotemporal Variation and Driving Factors Analysis of Habitat Quality: A Case Study in Harbin, China," Land, MDPI, vol. 13(1), pages 1-21, January.
    2. Zhang, Hanxiao & Li, Yan-Fu, 2022. "Robust optimization on redundancy allocation problems in multi-state and continuous-state series–parallel systems," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    3. Yutong Zhang & Wei Zhou & Danxue Luo, 2023. "The Relationship Research between Biodiversity Conservation and Economic Growth: From Multi-Level Attempts to Key Development," Sustainability, MDPI, vol. 15(4), pages 1-19, February.
    4. Law, Elizabeth A. & Macchi, Leandro & Baumann, Matthias & Decarre, Julieta & Gavier-Pizarro, Gregorio & Levers, Christian & Mastrangelo, Matías E. & Murray, Francisco & Müller, Daniel & Piquer-Rodrígu, 2021. "Fading opportunities for mitigating agriculture-environment trade-offs in a south American deforestation hotspot," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 262.
    5. Mohamed Fomba & Zinash Delebo Osunde & Souleymane Sidi Traoré & Appollonia Okhimamhe & Janina Kleemann & Christine Fürst, 2024. "Urban Green Spaces in Bamako and Sikasso, Mali: Land Use Changes and Perceptions," Land, MDPI, vol. 13(1), pages 1-20, January.
    6. Baldini, Carolina & Marasas, Mariana Edith & Tittonell, Pablo & Drozd, Andrea Alejandra, 2022. "Urban, periurban and horticultural landscapes – Conflict and sustainable planning in La Plata district, Argentina," Land Use Policy, Elsevier, vol. 117(C).
    7. Qiaoyin Zhang & Yan Wu & Zhiqiang Zhao, 2024. "Identification of Harbin Ecological Function Degradation Areas Based on Ecological Importance Assessment and Ecological Sensitivity," Sustainability, MDPI, vol. 16(16), pages 1-17, August.
    8. Xiaoliang Shi & Fei Chen & Hao Ding & Mengqi Shi & Yi Li, 2022. "Assessing Vegetation Ecosystem Resistance to Drought in the Middle Reaches of the Yellow River Basin, China," IJERPH, MDPI, vol. 19(7), pages 1-16, March.
    9. Qian Zuo & Yong Zhou & Jingyi Liu, 2022. "Construction and Optimization Strategy of an Ecological Network in Mountainous Areas: A Case Study in Southwestern Hubei Province, China," IJERPH, MDPI, vol. 19(15), pages 1-27, August.
    10. Ziqi Meng & Jinwei Dong & Erle C. Ellis & Graciela Metternicht & Yuanwei Qin & Xiao-Peng Song & Sara Löfqvist & Rachael D. Garrett & Xiaopeng Jia & Xiangming Xiao, 2023. "Post-2020 biodiversity framework challenged by cropland expansion in protected areas," Nature Sustainability, Nature, vol. 6(7), pages 758-768, July.
    11. Guangdong Li & Chuanglin Fang & James E. M. Watson & Siao Sun & Wei Qi & Zhenbo Wang & Jianguo Liu, 2024. "Mixed effectiveness of global protected areas in resisting habitat loss," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    12. Sarah R. Weiskopf & Forest Isbell & Maria Isabel Arce-Plata & Moreno Di Marco & Mike Harfoot & Justin Johnson & Susannah B. Lerman & Brian W. Miller & Toni Lyn Morelli & Akira S. Mori & Ensheng Weng &, 2024. "Biodiversity loss reduces global terrestrial carbon storage," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    13. Shuangshuang Liu & Qipeng Liao & Mingzhu Xiao & Dengyue Zhao & Chunbo Huang, 2022. "Spatial and Temporal Variations of Habitat Quality and Its Response of Landscape Dynamic in the Three Gorges Reservoir Area, China," IJERPH, MDPI, vol. 19(6), pages 1-20, March.
    14. Hu Liao & Hu Li & Chen-Song Duan & Xin-Yuan Zhou & Qiu-Ping Luo & Xin-Li An & Yong-Guan Zhu & Jian-Qiang Su, 2022. "Response of soil viral communities to land use changes," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    15. Karlsson, Johan O. & Röös, Elin, 2019. "Resource-efficient use of land and animals—Environmental impacts of food systems based on organic cropping and avoided food-feed competition," Land Use Policy, Elsevier, vol. 85(C), pages 63-72.
    16. Nobel, Anne & Lizin, Sebastien & Malina, Robert, 2023. "What drives the designation of protected areas? Accounting for spatial dependence using a composite marginal likelihood approach," Ecological Economics, Elsevier, vol. 205(C).
    17. Hanwen Zhang & Yanqing Lang, 2022. "Quantifying and Analyzing the Responses of Habitat Quality to Land Use Change in Guangdong Province, China over the Past 40 Years," Land, MDPI, vol. 11(6), pages 1-23, May.
    18. Jan-Philipp Sasse & Evelina Trutnevyte, 2023. "A low-carbon electricity sector in Europe risks sustaining regional inequalities in benefits and vulnerabilities," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    19. Nele Lohrum & Morten Graversgaard & Chris Kjeldsen, 2021. "Historical Transition of a Farming System towards Industrialization: A Danish Agricultural Case Study Comparing Sustainability in the 1840s and 2019," Sustainability, MDPI, vol. 13(22), pages 1-15, November.
    20. Li, Shuai & Chi, Xuefen & Yu, Baozhu, 2022. "An improved particle swarm optimization algorithm for the reliability–redundancy allocation problem with global reliability," Reliability Engineering and System Safety, Elsevier, vol. 225(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:22:p:2984-:d:685213. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.