IDEAS home Printed from https://ideas.repec.org/a/gam/jagris/v13y2023i6p1238-d1170292.html
   My bibliography  Save this article

M2F-Net: A Deep Learning-Based Multimodal Classification with High-Throughput Phenotyping for Identification of Overabundance of Fertilizers

Author

Listed:
  • J. Dhakshayani

    (Department of Computer Science and Engineering, National Institute of Technology Puducherry, Karaikal 609609, India)

  • B. Surendiran

    (Department of Computer Science and Engineering, National Institute of Technology Puducherry, Karaikal 609609, India)

Abstract

Amaranth, a pseudocereal crop which is rich in nutrients and climate resistant, can provide an opportunity to increase food security and nutritional content for the growing population. Farmers rely mainly on synthetic fertilizers to improve the quality and yield of the crop; however, this overuse harms the ecosystem. Understanding the mechanism causing this environmental deterioration is crucial for crop production and ecological sustainability. In recent years, high-throughput phenotyping using Artificial Intelligence (AI) has been thriving and can provide an effective solution for the identification of fertilizer overuse. Influenced by the strength of deep learning paradigms and IoT sensors, a novel multimodal fusion network (M2F-Net) is proposed for high-throughput phenotyping to diagnose overabundance of fertilizers. In this paper, we developed and analyzed three strategies that fuse agrometeorological and image data by assessing fusion at various stages. Initially two unimodal baseline networks were trained: Multi-Layer Perceptron (MLP) on agrometeorological data and a pre-trained Convolutional Neural Network (CNN) model DenseNet-121 on image data. With these baselines, the multimodal fusion network is developed, capable of adeptly learning from image and non-image data and the model’s performance is evaluated in terms of accuracy and Area Under Curve (AUC). Moreover, the fusion approaches that are considered outperformed the unimodal networks remarkably with 91% accuracy. From the experimental result, it is proven that incorporating agrometeorological information and images can substantially boost the classification performance for the overabundance of fertilizer.

Suggested Citation

  • J. Dhakshayani & B. Surendiran, 2023. "M2F-Net: A Deep Learning-Based Multimodal Classification with High-Throughput Phenotyping for Identification of Overabundance of Fertilizers," Agriculture, MDPI, vol. 13(6), pages 1-19, June.
    • Handle: RePEc:gam:jagris:v:13:y:2023:i:6:p:1238-:d:1170292
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2077-0472/13/6/1238/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2077-0472/13/6/1238/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yousfi, Salima & Marín, José & Parra, Lorena & Lloret, Jaime & Mauri, Pedro V., 2022. "Remote sensing devices as key methods in the advanced turfgrass phenotyping under different water regimes," Agricultural Water Management, Elsevier, vol. 266(C).
    2. Shengyi Zhao & Yun Peng & Jizhan Liu & Shuo Wu, 2021. "Tomato Leaf Disease Diagnosis Based on Improved Convolution Neural Network by Attention Module," Agriculture, MDPI, vol. 11(7), pages 1-15, July.
    3. Engås, Karen G. & Raja, Jawwad Z. & Neufang, Isabelle Fabienne, 2023. "Decoding technological frames: An exploratory study of access to and meaningful engagement with digital technologies in agriculture," Technological Forecasting and Social Change, Elsevier, vol. 190(C).
    4. Yujin Hwang & Seunghyeon Lee & Taejoo Kim & Kyeonghoon Baik & Yukyung Choi, 2022. "Crop Growth Monitoring System in Vertical Farms Based on Region-of-Interest Prediction," Agriculture, MDPI, vol. 12(5), pages 1-14, April.
    5. A. S. Syed Shahul Hameed & Narendran Rajagopalan, 2022. "SPGD: Search Party Gradient Descent Algorithm, a Simple Gradient-Based Parallel Algorithm for Bound-Constrained Optimization," Mathematics, MDPI, vol. 10(5), pages 1-24, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang Chen & Xiaoyulong Chen & Jianwu Lin & Renyong Pan & Tengbao Cao & Jitong Cai & Dianzhi Yu & Tomislav Cernava & Xin Zhang, 2022. "DFCANet: A Novel Lightweight Convolutional Neural Network Model for Corn Disease Identification," Agriculture, MDPI, vol. 12(12), pages 1-22, November.
    2. Taejoo Kim & Hyeongjun Kim & Kyeonghoon Baik & Yukyung Choi, 2022. "Instance-Aware Plant Disease Detection by Utilizing Saliency Map and Self-Supervised Pre-Training," Agriculture, MDPI, vol. 12(8), pages 1-16, July.
    3. Phumelelani Mbuqwa & Hezekiel Bheki Magagula & Ahmed Mukalazi Kalumba & Gbenga Abayomi Afuye, 2024. "Interdecadal Variations in Agricultural Drought Monitoring Using Land Surface Temperature and Vegetation Indices: A Case of the Amahlathi Local Municipality in South Africa," Sustainability, MDPI, vol. 16(18), pages 1-21, September.
    4. Xia Hao & Man Zhang & Tianru Zhou & Xuchao Guo & Federico Tomasetto & Yuxin Tong & Minjuan Wang, 2021. "An Automatic Light Stress Grading Architecture Based on Feature Optimization and Convolutional Neural Network," Agriculture, MDPI, vol. 11(11), pages 1-17, November.
    5. Lee, Chien-Chiang & Yan, Jingyang & Wang, Fuhao, 2024. "Impact of population aging on food security in the context of artificial intelligence: Evidence from China," Technological Forecasting and Social Change, Elsevier, vol. 199(C).
    6. Jianwu Lin & Xiaoyulong Chen & Renyong Pan & Tengbao Cao & Jitong Cai & Yang Chen & Xishun Peng & Tomislav Cernava & Xin Zhang, 2022. "GrapeNet: A Lightweight Convolutional Neural Network Model for Identification of Grape Leaf Diseases," Agriculture, MDPI, vol. 12(6), pages 1-17, June.
    7. Yuan-Kai Tu & Chin-En Kuo & Shih-Lun Fang & Han-Wei Chen & Ming-Kun Chi & Min-Hwi Yao & Bo-Jein Kuo, 2022. "A 1D-SP-Net to Determine Early Drought Stress Status of Tomato ( Solanum lycopersicum ) with Imbalanced Vis/NIR Spectroscopy Data," Agriculture, MDPI, vol. 12(2), pages 1-17, February.
    8. Ciliberti, Stefano & Frascarelli, Angelo & Polenzani, Bianca & Brunori, Gianluca & Martino, Gaetano, 2024. "Digitalisation strategies in the agri-food system: The case of PDO Parmigiano Reggiano," Agricultural Systems, Elsevier, vol. 218(C).
    9. Zahid Ullah & Najah Alsubaie & Mona Jamjoom & Samah H. Alajmani & Farrukh Saleem, 2023. "EffiMob-Net: A Deep Learning-Based Hybrid Model for Detection and Identification of Tomato Diseases Using Leaf Images," Agriculture, MDPI, vol. 13(3), pages 1-13, March.
    10. Xiang Zhang & Huiyi Gao & Li Wan, 2022. "Classification of Fine-Grained Crop Disease by Dilated Convolution and Improved Channel Attention Module," Agriculture, MDPI, vol. 12(10), pages 1-16, October.
    11. Jeehan Awad & Rodrigo Martín‐Rojas, 2024. "Enhancing social responsibility and resilience through entrepreneurship and digital environment," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(3), pages 1688-1704, May.
    12. da Silveira, Franco & da Silva, Sabrina Letícia Couto & Machado, Filipe Molinar & Barbedo, Jayme Garcia Arnal & Amaral, Fernando Gonçalves, 2023. "Farmers' perception of the barriers that hinder the implementation of agriculture 4.0," Agricultural Systems, Elsevier, vol. 208(C).
    13. Li Zhang & Qun Hao & Jie Cao, 2023. "Attention-Based Fine-Grained Lightweight Architecture for Fuji Apple Maturity Classification in an Open-World Orchard Environment," Agriculture, MDPI, vol. 13(2), pages 1-20, January.
    14. Cimino, Antonio & Coniglio, Ilda Maria & Corvello, Vincenzo & Longo, Francesco & Sagawa, Juliana Keiko & Solina, Vittorio, 2024. "Exploring small farmers behavioral intention to adopt digital platforms for sustainable and successful agricultural ecosystems," Technological Forecasting and Social Change, Elsevier, vol. 204(C).
    15. Bharathwaaj Sundararaman & Siddhant Jagdev & Narendra Khatri, 2023. "Transformative Role of Artificial Intelligence in Advancing Sustainable Tomato ( Solanum lycopersicum ) Disease Management for Global Food Security: A Comprehensive Review," Sustainability, MDPI, vol. 15(15), pages 1-23, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jagris:v:13:y:2023:i:6:p:1238-:d:1170292. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.