IDEAS home Printed from https://ideas.repec.org/a/gam/jagris/v13y2023i9p1814-d1240031.html
   My bibliography  Save this article

An Overview of the Application of Machine Vision in Recognition and Localization of Fruit and Vegetable Harvesting Robots

Author

Listed:
  • Guangyu Hou

    (Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
    Science Island Branch, University of Science and Technology of China, Hefei 230026, China)

  • Haihua Chen

    (Institute of Computer Science, Chinese Academy of Sciences, Beijing 100190, China)

  • Mingkun Jiang

    (Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
    Science Island Branch, University of Science and Technology of China, Hefei 230026, China)

  • Runxin Niu

    (Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China)

Abstract

Intelligent agriculture imposes higher requirements on the recognition and localization of fruit and vegetable picking robots. Due to its unique visual information and relatively low hardware cost, machine vision is widely applied in the recognition and localization of fruit and vegetable picking robots. This article provides an overview of the application of machine vision in the recognition and localization of fruit and vegetable picking robots. Firstly, the advantages, disadvantages, and the roles of different visual sensors and machine vision algorithms in the recognition and localization of fruit and vegetable picking robots are introduced, including monocular cameras, stereo cameras, structured light cameras, multispectral cameras, image segmentation algorithms, object detection algorithms, and 3D reconstruction algorithms. Then, the current status and challenges faced by machine vision in the recognition and localization of fruit and vegetable picking robots are summarized. These challenges include the stability of fast recognition under complex background interference, stability of recognition under different lighting environments for the same crop, the reliance of recognition and localization on prior information in the presence of fruit overlap and occlusions caused by leaves and branches, and the uncertainty of picking caused by complex working environments. In current research on algorithms dealing with complex background interference and various occlusion disturbances, good results have been achieved. Different lighting environments have a significant impact on the recognition and positioning of fruits and vegetables, with a minimum accuracy of 59.2%. Finally, this article outlines future research directions to address these challenges.

Suggested Citation

  • Guangyu Hou & Haihua Chen & Mingkun Jiang & Runxin Niu, 2023. "An Overview of the Application of Machine Vision in Recognition and Localization of Fruit and Vegetable Harvesting Robots," Agriculture, MDPI, vol. 13(9), pages 1-31, September.
    • Handle: RePEc:gam:jagris:v:13:y:2023:i:9:p:1814-:d:1240031
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2077-0472/13/9/1814/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2077-0472/13/9/1814/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jinlong Wu & Sheng Zhang & Tianlong Zou & Lizhong Dong & Zhou Peng & Hongjun Wang & Mohammad Yaghoub Abdollahzadeh Jamalabadi, 2022. "A Dense Litchi Target Recognition Algorithm for Large Scenes," Mathematical Problems in Engineering, Hindawi, vol. 2022, pages 1-10, April.
    2. Peng Xu & Qian Tan & Yunpeng Zhang & Xiantao Zha & Songmei Yang & Ranbing Yang, 2022. "Research on Maize Seed Classification and Recognition Based on Machine Vision and Deep Learning," Agriculture, MDPI, vol. 12(2), pages 1-16, February.
    3. Wei Ji & Yu Pan & Bo Xu & Juncheng Wang, 2022. "A Real-Time Apple Targets Detection Method for Picking Robot Based on ShufflenetV2-YOLOX," Agriculture, MDPI, vol. 12(6), pages 1-18, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mingjie Wu & Xuanxi Yang & Lijun Yun & Chenggui Yang & Zaiqing Chen & Yuelong Xia, 2024. "A General Image Super-Resolution Reconstruction Technique for Walnut Object Detection Model," Agriculture, MDPI, vol. 14(8), pages 1-24, August.
    2. Jaehwi Seol & Yonghyun Park & Jeonghyeon Pak & Yuseung Jo & Giwan Lee & Yeongmin Kim & Chanyoung Ju & Ayoung Hong & Hyoung Il Son, 2024. "Human-Centered Robotic System for Agricultural Applications: Design, Development, and Field Evaluation," Agriculture, MDPI, vol. 14(11), pages 1-17, November.
    3. Chenggui Yang & Zhengda Cai & Mingjie Wu & Lijun Yun & Zaiqing Chen & Yuelong Xia, 2024. "Research on Detection Algorithm of Green Walnut in Complex Environment," Agriculture, MDPI, vol. 14(9), pages 1-22, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weidong Zhu & Jun Sun & Simin Wang & Jifeng Shen & Kaifeng Yang & Xin Zhou, 2022. "Identifying Field Crop Diseases Using Transformer-Embedded Convolutional Neural Network," Agriculture, MDPI, vol. 12(8), pages 1-19, July.
    2. Yu Wang & Hongyi Bai & Laijun Sun & Yan Tang & Yonglong Huo & Rui Min, 2022. "The Rapid and Accurate Detection of Kidney Bean Seeds Based on a Compressed Yolov3 Model," Agriculture, MDPI, vol. 12(8), pages 1-21, August.
    3. Rong-Li Gai & Kai Wei & Peng-Fei Wang, 2023. "SSMDA: Self-Supervised Cherry Maturity Detection Algorithm Based on Multi-Feature Contrastive Learning," Agriculture, MDPI, vol. 13(5), pages 1-13, April.
    4. Xianguo Ren & Haiqing Tian & Kai Zhao & Dapeng Li & Ziqing Xiao & Yang Yu & Fei Liu, 2022. "Research on pH Value Detection Method during Maize Silage Secondary Fermentation Based on Computer Vision," Agriculture, MDPI, vol. 12(10), pages 1-17, October.
    5. Lili Yang & Changlong Wang & Jianfeng Yu & Nan Xu & Dongwei Wang, 2023. "Method of Peanut Pod Quality Detection Based on Improved ResNet," Agriculture, MDPI, vol. 13(7), pages 1-20, July.
    6. Dimitre D. Dimitrov, 2023. "Internet and Computers for Agriculture," Agriculture, MDPI, vol. 13(1), pages 1-7, January.
    7. Kadir Sabanci, 2023. "Benchmarking of CNN Models and MobileNet-BiLSTM Approach to Classification of Tomato Seed Cultivars," Sustainability, MDPI, vol. 15(5), pages 1-14, March.
    8. Huawei Yang & Yinzeng Liu & Shaowei Wang & Huixing Qu & Ning Li & Jie Wu & Yinfa Yan & Hongjian Zhang & Jinxing Wang & Jianfeng Qiu, 2023. "Improved Apple Fruit Target Recognition Method Based on YOLOv7 Model," Agriculture, MDPI, vol. 13(7), pages 1-21, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jagris:v:13:y:2023:i:9:p:1814-:d:1240031. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.