Author
Listed:
- Zaizuo Tang
(Chengdu University of Technology)
- Guangzhu Chen
(Chengdu University of Technology)
- Ruili Wang
(Massey University)
- Zhenlian Miao
(Chengdu University of Technology)
- Manna Dai
(Agency for Science, Technology and Research (A*STAR))
- Yujun Ma
(Massey University)
- Xiaojuan Liao
(Chengdu University of Technology)
Abstract
Three-dimensional (3D) instance segmentation, as an effective method for scene object recognition, can effectively enhance workshop intelligence. However, the existing 3D instance segmentation network is difficult to apply in workshop scenes due to the large number of 3D instance segmentation labels and 3D information acquisition devices required. In this paper, a monocular 3D instance segmentation network is proposed, which achieves satisfactory results while relying on a monocular RGB camera without 3D instance segmentation labels. The proposed method has two stages. In the first stage, the double-snake multitask network is proposed to solve the problem of a lack of 3D information acquisition devices. It simultaneously performs depth estimation and instance segmentation and uses the features obtained from depth estimation to guide the instance segmentation task. In the second stage, an adaptive point cloud filtering algorithm that performs adaptive point cloud noise filtering on multi-scale objects based on two-dimensional prior information is proposed to solve the problem of a lack of 3D labels. In addition, color information is introduced into the filtering process to further improve filtering accuracy. Experiments on the Cityscapes and SOP datasets demonstrate the competitive performance of the proposed method. When the IoU threshold is set to 0.35, the mean average precision (mAP) is 50.41. Our approach is deployed in an actual production workshop to verify its feasibility.
Suggested Citation
Zaizuo Tang & Guangzhu Chen & Ruili Wang & Zhenlian Miao & Manna Dai & Yujun Ma & Xiaojuan Liao, 2024.
"CD3IS: cross dimensional 3D instance segmentation network for production workshop,"
Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3273-3289, October.
Handle:
RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02200-6
DOI: 10.1007/s10845-023-02200-6
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02200-6. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.