IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i23p3827-d1536112.html
   My bibliography  Save this article

Multi-Scale Geometric Feature Extraction and Global Transformer for Real-World Indoor Point Cloud Analysis

Author

Listed:
  • Yisheng Chen

    (The Academy of Digital China, Fuzhou University, Fuzhou 350108, China)

  • Yu Xiao

    (The Academy of Digital China, Fuzhou University, Fuzhou 350108, China)

  • Hui Wu

    (The Academy of Digital China, Fuzhou University, Fuzhou 350108, China)

  • Chongcheng Chen

    (The Academy of Digital China, Fuzhou University, Fuzhou 350108, China)

  • Ding Lin

    (The Academy of Digital China, Fuzhou University, Fuzhou 350108, China)

Abstract

Indoor point clouds often present significant challenges due to the complexity and variety of structures and high object similarity. The local geometric structure helps the model learn the shape features of objects at the detail level, while the global context provides overall scene semantics and spatial relationship information between objects. To address these challenges, we propose a novel network architecture, PointMSGT, which includes a multi-scale geometric feature extraction (MSGFE) module and a global Transformer (GT) module. The MSGFE module consists of a geometric feature extraction (GFE) module and a multi-scale attention (MSA) module. The GFE module reconstructs triangles through each point’s two neighbors and extracts detailed local geometric relationships by the triangle’s centroid, normal vector, and plane constant. The MSA module extracts features through multi-scale convolutions and adaptively aggregates features, focusing on both local geometric details and global semantic information at different scale levels, enhancing the understanding of complex scenes. The global Transformer employs a self-attention mechanism to capture long-range dependencies across the entire point cloud. The proposed method demonstrates competitive performance in real-world indoor scenarios, with a mIoU of 68.6% in semantic segmentation on S3DIS and OA of 86.4% in classification on ScanObjectNN.

Suggested Citation

  • Yisheng Chen & Yu Xiao & Hui Wu & Chongcheng Chen & Ding Lin, 2024. "Multi-Scale Geometric Feature Extraction and Global Transformer for Real-World Indoor Point Cloud Analysis," Mathematics, MDPI, vol. 12(23), pages 1-21, December.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:23:p:3827-:d:1536112
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/23/3827/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/23/3827/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:23:p:3827-:d:1536112. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.