IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2022i1p112-d1015877.html
   My bibliography  Save this article

Heterogeneous Feature Fusion Module Based on CNN and Transformer for Multiview Stereo Reconstruction

Author

Listed:
  • Rui Gao

    (Department of Multimedia Engineering, Dongguk University-Seoul, 30, Pildongro-1-gil, Jung-gu, Seoul 04620, Republic of Korea)

  • Jiajia Xu

    (Department of Multimedia Engineering, Dongguk University-Seoul, 30, Pildongro-1-gil, Jung-gu, Seoul 04620, Republic of Korea)

  • Yipeng Chen

    (Department of Autonomous Things Intelligence, Dongguk University-Seoul, 30, Pildongro-1-gil, Jung-gu, Seoul 04620, Republic of Korea)

  • Kyungeun Cho

    (Department of Multimedia Engineering, Dongguk University-Seoul, 30, Pildongro-1-gil, Jung-gu, Seoul 04620, Republic of Korea)

Abstract

For decades, a vital area of computer vision research has been multiview stereo (MVS), which creates 3D models of a scene using photographs. This study presents an effective MVS network for 3D reconstruction utilizing multiview pictures. Alternative learning-based reconstruction techniques work well, because CNNs (convolutional neural network) can extract only the image’s local features; however, they contain many artifacts. Herein, a transformer and CNN are used to extract the global and local features of the image, respectively. Additionally, hierarchical aggregation and heterogeneous interaction modules were used to improve these features. They are based on the transformer and can extract dense features with 3D consistency and global context that are necessary to provide accurate matching for MVS.

Suggested Citation

  • Rui Gao & Jiajia Xu & Yipeng Chen & Kyungeun Cho, 2022. "Heterogeneous Feature Fusion Module Based on CNN and Transformer for Multiview Stereo Reconstruction," Mathematics, MDPI, vol. 11(1), pages 1-14, December.
    • Handle: RePEc:gam:jmathe:v:11:y:2022:i:1:p:112-:d:1015877
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/1/112/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/11/1/112/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2022:i:1:p:112-:d:1015877. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.