IDEAS home Printed from https://ideas.repec.org/a/igg/jswis0/v20y2024i1p1-22.html
   My bibliography  Save this article

Reversible-Prior-Based Spectral-Spatial Transformer for Efficient Hyperspectral Image Reconstruction

Author

Listed:
  • Zeyu Cai

    (Southeast University, China)

  • Zheng Liu

    (Nanjing Institute of Argicultural Mechanization, Ministry of Agriculture and Rural Affairs, China)

  • Jian Yu

    (Southeast University, China)

  • Ziyu Zhang

    (Nanjing University, China)

  • Feipeng Da

    (Southeast University, China)

  • Chengqian Jin

    (Nanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, China)

Abstract

The task of reconstructing a 3D cube from a 2D measurement is not well-defined in spectral imaging. Unfortunately, existing Deep Unfolding Network (DU) and End-to-End (E2E) approaches can't strike an optimal balance between computational complexity and reconstruction quality. The goal of this study is to think about ways to merge the E2E's violent mapping with DU's iterative method. Our proposed deep learning framework, the Reversible-prior-based Spectral-Spatial Transformer, combines the high-quality reconstruction capabilities of DU with the advantages of having fewer parameters and lower computing cost, similar to the E2E approach. SST-ReversibleNet uses a reversible prior to project the end-to-end mapping reconstruction results back into the measurement space, construct the residuals between the reprojection and the actual measurement, and improve reconstruction accuracy. Extensive trials show that our SST-ReversibleNet outperforms cutting-edge approaches by at least 0.8 dB and only use 34.3% Params and 44.1% giga floating-point operations per second (GFLOP).

Suggested Citation

  • Zeyu Cai & Zheng Liu & Jian Yu & Ziyu Zhang & Feipeng Da & Chengqian Jin, 2024. "Reversible-Prior-Based Spectral-Spatial Transformer for Efficient Hyperspectral Image Reconstruction," International Journal on Semantic Web and Information Systems (IJSWIS), IGI Global, vol. 20(1), pages 1-22, January.
  • Handle: RePEc:igg:jswis0:v:20:y:2024:i:1:p:1-22
    as

    Download full text from publisher

    File URL: http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJSWIS.344457
    Download Restriction: no
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:igg:jswis0:v:20:y:2024:i:1:p:1-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Journal Editor (email available below). General contact details of provider: https://www.igi-global.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.