IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i4p847-d1060605.html
   My bibliography  Save this article

Compression Reconstruction Network with Coordinated Self-Attention and Adaptive Gaussian Filtering Module

Author

Listed:
  • Zhen Wei

    (School of Information Engineering, Nanchang University, Nanchang 330031, China)

  • Qiurong Yan

    (School of Information Engineering, Nanchang University, Nanchang 330031, China)

  • Xiaoqiang Lu

    (Qiyuan Lab, Beijing 100095, China)

  • Yongjian Zheng

    (School of Information Engineering, Nanchang University, Nanchang 330031, China)

  • Shida Sun

    (School of Information Engineering, Nanchang University, Nanchang 330031, China)

  • Jian Lin

    (School of Information Engineering, Nanchang University, Nanchang 330031, China)

Abstract

Although compressed sensing theory has many advantages in image reconstruction, its reconstruction and sampling time is very long. Fast reconstruction of high-quality images at low measurement rates is the direction of the effort. Compressed sensing based on deep learning provides an effective solution for this. In this study, we propose an attention-based compression reconstruction mechanism (ACRM). The coordinated self-attention module (CSAM) is designed to be embedded in the main network consisting of convolutional blocks and utilizes the global space and channels to focus on key information and ignore irrelevant information. An adaptive Gaussian filter is proposed to solve the loss of multi-frequency components caused by global average pooling in the CSAM, effectively supplementing the network with different frequency information at different measurement rates. Finally, inspired by the basic idea of the attention mechanism, an improved loss function with attention mechanism (AMLoss) is proposed. Extensive experiments show that the ACRM outperforms most compression reconstruction algorithms at low measurement rates.

Suggested Citation

  • Zhen Wei & Qiurong Yan & Xiaoqiang Lu & Yongjian Zheng & Shida Sun & Jian Lin, 2023. "Compression Reconstruction Network with Coordinated Self-Attention and Adaptive Gaussian Filtering Module," Mathematics, MDPI, vol. 11(4), pages 1-17, February.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:4:p:847-:d:1060605
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/4/847/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/4/847/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chengbo Li & Wotao Yin & Hong Jiang & Yin Zhang, 2013. "An efficient augmented Lagrangian method with applications to total variation minimization," Computational Optimization and Applications, Springer, vol. 56(3), pages 507-530, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paula A. Kikuchi & Aurelio R. L. Oliveira, 2020. "New Preconditioners Applied to Linear Programming and the Compressive Sensing Problems," SN Operations Research Forum, Springer, vol. 1(4), pages 1-20, December.
    2. Ya-Feng Liu & Xin Liu & Shiqian Ma, 2019. "On the Nonergodic Convergence Rate of an Inexact Augmented Lagrangian Framework for Composite Convex Programming," Mathematics of Operations Research, INFORMS, vol. 44(2), pages 632-650, May.
    3. Kruse, René-Marcel & Silbersdorff, Alexander & Säfken, Benjamin, 2022. "Model averaging for linear mixed models via augmented Lagrangian," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    4. Leonardo Galli & Alessandro Galligari & Marco Sciandrone, 2020. "A unified convergence framework for nonmonotone inexact decomposition methods," Computational Optimization and Applications, Springer, vol. 75(1), pages 113-144, January.
    5. Keshvari, Abolfazl, 2017. "A penalized method for multivariate concave least squares with application to productivity analysis," European Journal of Operational Research, Elsevier, vol. 257(3), pages 1016-1029.
    6. Xiao, Jiang-Wen & Yang, Yan-Bing & Cui, Shichang & Liu, Xiao-Kang, 2022. "A new energy storage sharing framework with regard to both storage capacity and power capacity," Applied Energy, Elsevier, vol. 307(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:4:p:847-:d:1060605. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.