IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i1p177-d1561325.html
   My bibliography  Save this article

Multimodal Image Translation Algorithm Based on Singular Squeeze-and-Excitation Network

Author

Listed:
  • Hangyao Tu

    (School of Computer Science and Technology, Zhejiang University, Hangzhou 310015, China
    School of Computer and Computational Science, Hangzhou City University, Hangzhou 310015, China)

  • Zheng Wang

    (School of Computer and Computational Science, Hangzhou City University, Hangzhou 310015, China)

  • Yanwei Zhao

    (College of Engineering, Zhejiang University of Technology, Hangzhou 310015, China)

Abstract

Image-to-image translation methods have advanced from focusing on image-level info to incorporating pixel-level and instance-level details. However, with feature-level constraint, deviation occurs when the network overemphasizes convolutional features, neglecting traditional image feature extraction. To address this, we proposed the multimodal image translation algorithm MASSE based on a Singular Squeeze-and-Excitation Network, combining GANs and SENet. It utilizes SVD features to assist the SENet in managing the scaling degree. The SENet employs SVD to extract features and enhance the Excitation operation to obtain new channel attention weights and form attention feature maps. Then, image content features are refined by combining convolutional and attention feature maps, and style features are obtained by the style generator. Finally, content and style features are combined to generate new style images. Ablation experiments showed the optimal SVD parameter is 128, producing the best translation results. According to FID, MASSE outperforms current methods in generating diverse images.

Suggested Citation

  • Hangyao Tu & Zheng Wang & Yanwei Zhao, 2025. "Multimodal Image Translation Algorithm Based on Singular Squeeze-and-Excitation Network," Mathematics, MDPI, vol. 13(1), pages 1-19, January.
    • Handle: RePEc:gam:jmathe:v:13:y:2025:i:1:p:177-:d:1561325
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/1/177/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/13/1/177/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:1:p:177-:d:1561325. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.