IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i16p2462-d1453005.html
   My bibliography  Save this article

Universal Network for Image Registration and Generation Using Denoising Diffusion Probability Model

Author

Listed:
  • Huizhong Ji

    (Department of Mechanical, Electrical and Information Engineering, Shandong University, Weihai 264209, China
    These authors contributed equally to this work.)

  • Peng Xue

    (Department of Mechanical, Electrical and Information Engineering, Shandong University, Weihai 264209, China
    These authors contributed equally to this work.)

  • Enqing Dong

    (Department of Mechanical, Electrical and Information Engineering, Shandong University, Weihai 264209, China)

Abstract

Classical diffusion model-based image registration approaches require separate diffusion and deformation networks to learn the reverse Gaussian transitions and predict deformations between paired images, respectively. However, such cascaded architectures introduce noisy inputs in the registration, leading to excessive computational complexity and issues with low registration accuracy. To overcome these limitations, a diffusion model-based universal network for image registration and generation (UNIRG) is proposed. Specifically, the training process of the diffusion model is generalized as a process of matching the posterior mean of the forward process to the modified mean. Subsequently, the equivalence between the training process for image generation and that for image registration is verified by incorporating the deformation information of the paired images to obtain the modified mean. In this manner, UNIRG integrates image registration and generation within a unified network, achieving shared training parameters. Experimental results on 2D facial and 3D cardiac medical images demonstrate that the proposed approach integrates the capabilities of image registration and guided image generation. Meanwhile, UNIRG achieves registration performance with NMSE of 0.0049, SSIM of 0.859, and PSNR of 27.28 on the 2D facial dataset, along with Dice of 0.795 and PSNR of 12.05 on the 3D cardiac dataset.

Suggested Citation

  • Huizhong Ji & Peng Xue & Enqing Dong, 2024. "Universal Network for Image Registration and Generation Using Denoising Diffusion Probability Model," Mathematics, MDPI, vol. 12(16), pages 1-16, August.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:16:p:2462-:d:1453005
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/16/2462/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/16/2462/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xining Zhu & Lin Zhang & Lijun Zhang & Xiao Liu & Ying Shen & Shengjie Zhao, 2020. "GAN-Based Image Super-Resolution with a Novel Quality Loss," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-12, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pei-Fen Tsai & Huai-Nan Peng & Chia-Hung Liao & Shyan-Ming Yuan, 2023. "Full-Reference Image Quality Assessment with Transformer and DISTS," Mathematics, MDPI, vol. 11(7), pages 1-15, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:16:p:2462-:d:1453005. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.