IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i4p816-d1059086.html
   My bibliography  Save this article

Frequency Domain Filtered Residual Network for Deepfake Detection

Author

Listed:
  • Bo Wang

    (School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China)

  • Xiaohan Wu

    (School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China)

  • Yeling Tang

    (School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China)

  • Yanyan Ma

    (School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China)

  • Zihao Shan

    (Independent Researcher, 1 Hacker Way, Menlo Park, CA 94560, USA)

  • Fei Wei

    (School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore)

Abstract

As deepfake becomes more sophisticated, the demand for fake facial image detection is increasing. Although great progress has been made in deepfake detection, the performance of most existing deepfake detection methods degrade significantly when these methods are applied to detect low-quality images for the disappearance of key clues during the compression process. In this work, we mine frequency domain and RGB domain information to specifically improve the detection of low-quality compressed deepfake images. Our method consists of two modules: (1) a preprocessing module and (2) a classification module. In the preprocessing module, we utilize the Haar wavelet transform and residual calculation to obtain the mid-high frequency joint information and fuse the frequency map with the RGB input. In the classification module, the image obtained by concatenation is fed to the convolutional neural network for classification. Because of the combination of RGB and frequency domain, the robustness of the model has been greatly improved. Our extensive experimental results demonstrate that our approach can not only achieve excellent performance when detecting low-quality compressed deepfake images, but also maintain great performance with high-quality images.

Suggested Citation

  • Bo Wang & Xiaohan Wu & Yeling Tang & Yanyan Ma & Zihao Shan & Fei Wei, 2023. "Frequency Domain Filtered Residual Network for Deepfake Detection," Mathematics, MDPI, vol. 11(4), pages 1-13, February.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:4:p:816-:d:1059086
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/4/816/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/4/816/
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Eun-Gi Lee & Isack Lee & Seok-Bong Yoo, 2023. "ClueCatcher: Catching Domain-Wise Independent Clues for Deepfake Detection," Mathematics, MDPI, vol. 11(18), pages 1-17, September.
    2. Muhammad Asad Arshed & Ayed Alwadain & Rao Faizan Ali & Shahzad Mumtaz & Muhammad Ibrahim & Amgad Muneer, 2023. "Unmasking Deception: Empowering Deepfake Detection with Vision Transformer Network," Mathematics, MDPI, vol. 11(17), pages 1-13, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:4:p:816-:d:1059086. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.