Do Deepfake Detectors Work in Reality?
Organizations: Duke University · Georgia Tech · Texas A&M
Abstract
Deepfakes, particularly those involving faceswap-based manipulations, have sparked significant societal concern due to their increasing realism and potential for misuse. Despite rapid advancements in generative models, detection methods have not kept pace, creating a critical gap in defense strategies. This disparity is further amplified by the disconnect between academic research and real-world applications, which often prioritize different objectives and evaluation criteria. In this study, we take a pivotal step toward bridging this gap by presenting a novel observation: the post-processing step of super-resolution, commonly employed in real-world scenarios, substantially undermines the effectiveness of existing deepfake detection methods. To substantiate this claim, we introduce and publish the first real-world faceswap dataset, collected from popular online faceswap platforms. We then qualitatively evaluate the performance of state-of-the-art deepfake detectors on real-world deepfakes, revealing that their accuracy approaches the level of random guessing. Furthermore, we quantitatively demonstrate the significant performance degradation caused by common post-processing techniques. By addressing this overlooked challenge, our study underscores a critical avenue for enhancing the robustness and practical applicability of deepfake detection methods in real-world settings.
Figures & tables
| Source Website | URL | Number of Images |
|---|---|---|
| Pixlr | pixlr.com/face-swap | 81 |
| Magic Hour | magichour.ai/products/face-swap | 104 |
| Remaker | remaker.ai/face-swap-free | 92 |
| AI FaceSwap IO | aifaceswap.io | 71 |
| Ismarta | ismartta.com | 93 |
| Pica | pica-ai.com | 84 |
Deepfake Detection
Deepfake detection identifies manipulated or AI-generated media to support trustworthy communication, identity verification, and forensic analysis.
See all 241 papers