Organizations: Shenzhen Technology University, Guangdong, China · Singapore Institute of Technology, Singapore, Singapore · The University of Hong Kong, Hong Kong, China · Nanyang Technological University, Singapore, Singapore
The rapid advancement of deepfake generation techniques poses significant threats to public safety and causes societal harm through the creation of highly realistic synthetic facial media. While existing detection methods demonstrate limitations in generalizing to emerging forgery patterns, this paper presents Deepfake Forensics Adapter (DFA), a novel dual-stream framework that synergizes vision-language foundation models with targeted forensics analysis. Our approach integrates a pre-trained CLIP model with three core components to achieve specialized deepfake detection by leveraging the powerful general capabilities of CLIP without changing CLIP parameters: 1) A Global Feature Adapter is used to identify global inconsistencies in image content that may indicate forgery, 2) A Local Anomaly Stream enhances the model's ability to perceive local facial forgery cues by explicitly leveraging facial structure priors, and 3) An Interactive Fusion Classifier promotes deep interaction and fusion between global and local features using a transformer encoder. Extensive evaluations of frame-level and video-level benchmarks demonstrate the superior generalization capabilities of DFA, particularly achieving state-of-the-art performance in the challenging DFDC dataset with frame-level AUC/EER of 0.816/0.256 and video-level AUC/EER of 0.836/0.251, representing a 4.8% video AUC improvement over previous methods. Our framework not only demonstrates state-of-the-art performance, but also points out a feasible and effective direction for developing a robust deepfake detection system with enhanced generalization capabilities against the evolving deepfake threats. Our code is available at https://github.com/Liao330/DFA.git
Figures & tables
Figure 1: The radar chart shows how different models perform across several metrics.
Figure 2: Examples of reenactment, replacement, editing, and synthesis of deepfakes of the human face. [ 25 ]
Figure 3: Overall architecture of the proposed Deepfake Forensics Adapter.
Figure 4: Overview of datasets used for evaluating model performance, including CelebDF-V1, CelebDF-V2, DFDC, DFDCP, and FF++. DFDC is reserved for evaluating generalization capability, while the remaining datasets form the training/validation data.
Method
Acc
Precision
AUC
Avg
CNN [ 30 ]
0.904
0.815
0.890
0.867
Xception [ 12 ]
0.955
0.897
0.962
0.938
ResNeXt-LSTM [ 14 ]
0.967
0.931
0.960
0.953
CViT [ 13 ]
0.941
0.868
0.959
0.923
Efficient-ViT [ 15 ]
0.968
0.932
0.954
0.951
Ours
0.983
0.963
0.976
0.974
Table 1: Frame-level metrics scores of various deepfake detection methods on our Mixed dataset.
Method
AUC
EER ↓
CNN [ 30 ]
0.674
0.370
Xception [ 12 ]
0.752
0.315
ResNeXt-LSTM [ 14 ]
0.754
0.311
CViT [ 13 ]
0.738
0.323
Efficient-ViT [ 15 ]
0.764
0.293
Ours
0.816
0.256
Table 2: Frame-level AUC and EER scores of various deepfake detection methods on the DFDC dataset.
Method
AUC
EER ↓
CNN [ 30 ]
0.698
0.375
Xception [ 12 ]
0.774
0.325
ResNeXt-LSTM [ 14 ]
0.776
0.319
CViT [ 13 ]
0.770
0.323
Efficient-ViT [ 15 ]
0.788
0.300
Ours
0.836
0.251
Table 3: Video-level AUC and EER scores of various deepfake detection methods on the DFDC dataset.
Global
Local
IFC
AUC
EER ↓
×
✓
✓
0.766
0.356
✓
×
✓
0.747
0.323
✓
✓
×
0.753
0.301
✓
✓
✓
0.816
0.256
Table 4: Ablation study on DFA modules: Frame-level results on the DFDC dataset.
Figure 5: Comparison of t-SNE visualizations of features extracted by Xception (left) and our DFA model (right) on samples from the DFDC dataset.
Current deepfake attribution or deepfake detection works tend to exhibit poor generalization to novel generative methods due to the limited exploration in visual modalities alone. They tend to assess the attribution or detection performance of models on unseen advanced generators, coarsely, and fail to consider the synergy of the two tasks. To this end, we propose a novel gaze-guided CLIP with adaptive-enhanced fine-grained language prompts for fine-grained deepfake attribution and detection (DFAD). Specifically, we conduct a novel and fine-grained benchmark to evaluate the DFAD performance of networks on novel generators like diffusion and flow models. Additionally, we introduce a gaze-aware model based on CLIP, which is devised to enhance the generalization to unseen face forgery attacks. Built upon the novel observation that there are significant distribution differences between pristine and forged gaze vectors, and the preservation of the target gaze in facial images generated by GAN and diffusion varies significantly, we design a visual perception encoder to employ the inherent gaze differences to mine global forgery embeddings across appearance and gaze domains. We propose a gaze-aware image encoder (GIE) that fuses forgery gaze prompts extracted via a gaze encoder with common forged image embeddings to capture general attribution patterns, allowing features to be transformed into a more stable and common DFAD feature space. We build a language refinement encoder (LRE) to generate dynamically enhanced language embeddings via an adaptive-enhanced word selector for precise vision-language matching. Extensive experiments on our benchmark show that our model outperforms the state-of-the-art by 6.56% ACC and 5.32% AUC in average performance under the attribution and detection settings, respectively. Codes will be available on GitHub.
Yaning Zhang, Linlin Shen, Zitong Yu +2
Faculty of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250014, China · Computer Vision Institute, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518060, China · National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University +5
The rapid evolution of generative models has enabled the creation of hyper-realistic facial deepfakes, exposing a critical vulnerability in modern digital forensics: the inability of detectors to generalize to unseen manipulation techniques. Traditional networks suffer from representation collapse, overfitting to localized artifact fingerprints of specific training generators. This work investigates whether modern Vision Foundation Models can serve as generalizable, out-of-the-box feature extractors capable of tracking forensic anomalies across entirely unseen generative manifolds. We conduct a systematic cross-domain evaluation comparing three foundational learning paradigms: fully supervised macro-semantic features (RoPE-ViT), pure self-supervised geometric features (DINOv3), and multi-teacher agglomerative representations (NVIDIA C-RADIOv4-H). By deploying frozen backbones subjected to downstream linear probing, we map the performance limitations of these architectures on the challenging DF40 benchmark. Our empirical findings expose the intrinsic trade-offs between pre-training paradigms and parameter scale, proving that while foundation models retain high discriminative capabilities for entire face synthesis, localized face editing techniques expose fundamental boundaries in linear probe evaluation structures. Source code and model weights are available in http://github.com/mribrahim/deepfake
Ibrahim Delibasoglu
Department of Software Engineering, Faculty of Computer and Information Sciences, Sakarya University, Esentepe, Sakarya, 54050 Türkiye.
The malicious use of generative artificial intelligence to create highly realistic deepfake videos raises serious ethical concerns and poses substantial challenges to AI safety. However, existing deepfake video benchmarks provide limited coverage of recent synthesis methods and generally lack reliable fine-grained textual annotations. Meanwhile, conventional detectors and multimodal large language models (MLLMs), whether operating as a single model or relying on a single analytical perspective, often fail to capture subtle forgery artifacts, limiting their generalization to emerging AI-generated methods. To address these limitations, we introduce FaceVid-Forensics-100K, a large-scale deepfake video dataset comprising 100,000 videos and spanning 33 synthesis methods across face swapping, face reenactment, and entire-face synthesis, including recent generators such as Seedance 2.0. The dataset provides fine-grained textual annotations of visual observations and verdict-consistent forensic explanations, automatically synthesized through a multi-model aggregation and conflict-resolution pipeline powered by advanced MLLMs. Building on this benchmark, we propose a multi-agent forensic reasoning framework that employs four specialized domain-expert agents to independently analyze forgery cues from four perspectives: texture, lighting, motion, and physics. A judge agent then reconciles their reports to produce a final prediction together with an explanation. Extensive evaluations on out-of-domain test sets show that, despite being composed entirely of small open-source MLLMs, our framework outperforms all methods including closed-source GPT and Gemini models and ranks first across all reported metrics on this benchmark. The project page is available at https://xavierjiezou.github.io/ARGUS/.
Xuechao Zou, Shun Zhang, Kai Li +6
Beijing Jiaotong University · Tsinghua University · Ant Group