FeatDistill: A Feature Distillation Enhanced Multi-Expert Ensemble Framework for Robust AI-generated Image Detection
Organizations: School of Computer Science and Engineering, University of Electronic Science and Technology of China · State Key Laboratory of Internet of Things for Smart City, University of Macau · Department of Information Engineering, University of Florence
Abstract
The rapid iteration and widespread dissemination of deepfake technology have posed severe challenges to information security, making robust and generalizable detection of AI-generated forged images increasingly important. In this paper, we propose FeatDistill, an AI-generated image detection framework that integrates feature distillation with a multi-expert ensemble, developed for the NTIRE Challenge on Robust AI-Generated Image Detection in the Wild. The framework explicitly targets three practical bottlenecks in real-world forensics: degradation interference, insufficient feature representation, and limited generalization. Concretely, we build a four-backbone Vision Transformer (ViT) ensemble composed of CLIP and SigLIP variants to capture complementary forensic cues. To improve data coverage, we expand the training set and introduce comprehensive degradation modeling, which exposes the detector to diverse quality variations and synthesis artifacts commonly encountered in unconstrained scenarios. We further adopt a two-stage training paradigm: the model is first optimized with a standard binary classification objective, then refined by dense feature-level self-distillation for representation alignment. This design effectively mitigates overfitting and enhances semantic consistency of learned features. At inference time, the final prediction is obtained by averaging the probabilities from four independently trained experts, yielding stable and reliable decisions across unseen generators and complex degradations. Despite the ensemble design, the framework remains efficient, requiring only about 10 GB peak GPU memory. Extensive evaluations in the NTIRE challenge setting demonstrate that FeatDistill achieves strong robustness and generalization under diverse ``in-the-wild'' conditions, offering an effective and practical solution for real-world deepfake image detection.
Figures & tables
| Split | # Generators | # Distortions | Distortion Profile | Labels | Role |
|---|---|---|---|---|---|
| Toy | 10 | 0 | Clean only | Yes | Debug/sanity check |
| Training | 20 | 0 | Clean only | Yes | Supervised training |
| 1st Validation | 25 | 5 | Unseen simple distortions | No | Model selection |
| Hard Validation | 25 | 5 | Harder simple distortions | No | Robust validation |
| Public Test | 30 | 7 | Unknown mixed distortions | No | Public leaderboard |
| Private Test | 35 | 9 | Unknown mixed, hardest setting | No | Final ranking |
| Online Validation | Online Test | ||||
| Backbone | Architecture | Parameters | Dense Labels | Robust ROC AUC | Robust Hard ROC AUC |
| Swin-T | Transformer | 28M | No | 0.785 | N/A |
| CLIP-RN50x64 | CNN | 420M | No | 0.828 | N/A |
| MOCOV3 | Transformer | 86M | No | 0.851 | N/A |
| CONVNEXT | CNN | 89M | No | 0.855 | N/A |
| BEIT | Transformer | 86M | No | 0.857 | N/A |
AI-Generated Image Detection
AI-generated image detection identifies synthetic or AI-edited images and develops methods that generalize across generators, domains, and image transformations.
See all 194 papers