From Pixels to Prompts: Physics-Guided Language Enhancement for AI-Generated Image Detection
Organizations: Artificial Intelligence Research Institute, SDIC Intelligence Co., Ltd., Software Park Phase III, Xiamen, 361024, Fujian, China.
Abstract
AI-generated content (AIGC) has substantially narrowed the visual gap between natural and synthetic images, while existing detectors often rely on generator-specific artifacts and exhibit limited generalization to unseen models. This motivates a fundamental question: which intrinsic physical image characteristics provide stable, discriminative cues for distinguishing natural from AI-generated images? We investigate this by systematically identifying robust physical features and incorporating them into a vision-language representation without external textual prompts at inference. We first analyze 15 handcrafted physical descriptors across images from over 20 generative models. Based on cross-generator stability and real-fake discriminability, we propose a Feature Stability-Discriminability Validation Assessment (FSDVA) to select a compact set of reliable features. Five core features, including Laplacian variance, Sobel statistics, and residual-noise variance, are then used to construct structured textual descriptions encoding physical evidence for CLIP-based learning. We integrate these physics-enriched descriptions with image representations via a native physics-guided multimodal framework, adapting CLIP ViT-L 14 with LoRA. At inference, the model requires only the input image, with no external captions or manual prompts. On GenImage, our method achieves 99.0 percent accuracy on SDv1.4 and 96.7 percent on Wukong, with a mean of 97.23 percent across eight generative models versus 95.8 percent for C2pCLIP under the same setting. On UniversalFakeDetect, it maintains strong, stable generalization across diverse and unseen generation settings. These results show that carefully selected physical image statistics provide complementary forensic evidence to pretrained vision-language representations, enabling interpretable, more generator-agnostic AIGC detection.
Figures & tables
| Method | Ref | Midjourney | SDv1.4 | SDv1.5 | ADM | GLIDE | Wukong | VQDM | BigGAN | mAcc |
|---|---|---|---|---|---|---|---|---|---|---|
| UniFD | CVPR 2023 Ojha and others (2023) | 93.9 | 96.4 | 96.2 | 71.9 | 85.4 | 94.3 | 81.6 | 90.5 | 88.8 |
| NPR | CVPR 2024 Tan and others (2024b) | 81.0 | 98.2 | 97.9 | 76.9 | 89.8 | 96.9 | 84.1 | 84.2 | 88.6 |
| FreqNet | AAAI 2024 Tan and others (2024a) | 89.6 | 98.8 | 98.6 | 66.8 | 86.5 | 87.3 | 75.8 | 81.4 | 86.8 |
| FatFormer | CVPR 2024 Liu and others (2024) | 92.7 | 100.0 | 99.9 | 75.9 | 88.0 | 99.9 | 98.8 | 55.8 | 88.9 |
| C2pClip (Trump.Biden) | AAAI 2025 Tan and others (2025) | 82.2 | 95.1 | 95.5 | 95.1 | 98.9 | 98.7 | 93.8 | 98.3 | 94.7 |
| C2pClip (Deepfake.Camera) | AAAI 2025 Tan and others (2025) | 88.2 | 90.9 | 97.9 | 96.4 | 99.8 | 98.8 | 96.5 | 98.7 | 95.8 |
| Method | Ref | DALLE | Glide | ADM | LDM | mAcc | ||||
|---|---|---|---|---|---|---|---|---|---|---|
| 100_10 | 100_27 | 50_27 | 100_10 | 100_27 | 50_27 | 100 | 200 | 200_cfg | ||
| CNNDet Wang and others (2020a) | CVPR 2020 | 51.8 | 53.3 | 53.0 | 54.2 | 54.9 | 51.9 | 52.0 | 51.6 | 52.8 |
| FreDect Frank and others (2020) | ICML 2020 | 57.0 | 53.6 | 50.4 | 52.0 | 53.4 | 56.6 | 56.4 | 56.5 | 54.5 |
| F3Net Qian and others (2020) | ECCV 2020 | 71.6 | 88.3 | 87.0 | 88.5 | 69.2 | 74.1 | 73.4 | 80.7 | 79.1 |
| LGrad [28] | CVPR 2023 | 88.5 | 89.4 | 87.4 | 90.7 | 86.6 | 94.8 | 94.2 | 95.9 | 90.9 |
| UnivFD Ojha and others (2023) | CVPR 2023 | 89.5 | 90.1 | 90.7 | 91.1 | 75.7 | 90.5 | 90.2 | 77.3 | 86.9 |
AI-Generated Image Detection
AI-generated image detection identifies synthetic or AI-edited images and develops methods that generalize across generators, domains, and image transformations.
See all 203 papers