ScenePercept: Scenario-Conditioned Perceptual Assessment of Real-World User-Generated Content Images
Organizations: Beijing University of Posts and Telecommunications · Amap, Alibaba Group
Abstract
The rapid development of mobile imaging and social platforms has led to explosive growth in user-generated content images, making their systematic and comprehensive perceptual assessment increasingly important. Existing image perception benchmarks are typically task-oriented, curating specific scenarios for quality or aesthetic assessment and applying a uniform perceptual criterion across diverse scenarios. This limits their ability to capture the scene diversity and perceptual complexity of real-world UGC images. To address these limitations, we introduce ScenePercept-Bench, a benchmark designed to reflect the distribution of real-world UGC images, comprising 23,100 images across 21 categories and 105 fine-grained scenes. To account for the influence of scene context on human perception, we design a hierarchical, scene-aware annotation protocol, covering visual quality, aesthetic perception, and scene semantics, with 15 attributes in total. Each image is annotated with an overall score, 15 attribute-level scores, and structured explanatory reasoning. Building on this benchmark, we further introduce Scenario-Conditioned Perceptual Alignment, a training framework that tackles the heterogeneity of perceptual criteria across scenarios. SCPA jointly optimizes absolute score prediction, preference ranking, and cross-scenario calibration, preserving the model general perceptual assessment ability while encouraging it to explore and adapt perceptual criteria across different scenarios. Extensive experiments demonstrate that SCPA achieves state-of-the-art performance in UGC image perception and generalizes effectively to established IQA and IAA benchmarks.
Figures & tables
| Dataset | Source | Scen. | Score | Reason. | Attr. |
|---|---|---|---|---|---|
| AVA | Photography | – | ✓ | ✗ | – |
| TAD66K | Photography | 47 | ✓ | ✗ | – |
| KonIQ | Photography | – | ✓ | ✗ | – |
| FLICKR | Photography | 9 | ✓ | ✗ | – |
| UniPercept | Photography | 17 | ✓ | ✓ | 13 |
| RealQA | UGC | – | ✓ | ✓ | 10 |
| Model | Spearman | Within-0.5 Rate | Within-1.0 Rate |
|---|---|---|---|
| Qwen-series | 0.892 | 0.898 | 0.990 |
| Gemini-3 | 0.928 | 0.918 | 0.988 |
| GPT-5.3 | 0.960 | 0.964 | 0.990 |
| Category | Methods | ScenePercept-Bench | TAD66K | AVA | KonIQ | FLICKR-AES |
|---|---|---|---|---|---|---|
| Proprietary Models | Gemini-2.5-pro | 0.574 / 0.593 | 0.143 / 0.037 | 0.248 / 0.100 | 0.582 / 0.316 | 0.357 / 0.206 |
| Gemini-3-flash | 0.712 / 0.735 | 0.286 / 0.289 | 0.483 / 0.479 | 0.703 / 0.703 | 0.614 / 0.608 | |
| GPT-4o | 0.638 / 0.651 | 0.278 / 0.282 | 0.509 / 0.485 | 0.695 / 0.744 | 0.605 / 0.597 | |
| GPT-5.3 | 0.763 / 0.771 | 0.299 / 0.306 | 0.525 / 0.516 | 0.719 / 0.705 | 0.630 / 0.642 | |
| Open-source Models | Qwen2.5-VL-7B | 0.516 / 0.538 | 0.208 / 0.195 | 0.359 / 0.324 | 0.708 / 0.762 | 0.588 / 0.520 |
| Qwen3-VL-8B | 0.504 / 0.512 | 0.191 / 0.121 | 0.280 / 0.170 | 0.761 / 0.822 | 0.507 / 0.388 |
| ScenePercept-Bench | TAD66K | AVA | KonIQ | FLICKR-AES | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SRCC | PLCC | SRCC | PLCC | SRCC | PLCC | SRCC | PLCC | SRCC | PLCC | |||
| ✓ | ✓ | ✗ | 0.892 | 0.892 | 0.303 | 0.316 | 0.520 | 0.520 | 0.707 | 0.706 | 0.647 | 0.642 |
| ✓ | ✗ | ✓ | 0.898 | 0.897 | 0.310 | 0.313 | 0.518 | 0.509 | 0.703 | 0.710 | 0.639 | 0.664 |
| ✗ | ✓ | ✓ | 0.898 | 0.895 | 0.288 | 0.290 | 0.500 | 0.478 | 0.714 | 0.703 | 0.632 | 0.644 |
| ✓ | ✓ | ✓ | 0.907 | 0.907 | 0.304 | 0.317 | 0.529 | 0.524 | 0.724 | 0.715 | 0.647 | 0.668 |
| Methods | ScenePercept-Bench | Human Subset |
|---|---|---|
| Qwen-series | 0.562 | 0.543 |
| Gemini-3-flash | 0.712 | 0.699 |
| GPT-5.3 | 0.763 | 0.756 |
| RAPO | 0.890 | 0.874 |
| SCPA | 0.907 | 0.895 |
| Setting | Full Test SRCC | Full Test PLCC |
|---|---|---|
| Correct Scenario | 0.907 | 0.907 |
| Remove Scenario | 0.869 | 0.874 |
| Shuffled Scenario | 0.701 | 0.711 |