VGIQA: Fine-Grained Image Quality Assessment with Visual Grounding Rewards
Organizations: State Key Laboratory of Integrated Services Networks, Xidian University · Huawei Foundation Model Department
Abstract
Image quality assessment (IQA) aims to evaluate the perceptual visual quality of images. Recently, the rapid development of Multi-modal Large Language Models (MLLMs) has significantly advanced the IQA field. By integrating chain-of-thought (CoT) reasoning and reinforcement learning (RL), these models can generate more accurate and interpretable results while relying on less training data. However, existing MLLM-based methods are predominantly constrained to holistic, image-level evaluations and lack the capability to produce fine-grained, localized assessments, which substantially limits their practical applicability. To address this limitation, we propose VGIQA, a novel IQA model endowed with both local and global quality assessment capabilities. VGIQA is trained via a two-stage paradigm comprising a cold-start phase followed by reinforcement learning. Driven by carefully designed local quality assessment reward functions, our model exhibits exceptional image quality understanding on VGSR-2K, a new dataset we propose specifically for local quality evaluation, significantly outperforming existing open-source MLLMs such as Qwen2.5-VL-72B-Instruct and Qwen3-VL-32B-Instruct. Furthermore, the local quality evaluation task can effectively enhance the model's performance on the degradation perception task.
Figures & tables
| Method | Metrics | Blur | JPEG | Darken | Noise | Null | Average |
|---|---|---|---|---|---|---|---|
| Q-Insight [ 18 ] | Deg.Acc. | 91.48% | 98.02% | 63.23% | 16.13% | 64.93% | 66.57% |
| Lev.Acc. | 43.05% | 46.04% | 22.70% | 6.91% | - | 34.23% | |
| VGIQA (Ours) | Deg.Acc. | 94.17% | 98.51% | 67.71% | 62.21% | 94.03% | 82.18% |
| Lev.Acc. | 52.91% | 44.55% | 23.77% | 23.96% | - | 43.94% |
| Method | KonIQ | SPAQ | KADID | PIPAL | LIVE-Wild | AGIQA-3K | CSIQ | Average |
|---|---|---|---|---|---|---|---|---|
| NIQE [ 13 ] | 0.533/0.530 | 0.679/0.664 | 0.468/0.405 | 0.195/0.161 | 0.493/0.449 | 0.560/0.533 | 0.718/0.628 | 0.521/0.481 |
| BRISQUE [ 22 ] | 0.225/0.226 | 0.490/0.406 | 0.429/0.356 | 0.267/0.232 | 0.361/0.313 | 0.541/0.497 | 0.740/0.556 | 0.436/0.369 |
| NIMA [ 36 ] | 0.896/0.859 | 0.838/0.856 | 0.532/0.535 | 0.390/0.399 | 0.814/0.771 | 0.715/0.654 | 0.695/0.649 | 0.697/0.675 |
| MUSIQ [ 15 ] | 0.924/0.929 | 0.868/0.863 | 0.575/0.556 | 0.431/0.431 | 0.789/0.830 | 0.722/0.630 | 0.771/0.710 | 0.726/0.707 |
| CLIP-IQA+ [ 37 ] | 0.909/0.895 | 0.866/0.864 | 0.653/0.654 | 0.427/0.419 | 0.832/0.805 | 0.736/0.685 | 0.772/0.719 | 0.742/0.720 |
| ManIQA [ 45 ] | 0.849/0.834 | 0.768/0.758 | 0.499/0.465 | 0.457/0.452 | 0.849/0.832 | 0.723/0.636 | 0.623/0.627 | 0.681/0.658 |
| Method | Metrics | Blur | JPEG | Darken | Noise | null | Average |
|---|---|---|---|---|---|---|---|
| Global-only | Deg.Acc. | 51.12% | 97.52% | 43.05% | 43.78% | 72.39% | 59.96% |
| Lev.Acc. | 25.11% | 45.05% | 14.08% | 27.19% | - | 33.63% | |
| Global + Local (Ours) | Deg.Acc. | 94.17% | 98.51% | 67.71% | 62.21% | 94.03% | 82.18% |
| Lev.Acc. | 52.91% | 44.55% | 23.77% | 23.96% | - | 43.94% |
| System Prompt (Shared) |
| A conversation between User and Assistant. The user asks a question, and the Assistant solves it. The assistant first thinks about the reasoning process in the mind and then provides the user with the answer. The reasoning process and answer are enclosed within <think> </think> and <answer> </answer> tags, respectively, i.e., <think> reasoning process here </think><answer> answer here </answer> . |
| Prompt for Local Quality Assessment (Ours) |
| You are an expert in super-resolution (SR) image quality assessment. You are provided with: |
| First image: Low-Resolution (LR) reference image (ground truth basis) |
| Second image: Super-Resolved (SR) output image |
| Your task is to carefully compare the two images to detect, localize, and evaluate all regions in the SR image where the generation is problematic (e.g., hallucinations, distortions, or objective degradations). |
Image Quality Assessment
Image Quality Assessment measures perceived image quality, distortion, and usefulness with computational metrics and human-aligned evaluation.
See all 175 papers