Traditional Image Quality Assessment (IQA) metrics typically fall into one of two extremes: rigid, hand-crafted mathematical models or "black-box" deep learning architectures that completely lack interpretability. To bridge this gap, we propose EvoIQA, a fully explainable symbolic regression framework based on Genetic Programming that Evolves explicit, human-readable mathematical formulas for image quality assessment (IQA). Utilizing a rich terminal set from the VSI, VIF, FSIM, and HaarPSI metrics, our framework inherently maps structural, chromatic, and information-theoretic degradations into observable mathematical equations. Our results demonstrate that the evolved GP models consistently achieve strong alignment between the predictions and human visual preferences. Furthermore, they not only outperform traditional hand-crafted metrics but also achieve performance parity with complex, state-of-the-art deep learning models like DB-CNN, proving that we no longer have to sacrifice interpretability for state-of-the-art performance.
Figures & tables
Figure 1: Hierarchical Decomposition of JPEG2000 (JP2K) Compression. Each row illustrates the transition from visual artifacts to spatial weight maps and their corresponding AGGD signatures. Note the heavy compression in Row 1 results in a sharper peaked distribution.
Symbol
Feature Name
Perceptual Significance
σgm,σˉSgm2
Gradient Fidelity
Scharr-filtered similarity maps, quantifying total distortion energy and local edge consistency.
μSmn,σSmn
Chromatic Integrity
LMN-space chromatic similarity, tracking global color shifts and local artifacts to isolate perceived color degradation from luminance fluctuations.
∇ref
Ref. Gradient
Gradient magnitude of the reference image, acting as a structural weighting factor.
μΔC
Chromatic NSS
Mean DKL of AGGD-fitted PDFs derived from 2×2 average-pooled I and Q chrominance channels, quantifying statistical chromatic shift.
μPCmax
PC Saliency
Maximum phase congruency to identify salient regions - max(PCr,PCd) .
Table 1: Definitions of the perceptual primitives in the MEvoIQA-Full metric.
Symbol
Feature Name
Perceptual Significance
Δcs
Chromatic-Structural Divergence
Quantifies discrepancy between chromatic and structural loss: Δcs=μSmn−μSgm .
Ωcv
Coeff. of Variation of structural similarity
Penalizes localized artifacts (e.g., JPEG blocks) over uniform noise as shown in Figure 3 . Ωcv=σSgm/μSgm .
Table 2: Definitions of the perceptual primitives in the MEvoIQA-Subset metric.
Figure 2: Qualitative comparison of color saturation artifacts in an unseen KADID-10k dataset. The reference image (left) is compared against five increasing levels of saturation distortion. While the structural HaarPSI baseline remains invariant to the last chromatic shift, our EvoIQA models leverage a learned feature subset —specifically the evolved Chrominance Similarity ( Smn ) maps—to successfully track perceptual degradation. The resulting predictions show a high monotonic alignment with human Mean Opinion Scores (MOS), whereas the baseline results (highlighted in red ) fail to capture the intensity of the distortion.
Figure 3: Localized vs. Global Distortion Analysis. Comparison of global noise (a) and local block distortion (b). While HaarPSI (c, e) blurs artifacts through multi-resolution pooling, our VSI Gradient map ( sgm ) explicitly isolates unnatural edge discontinuities (d, f). Under identical means ( μ≈0.98 ), localized blocks trigger a 2× spike in standard deviation ( σ=0.11 vs. 0.05 ). This Gradient Heterogeneity allows our evolved GP model (Eq. 16 ) to penalize structural collapse via the Coefficient of Variation ( Ωcv=σgm/μgm ), identifying distortions that traditional pooling obscures.
Method
Model Type
SROCC
SSIM [ 61 ]
Manual (Traditional)
0.6400
MS-SSIM [ 64 ]
Manual (Traditional)
0.7915
FSIM [ 73 ]
Manual (Traditional)
0.8016
HaarPSI [ 51 ]
Manual (Traditional)
0.8662
BRISQUE [ 20 ] ∗
No-Reference (NR)
0.5746
MEON †
Deep Learning (Black-Box)
0.8800
Table 3: Performance comparison (SROCC) on the TID2013 test partition. All methods report the mean performance across 30 independent runs , using randomized reference-based partitioning ( 20% held-out test set per run). † DL baselines are cited from [ 74 ] (comparable 10-run 80/20 protocol). ∗ BRISQUE was independently trained using a 10-run protocol.
Method
KADID-10k
CSIQ
CID:IQ
VDID
SS-SSIM
0.720
0.864
0.773
0.895
MS-SSIM
0.800
0.913
0.793
0.901
FSIM
0.830
0.924
0.779
0.926
HaarPSI
0.890
0.956
0.755
0.920
Random Forest
0.886
0.894
0.670
0.904
SVR
0.778
0.880
0.511
0.857
Table 4: Cross-dataset SROCC Performance Comparison. All models were trained on the TID2013 reference dataset to evaluate generalization capability. For EvoIQA, we report the Mean ± Standard Deviation across 30 runs, with the Maximum Absolute SROCC achieved shown in brackets. Both Random Forest and SVR were trained on the feature subset used by Evo-IQA Subset .
Distortion Category
MEON
DB-CNN
HaarPSI
EvoIQA Full (Ours)
Additive Gaussian noise
0.813
0.790
0.943
0.952
Additive noise in color components
0.722
0.700
0.867
0.886
Spatially correlated noise
0.926
0.826
0.941
0.943
Masked noise
0.728
0.646
0.773
0.750
High frequency noise
0.911
0.879
0.913
0.928
Impulse noise
0.901
0.708
0.885
0.870
Table 5: Performance comparison (SROCC) across all 24 TID2013 test partition distortion categories. Results represent the mean across 30 independent runs. Rows highlighted in green indicate categories where EvoIQA Full achieves the highest correlation. Deep learning baselines (MEON, DB-CNN) are cited from [ 74 ] . The results are statistically significant with ( p<0.05 ).
Dataset
Category
HaarPSI
EvoIQA Full (Mean [Max])
KADID-10k
Blurs
0.9389
0.9223 [0.9354]
Color Distortions
0.7875
0.7609 [0.8107]
Compression
0.9174
0.8824 [0.9003]
Noise
0.9181
0.8964 [0.9115]
Brightness Change
0.8406
0.8217 [0.8396]
Spatial Distortions
0.6662
0.5975 [0.6359]
Table 6: Cross-dataset SROCC Performance Comparison. Results are reported as the Mean [Maximum] performance across 30 independent runs. Rows highlighted in green indicate categories where the EvoIQA Full outperforms the HaarPSI baseline; bolded values indicate where the EvoIQA Full Max exceeds the baseline.
Configuration
SROCC
Δ SROCC
EvoIQA Full
0.8898
—
EvoIQA Full (Pearson Correlation Fitness)
0.8863
-0.0035
Non-Linear Operators ( log,exp )
0.8894
-0.0004
Reduced Population ( N=200 )
0.8825
-0.0073
Cold-Start (No Init. Sec. 3.3 , N=200 )
0.8810
-0.0088
Table 7: Ablation Study of Hyper-parameters on TID2013 test
Multi-modal large language models (MLLMs) have demonstrated significant potential in image quality assessment (IQA) by bridging visual perception with descriptive evaluations. However, existing approaches mainly focus on holistic quality prediction, often functioning as black boxes that provide limited insight into where distortions occur and how they affect perceived quality, hindering fine-grained analysis of localized and heterogeneous degradations. We propose GS-IQA, a framework that reformulates IQA as a progressive Where--What--How diagnosis, emulating the human perceptual process from an initial glance to closer scrutiny. Since a severity judgment is meaningful only for a correctly localized and recognized region, we realize this progression through a two-stage reinforcement learning paradigm that respects such dependencies: the glance stage uses a perception-gated reward to establish where degradations lie and what they are, activating severity feedback only once both are correct, while the scrutiny stage introduces online reward-conditioned degradation generation to synthesize hard examples targeted at the model's perceptual bottlenecks, sharpening its discrimination of subtle severity variations. To enable systematic evaluation, we construct Diag-Bench, a region-level IQA benchmark of about 25K curated samples spanning 12 distortion types and five ordinal severity levels. Extensive experiments show that GS-IQA consistently surpasses state-of-the-art methods in distortion localization, recognition, and severity estimation, and that its diagnostic representations transfer effectively to conventional global quality prediction across diverse external benchmarks. Code and data will be released.
Aoting Zhang, Mingze Gao, Dongbao Yang +5
IIE, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Xiaohongshu Inc. +1
Traditional image quality assessment (IQA) methods rely on mean opinion scores (MOS), which are resource-intensive to collect and fail to provide interpretable, localized feedback on specific image distortions. We overcome these limitations by shifting from absolute quality prediction to a relational and directional assessment. Our approach utilizes a self-supervised synthetic distortion engine to generate training data, eliminating the need for manual annotation. A distortion prediction network is trained with an anti-symmetric objective to produce spatially-aware, disentangled maps that identify the type, intensity, and direction of distortions relative to a reference image. Subsequently, a scoring network is trained via contrastive learning on ordinally ranked image sets to predict a relational quality score. Our method provides a more granular and interpretable approach to IQA for the targeted optimization of image processing algorithms without requiring any human-labeled quality scores.
Fadeel Sher Khan, Long N. Le, Abhinau K. Venkataramanan +2
The University of Texas at Austin Austin, TX, USA · Samsung Research America Plano, TX, USA
Image Quality Assessment (IQA) is a long-standing problem in computer vision. Previous methods typically focus on predicting numerical scores without explanation or providing low-level descriptions lacking precise scores. Recent reasoning-based vision language models (VLMs) have shown strong potential for IQA by jointly generating quality descriptions and scores. However, existing VLM-based IQA methods often suffer from unreliable reasoning due to their limited capability of integrating visual and textual cues. In this work, we introduce Zoom-IQA, a VLM-based IQA model to explicitly emulate key cognitive behaviors: uncertainty awareness, region reasoning, and iterative refinement. Specifically, we present a two-stage training pipeline: 1) supervised fine-tuning (SFT) on our Grounded-Rationale-IQA (GR-IQA) dataset to teach the model to ground its assessments in key regions, and 2) reinforcement learning (RL) for dynamic policy exploration, stabilized by our KL-Coverage regularizer to prevent reasoning and scoring diversity collapse, with a Progressive Re-sampling Strategy for mitigating annotation bias. Extensive experiments show that Zoom-IQA achieves improved robustness, explainability, and generalization. The application to downstream tasks, such as image restoration, further demonstrates the effectiveness of Zoom-IQA.
Guoqiang Liang, Jianyi Wang, Zhonghua Wu +2
National University of Singapore · S-Lab, Nanyang Technological University, Singapore · SenseTime Research