Diffusion-based image super-resolution (ISR) has shown strong potential, but it still struggles in real-world scenarios where degradations are unknown and spatially non-uniform, often resulting in lost details or visual artifacts. To address this challenge, we propose a novel super-resolution diffusion model, QUSR, which integrates a Quality-Aware Prior (QAP) with an Uncertainty-Guided Noise Generation (UNG) module. The UNG module adaptively adjusts the noise injection intensity, applying stronger perturbations to high-uncertainty regions (e.g., edges and textures) to reconstruct complex details, while minimizing noise in low-uncertainty regions (e.g., flat areas) to preserve original information. Concurrently, the QAP leverages an advanced Multimodal Large Language Model (MLLM) to generate reliable quality descriptions, providing an effective and interpretable quality prior for the restoration process. Experimental results confirm that QUSR can produce high-fidelity and high-realism images in real-world scenarios. The source code is available at https://github.com/oTvTog/QUSR.
Figures & tables
Figure 1: Framework of QUSR. (a) Initially, a MLLM is employed to generate quality-aware priors, each describing the content and degradation of the corresponding LQ image. These priors are then processed by a CLIP text encoder to derive quality embeddings. (b) Subsequently,, the LQ image is processed by the QUSR framework. Its core is a single-step denoising UNet that, conditioned on the quality embeddings, predicts the noise residual ( ϵg ) from the guided latent representation ( zg ). Furthermore, the UEM generates an uncertainty map to construct adaptive noise perturbations, guiding the model to focus more on complex regions of the image during restoration.
Datasets
Method
PSNR ↑
SSIM ↑
LPIPS ↓
FID ↓
CLIPIQA ↑
MUSIQ ↑
MANIQA ↑
RealSR
StableSR [ 15 ]
24.69
0.7052
0.3091
127.20
0.6195
65.42
0.6211
SeeSR [ 22 ]
25.33
0.7273
0.2985
125.66
0.6594
69.37
0.6439
SinSR [ 18 ]
26.30
0.7354
0.3212
137.05
0.6204
60.41
0.5389
OSEDiff [ 21 ]
25.15
0.7341
0.2921
123.50
0.6693
69.09
0.6339
PiSA-SR [ 14 ]
25.50
0.7414
0.2672
124.09
0.6702
70.15
0.6560
Ours
25.54
0.7289
0.2974
125.27
0.6824
69.17
0.6564
Table 1: Quantitative comparison among the state-of-the-art DM-based SR methods on real-world test datasets. The best and second-best results are highlighted in red and blue , respectively. The symbols ↑ and ↓ denote that higher and lower values are preferable, respectively.
Figure 2: Visual comparison of our method (QUSR) with SOTA methods on the RealSR and DRealSR datasets.
Method
PSNR ↑
SSIM ↑
CLIPIQA ↑
MUSIQ ↑
MANIQA ↑
w/o QAP
30.19
0.8206
0.6853
66.63
0.6318
w/o UNG
29.74
0.8179
0.6906
66.58
0.6392
Baseline
29.05
0.8071
0.6745
65.54
0.6268
Ours
29.81
0.8200
0.7082
67.00
0.6415
Table 2: Ablation study of Quality-Aware Prior and Uncertainty.
Real-world image super-resolution (Real-ISR) aims to reconstruct high-quality (HQ) images from low-quality (LQ) inputs subject to diverse real-world degradations. Recent advances have leveraged the LQ inputs and natural image priors learned by Stable Diffusion models to achieve impressive results. However, existing methods often overlook insufficient clarity of LQ inputs inevitably induce content drift in the generated HQ images. This manifests primarily as visual detail degradation and textual semantic shift, severely compromising both fidelity and perceptual quality. To address this challenge, we propose FSP-Diff, a novel one-step diffusion model featuring a dual-pathway architecture. This architecture comprises a Detail-Conditioned Pathway for injecting structured details to recover fine structures, and a Detail-Modulated Semantic Pathway that refines semantic guidance using structured details to mitigate semantic deviations. Extensive experiments on standard Real-ISR benchmarks demonstrate that FSP-Diff surpasses existing one-step diffusion methods in both quantitative and qualitative metrics.
Real-world image super-resolution is particularly challenging for diffusion models because real degradations are complex, heterogeneous, and rarely modeled explicitly. We propose a degradation-aware and structure-preserving diffusion framework for real-world SR. Specifically, we introduce Degradation-aware Token Injection, which encodes lightweight degradation statistics from low-resolution inputs and fuses them with semantic conditioning features, enabling explicit degradation-aware restoration. We further propose Spatially Asymmetric Noise Injection, which modulates diffusion noise with local edge strength to better preserve structural regions during training. Both modules are lightweight add-ons to the adopted diffusion SR framework, requiring only minor modifications to the conditioning pipeline. Experiments on DIV2K and RealSR show that our method delivers competitive no-reference perceptual quality and visually more realistic restoration results than recent baselines, while maintaining a favorable perception--distortion trade-off. Ablations confirm the effectiveness of each module and their complementary gains when combined. The code and model are publicly available at https://github.com/jiyang0315/DASP-SR.git.
Yang Ji, Zonghao Chen, Zhihao Xue +1
KUNBYTE Hangzhou, Zhejiang Province, China · GOLDMYE Xuhui District, Shanghai, China
The perception-distortion trade-off poses a fundamental challenge in single-image super-resolution (SR). Although diffusion-based SR methods excel at generating perceptually realistic images, achieving high fidelity remains a key limitation. Recent advances in diffusion-based SR have shown promise in improving fidelity, but these methods often compromise perceptual quality due to their high reliance on a high-fidelity image. To address this, we introduce UGDiff, a novel diffusion guidance paradigm designed to further improve the perception-distortion balance. In particular, we first estimate the reconstruction uncertainty of the latent features corresponding to a high-fidelity image. This uncertainty is then used to guide the diffusion process to selectively restore high-frequency details in high-uncertainty regions, while preserving fidelity elsewhere. Furthermore, our guidance method adaptively identifies the high-uncertainty regions by considering not only the estimated uncertainty but also the posterior variance of the diffusion sampler at each timestep. This relaxes the reliance on the high-fidelity image in the later stages of sampling, thereby achieving a better perception-distortion balance. Extensive experimental results demonstrate that our method performs favorably against state-of-the-art diffusion-based SR methods.
Ren Wang, Yung-Yu Chuang
National Taiwan University · National Taiwan University, NTU AI-CoRE