Generative-prior-based super-resolution (SR) methods leverage implicit knowledge learned from large-scale models to enhance low-resolution inputs. However, such priors are inherently stochastic and optimized for diverse generation, conflicting with the deterministic, high-fidelity reconstruction required for SR. It is also tied to the base model, costly to update, and prone to hallucinations as real-world data evolves. To address these limitations, we introduce WorldSR, a novel framework that augments SR with explicit, entity-aligned visual world knowledge. WorldSR automatically decomposes the input into semantic entities and performs entity-wise retrieval of structurally and semantically aligned images from a large-scale external corpus. For efficiency and reliability, we incorporate a memory mechanism to reuse previously retrieved results and a multi-step filtering process to refine candidate references. The selected references as world knowledge are then integrated through a novel multi-reference super-resolution model, which provides fine-grained constraints for detail synthesis and structural recovery. Experiments on real-world SR benchmarks show that WorldSR consistently improves structural fidelity and visual quality, outperforming existing generative super-resolution methods. Our results suggest that entity-level grounding in external visual world knowledge provides a simple and effective complement to model-bound generative priors.
Figures & tables
Figure 1: We propose WorldSR, a framework that integrates explicit, entity-aligned visual world knowledge into the super-resolution to mitigate hallucinations and enhance super-resolution quality.
Figure 2: Overview of the WorldSR pipeline.
Figure 3: The World-Grounded Image Super-Resolution Model and its training pipeline.
Figure 4: Qualitative comparison on RealLQ250, Face, Bird, WRSR and CUFED5 datasets.
Dataset
Method
MUSIQ ↑
CLIPIQA ↑
MANIQA ↑
RALI ↑
Q-Insight ↑
IDS ↑
1
RealLQ250
SeeSR + ReFIR + World Knowledge
69.72
0.6792
0.4756
3.8620
3.9227
-
2
Ada-RefSR + World Knowledge
67.35
0.6351
0.3852
3.8221
3.9168
-
3
Ours
73.32
0.7649
0.5954
3.9940
4.0270
-
4
Ours (w/o Iterative Refinement Loop)
73.23
0.7621
0.5928
3.9862
4.0257
-
5
Ours (w/o Agentic ROI Planner)
73.13
0.7654
0.5968
3.9688
4.0176
-
6
Ours (w/o World Knowledge Searcher)
72.14
0.7527
0.5910
3.8777
3.9824
-
Table 2: Ablation studies of WorldSR on the RealLQ250, Face and Bird datasets.
Figure 5: Qualitative results of the ablation studies on the RealLQ250, Face, and Bird datasets.
Appendix figures & tables17 assets
Supplementary material from the paper’s appendix.
Appendix
Agentic ROI Planner
Memory Verifier
World Knowledge Searcher
World Knowledge Filter
Image Super-Resolution Model
Inference Time
∼ 1 min
∼ 1 s
∼ 15 min
∼ 10 min
∼ 15 s
GPU Memory
∼ 72 GB
N/A
N/A
∼ 33 GB
∼ 40 GB
Appendix
Table 3: GPU memory usage and inference time for each module.
Setting
Time/Img
PSNR ↑
SSIM ↑
LPIPS ↓
RALI ↑
Q-Insight ↑
IDS ↑
HS ↑
w/o Filter
∼ 4.1 min
22.48
0.6636
0.3854
4.1280
4.0614
0.6577
3.94
Kweb=30
∼ 2.3 min
22.54
0.6697
0.3496
4.2611
4.1917
0.8015
4.12
Kweb=60
∼ 3.5 min
22.50
0.6703
0.3472
4.2624
4.1920
0.8065
4.17
Kweb=120 (default)
∼ 6.1 min
22.97
0.6879
0.3408
4.2522
4.1917
0.8199
4.47
Appendix
Table 4: Performance with Different Numbers of Retrieved References
Module
#Refs
MUSIQ ↑
CLIPIQA ↑
MANIQA ↑
RALI ↑
Q-Insight ↑
IDS ↑
w/o RQR
1
76.45
0.7008
0.6302
4.1192
4.1000
0.8215
2
76.59
0.6913
0.6315
4.1401
4.1290
0.8311
3
76.67
0.6933
0.6371
4.1537
4.1303
0.8342
w/ RQR
1
77.41
0.7910
0.7321
4.2226
4.1893
0.8096
2
77.47
0.7854
0.7333
4.2416
4.2027
0.8192
3
77.48
0.7832
0.7364
4.2547
4.2057
0.8211
Appendix
Table 5: Ablation study on the number of selected references ( k ) and the Reference Quality Refinement (RQR) module on the Face dataset.
Figure 6: Qualitative comparison of the World-Grounded Image Super-Resolution on Face dataset.
Setting
PSNR ↑
SSIM ↑
LPIPS ↓
RALI ↑
Q-Insight ↑
IDS ↑
HS ↑
1
w/o Iterative Refinement Loop (IRL)
22.57
0.6727
0.3456
4.2636
4.1754
0.8080
4.30
2
w/o Agentic ROI Planner (ARP)
22.61
0.6722
0.3451
4.2593
4.1748
0.8033
4.09
3
w/o World Knowledge Searcher (WKS)
22.99
0.6798
0.3799
4.1397
4.0704
0.6894
–
4
w/o World Knowledge Filter (WKF)
22.48
0.6636
0.3854
4.1280
4.0614
0.6577
3.94
5
Full Module
22.97
0.6879
0.3408
4.2522
4.1917
0.8199
4.47
Appendix
Table 6: Ablation study on each world knowledge module
Setting
PSNR ↑
SSIM ↑
LPIPS ↓
RALI ↑
Q-Insight ↑
IDS ↑
HS ↑
1
Ada-RefSR
24.43
0.6998
0.3191
4.0267
3.8969
0.7364
3.85
2
Ada-RefSR + World Knowledge
24.42
0.6996
0.3171
4.0311
3.8973
0.7395
4.14
3
WGISR w/o World Knowledge
22.99
0.6798
0.3799
4.1397
4.0704
0.6894
–
4
WGISR + World Knowledge (Ours)
22.97
0.6879
0.3408
4.2522
4.1917
0.8199
4.47
Appendix
Table 7: Ablation study on world knowledge improvements.
Reference data
LPIPS ↓
RALI ↑
Q-Insight ↑
IDS ↑
HS ↑
1
w/o Reference
0.3799
4.1397
4.0704
0.6894
–
2
Irrelevant (bird image)
0.3795
4.1472
4.1107
0.6808
–
3
Pure black image
0.3650
4.1255
4.0912
0.6883
–
4
Wrong face identity
0.3736
4.1895
4.1364
0.6347
2.51
5
Correct reference, 10 dB noise
0.3716
4.1659
4.1327
0.7578
4.16
6
Correct reference, 20 dB noise
0.3600
4.1987
4.1593
0.7794
4.35
Appendix
Table 8: Robustness of mismatch reference images.
Figure 7: Qualitative comparison on the RealLQ250 dataset. Please zoom in for more details.
Figure 8: Qualitative comparison on the RealLQ250 dataset. Please zoom in for more details.
Figure 9: Qualitative comparison on the Bird dataset. Please zoom in for more details.
Figure 10: Qualitative comparison on the Bird dataset. Please zoom in for more details.
Figure 11: Qualitative comparison on the Face dataset. Please zoom in for more details.
Figure 12: Qualitative comparison on the Face dataset. Please zoom in for more details.
Figure 13: Qualitative comparison on the WRSR dataset. Please zoom in for more details.
Figure 14: Qualitative comparison on the WRSR dataset. Please zoom in for more details.
Figure 15: Qualitative comparison on the CUFED5 dataset. Please zoom in for more details.
Figure 16: Qualitative comparison on the CUFED5 dataset. Please zoom in for more details.