Latent diffusion models have recently achieved remarkable progress in Real-world Image Super-Resolution (Real-SR). However, existing methods consistently exhibit a persistent seesaw effect: enhancing perceptual realism compromises structural fidelity. This effect, we argue, is not intrinsic to diffusion models, but largely stems from the architectural constraints of prevailing two-stage frameworks. To address this challenge, we propose PixelSR, a novel single-stage Pixel Diffusion Transformer for Real-SR that operates directly in pixel space. Specifically, PixelSR consists of two core designs: Pixel-space Conditional Diffusion and Orthogonal Flow Decoupling. The former establishes an effective pixel-space restoration framework by integrating spatially aligned LR conditioning, visual semantic guidance, and lightweight texture refinement, thereby bypassing VAE compression and enabling end-to-end optimization directly in RGB space. Complementarily, the latter decomposes the asymmetric flow target into a low-rank semantic component and a noise-free orthogonal texture component. By routing these components to specialized branches, it achieves decoupled optimization with reduced mutual interference. Benefiting from these designs, our PixelSR restores perceptually realistic details while faithfully preserving structural content. Extensive experiments across multiple benchmarks demonstrate that PixelSR not only achieves competitive performance, but also effectively mitigates the fidelity--realism seesaw effect.
Figures & tables
Figure 2: Overview of the proposed PixelSR framework. PixelSR comprises Pixel-space Conditional Diffusion (PCD) and Orthogonal Flow Decoupling (OFD). Left: PCD performs end-to-end RGB-space restoration using spatially aligned LR conditioning, visual semantic guidance, and lightweight pixel-level texture refinement. Right: OFD factorizes the asymmetric velocity target into a projected low-rank component and a deterministic orthogonal residual, which empirically exhibit semantic- and texture-dominant characteristics, respectively. Their predictions are assigned to specialized DiT and PiT branches and recombined into the full velocity for flow matching, enabling task-aligned optimization with reduced interference.
Figure 3: Visualization of orthogonal target factorization. With the Procrustes-aligned projector, the projected component mainly retains global content and coarse structures, while its orthogonal complement emphasizes edges, text patterns, and high-frequency textures.
Dataset
Method
Steps
Inference Time (s)
Reference-based Metrics
No-Reference Metrics
Rank ↓
PSNR ↑
SSIM ↑
LPIPS ↓
FID ↓
NIQE ↓
MUSIQ ↑
MANIQA ↑
DeQA ↑
StableSR
200
5.75
20.4946
0.5227
0.3193
60.0564
4.6047
62.7178
0.3254
3.0055
9
DiffBIR
50
5.08
20.5132
0.4899
0.2651
58.4458
4.4425
73.2548
0.6209
4.1696
4
DiT4SR
40
5.26
19.2087
0.4804
0.2723
59.0254
4.2242
72.6805
0.5067
3.8741
8
VOSR
25
3.86
20.5993
0.5111
0.2386
46.4918
3.8768
72.9454
0.5194
4.0873
2
LSDIR
DiT-SR
15
1.84
21.1127
0.5490
0.2457
41.7907
4.2975
69.5674
0.4341
3.8280
6
Table 1: Quantitative comparison on LSDIR, RealSR, ScreenSR, and UGCSR. Red indicates the best performance, orange indicates the second-best performance, and yellow indicates the third-best performance. ↑ : higher is better; ↓ : lower is better.
Figure 4: Qualitative comparison on challenging real-world examples. PixelSR better preserves the text layout and feather structure while recovering fine-grained details consistent with the HR references, whereas several competing methods exhibit distorted characters, irregular textures, or over-smoothed results. Best viewed zoomed in.
Figure 5: Ablation of PixelSR components on RealSR. The bars and green curve report PSNR and MANIQA, respectively. Pixel-space x0 -prediction provides a substantially stronger baseline than pixel-space v -prediction, while the successive PCD and OFD designs further improve fidelity and perceptual quality.
Figure 6: Frequency analysis of OFD branch specialization. Restoration results (top) and corresponding power spectra (bottom) under increasing orthogonal scale α . Larger α progressively strengthens fine textures and mid-to-high-frequency responses, while α=1 denotes the default OFD output. All spectra share the same color scale.
Variant
Reference-based Metrics
No-Reference Metrics
PSNR ↑
SSIM ↑
LPIPS ↓
MUSIQ ↑
MANIQA ↑
DeQA ↑
v -prediction
15.0173
0.0995
1.2483
26.5085
0.2176
1.5582
x0 -prediction
19.5442
0.4822
0.2543
72.3934
0.4895
3.6563
uA -prediction
20.3088
0.5101
0.2251
72.4436
0.5495
3.9879
OFD (Ours)
20.6907
0.5270
0.2203
73.1895
0.5661
4.0936
Table 2: Ablation of pixel-space flow formulations on LSDIR. All variants use the same PCD network and parameter count. OFD improves over monolithic uA -prediction through explicit factorization and branch assignment.
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
Hyperparameter
PixelSR
Architecture
Restoration resolution
5122×3
Conditional input dimension
5122×6
Patch-level depth N
28
Pixel-level depth M
4
Hidden size DDiT
1024
Appendix
Table 3: Implementation details of PixelSR.
Figure 7: Representative image matrix of UGCSR benchmark. The benchmark covers ten semantic categories: humans, animals, text-rich images, natural scenes, urban scenes, indoor scenes, plants, food, tools, and everyday objects. Two representative degraded images are shown for each category.
Figure 8: Objective semantic analysis of UGCSR. (a) Distribution of OpenCLIP zero-shot pseudo-labels across nine semantic categories. (b) UMAP visualization of the OpenCLIP image features, where each point represents one HR image and colors indicate the corresponding Top-1 predicted categories.
Metric
RealSR
ScreenSR
UGCSR
LR
HR
LR
HR
LR
HR
MUSIQ ↑
29.597 ± 6.335
57.465 ± 9.239
41.220 ± 12.321
72.150 ± 4.672
69.753 ± 9.747
75.175 ± 3.196
MANIQA ↑
0.278 ± 0.084
0.329 ± 0.093
0.212 ± 0.081
0.565 ± 0.061
0.464 ± 0.112
0.588 ± 0.056
DeQA ↑
1.721 ± 0.186
3.050 ± 0.418
2.341 ± 0.403
4.121 ± 0.303
3.559 ± 0.537
4.183 ± 0.215
NIQE ↓
18.215 ± 28.351
6.117 ± 1.444
6.968 ± 1.248
3.772 ± 1.952
4.797 ± 1.841
3.884 ± 1.428
Appendix
Table 4: No-reference quality comparison of LR and HR images across real-world paired SR benchmarks. Results are reported as mean ± standard deviation. The best results among LR and HR images are highlighted in bold and underlined , respectively.
Variant
Reference-based Metrics
No-Reference Metrics
PSNR ↑
SSIM ↑
LPIPS ↓
MUSIQ ↑
MANIQA ↑
DeQA ↑
Learnable P
23.4996
0.7114
0.2222
71.8488
0.4687
3.7217
SVD-based P
23.5053
0.7010
0.2224
71.9188
0.4645
3.7063
Procrustes P (SD2.1)
23.5640
0.7156
0.2082
72.8613
0.4824
3.8294
Procrustes P (SD3)
23.5583
0.7160
0.2132
72.8709
0.4816
3.8146
Procrustes P (FLUX.2)
23.5661
0.7168
0.2099
72.8436
0.4809
3.8318
Appendix
Table 5: Ablation of projector construction on ScreenSR. The first three rows compare projection strategies, while the additional rows examine different source VAEs for Procrustes alignment. All variants use the same training settings. Red and orange indicate the best and second-best performance, respectively.
Figure 9: t-SNE visualization of semantic and texture features. We sample 300 images from each of five ImageNet categories and visualize features from the two PixelSR branches. Semantic features form compact category-aware clusters, while texture features are more dispersed due to diverse local details, supporting the effectiveness of our OFD.
Encoder
PSNR ↑
SSIM ↑
LPIPS ↓
MUSIQ ↑
MANIQA ↑
DeQA ↑
CLIP
25.2911
0.7161
0.2924
68.4463
0.5056
3.2331
SigLIP
25.1778
0.7099
0.2967
68.7191
0.5168
3.2396
DINOv2
25.3360
0.7166
0.2922
69.5941
0.5381
3.6116
Appendix
Table 6: Ablation on different semantic encoders on RealSR. All variants use the same PCD framework and settings. Red indicates the best performance.
Figure 10: Qualitative comparison on challenging real-world examples. PixelSR better preserves the original text layout and character structures while recovering fine-grained image details, whereas several competing methods exhibit distorted characters, irregular textures, or over-smoothed results. Best viewed zoomed in.
Figure 11: Qualitative comparison on challenging real-world examples. PixelSR better preserves high-frequency textures and fine structural details, whereas competing methods often produce over-smoothed surfaces, irregular patterns, or artificial artifacts. Best viewed zoomed in.
Real-world image super-resolution (Real-ISR) aims to preserve structures supported by the degraded observation while reconstructing perceptually realistic details. However, existing Real-ISR methods largely optimize fidelity and perceptual quality within a shared network, causing the two objectives to interfere throughout training and making their balance difficult to control. Recent one-step methods reduce sampling steps, yet often inherit both this coupled optimization behavior and the expensive high-resolution backbone of their multi-step predecessors. We argue that efficient Real-ISR requires not only a shorter sampling trajectory, but also specialized modeling of faithful reconstruction and perceptual detail synthesis. Based on this insight, we propose PixelIR, a fidelity-perception decoupling framework built upon pixel-space image-residual flow matching. PixelIR first learns an image flow that maps the degraded observation to a faithful reconstruction. Then, a residual flow synthesizes the missing perceptual details from noise without repeatedly relearning or overwriting the complete restoration solution. We further distill the teacher into a deployment-oriented one-step student within a coarse-to-fine pyramid architecture. Extensive experiments show that PixelIR achieves leading PSNR, SSIM, and LPIPS on both RealSR and DRealSR. The final model completes pixel-space restoration in a single evaluation with only 32.9M parameters, 89.7G MACs, and 8.5ms latency, demonstrating a strong practical fidelity-perception-efficiency balance.
Bingtian Qiao, Yue Shi, Yong Guo +2
Shanghai Jiao Tong University · Fuzhou University · Shanghai AI Laboratory
Diffusion prior-based methods have shown impressive results in real-world image super-resolution (ISR), yet two key challenges persist: balancing pixel-level fidelity with semantic quality, and adapting to diverse degradations. Existing dual-branch approaches freeze the pixel module during semantic training, but the semantic branch can still expand capacity within the pixel subspace, precluding genuine perceptual improvement. Moreover, using a single static adapter cannot generalize across heterogeneous real-world corruptions. To address both issues, we propose FreqOrtho-SR, which comprises: Frequency-guided Mixture of LoRA Experts (FreqMoE), it routes inputs to specialized experts via a non-parametric FFT-based degradation-feature extractor that encodes frequency-domain signatures, enabling stable and interpretable specialization across corruption types; and Orthogonal Gradient Projection (OGP), which reframes the dual-objective optimization as a subspace-constrained problem: by extracting the pixel-fidelity subspace via SVD on combined expert weight deltas and projecting semantic gradients onto its null space, OGP guarantees orthogonality between the two objectives, enabling genuinely complementary learning without mutual interference. Experiments show that FreqOrtho-SR achieves competitive overall performance and a strong fidelity-perception trade-off across multiple benchmarks with efficient single-step inference. The source code of our method can be found at sonhm3029/FreqOrtho-SR.
Minh Son Hoang, Dinh Phu Tran, Quyen Nguyen Duc +2
Real-world image super-resolution is particularly challenging for diffusion models because real degradations are complex, heterogeneous, and rarely modeled explicitly. We propose a degradation-aware and structure-preserving diffusion framework for real-world SR. Specifically, we introduce Degradation-aware Token Injection, which encodes lightweight degradation statistics from low-resolution inputs and fuses them with semantic conditioning features, enabling explicit degradation-aware restoration. We further propose Spatially Asymmetric Noise Injection, which modulates diffusion noise with local edge strength to better preserve structural regions during training. Both modules are lightweight add-ons to the adopted diffusion SR framework, requiring only minor modifications to the conditioning pipeline. Experiments on DIV2K and RealSR show that our method delivers competitive no-reference perceptual quality and visually more realistic restoration results than recent baselines, while maintaining a favorable perception--distortion trade-off. Ablations confirm the effectiveness of each module and their complementary gains when combined. The code and model are publicly available at https://github.com/jiyang0315/DASP-SR.git.
Yang Ji, Zonghao Chen, Zhihao Xue +1
KUNBYTE Hangzhou, Zhejiang Province, China · GOLDMYE Xuhui District, Shanghai, China