One-step real-world image super-resolution (Real-ISR) offers efficient inference, but recovering realistic and perceptually rich details often relies on score distillation or adversarial learning, introducing additional trainable components and making optimization more cumbersome. To this end, we propose DriftSR, a one-step Real-ISR framework that leverages pretrained diffusion priors through distribution drifting. Specifically, we perform drifting in the frozen intermediate representation space of a pretrained diffusion model, without introducing an additional task-specific feature encoder. Building on this space, we introduce Spatial Feature Drifting, which treats spatial features rather than entire images as distributional samples, enabling denser supervision for distribution alignment. To mitigate structural deviations, we further introduce Structure-Modulated Guidance, which adaptively refines drifting guidance according to local structural consistency with the LQ input. Consequently, DriftSR optimizes only the one-step generator, without auxiliary distillation branches or adversarial discriminators. Extensive experiments on three real-world benchmarks demonstrate that DriftSR delivers high-quality super-resolution reconstruction with efficient one-step inference.
Figures & tables
Figure 1: Qualitative and quantitative comparison of different training objectives. Left : Reconstruction-only training with MSE and LPIPS produces over-smoothed results. Adding variational score distillation [ 33 ] improves perceptual details, while further incorporating the GAN objective from OMGSR [ 40 ] enhances texture realism at the cost of additional trainable components. Our drifting loss achieves comparable or better perceptual quality without introducing additional trainable modules. Right : MANIQA and MUSIQ scores on four real-world datasets, where drifting remains competitive with joint score distillation and adversarial training.
Figure 2: Overview of DriftSR training pipeline. Given an LQ image xL , Gθ produces x^H under reconstruction supervision from the corresponding HQ image xH . A frozen pretrained teacher extracts multi-level latent features from xH and x^H . These features are converted into positive and negative spatial samples to construct the original drifting field. The same procedure is applied to their DWT low-frequency components to construct a low-frequency drifting field. A structure map M adaptively combines the two drifting fields to obtain a structure modulated drifting field for computing the drifting loss. During training, only Gθ is optimized using the reconstruction and drifting losses.
Datasets
Metrics
DiT4SR
StableSR
SeeSR
ResShift
CTMSR
OSEDiff
PiSA-SR
TSD-SR
HYPIR
VOSR
FiDeSR
StrSR
DriftSR
T2I Prior
SD3.5
SD2
SD2
−
−
SD2.1
SD2.1
SD3.5
SD2.1
−
SD2.1
FLUX
SD2.1
DRealSR
PSNR ↑
25.7966
28.030
28.073
28.693
28.682
27.915
28.318
27.769
25.932
27.824
29.034
25.0242
27.393
SSIM ↑
0.6822
0.7536
0.7684
0.7875
0.7839
0.7833
0.7804
0.7559
0.7197
0.7427
0.7942
0.7297
0.7584
LPIPS ↓
0.3677
0.3284
0.3173
0.3525
0.3236
0.2968
0.2960
0.2967
0.3371
0.3259
0.2811
0.3052
0.3379
CLIPIQA ↑
0.6624
0.6356
0.6909
0.5404
0.6517
0.6974
0.6971
0.7344
0.6392
0.5914
0.6927
0.6435
0.7442
MUSIQ ↑
64.3893
58.512
65.080
52.373
59.766
64.691
66.113
66.599
61.069
66.025
65.359
64.086
67.490
Table 1: A comprehensive comparison with state-of-the-art methods on three real-world datasets. For VOSR, we report the one-step variant with 1.4B parameters. The best and second-best results under each metric are marked in red and blue respectively.
Figure 3: Visual comparison of different methods. s denotes the number of inference steps. Please zoom in for a better view.
Figure 5
Multi-step Real-ISR Methods
One-step Real-ISR Methods
StableSR
DiT4SR
SeeSR
ResShift
CTMSR
OSEDiff
PiSA-SR
TSDSR
HYPIR
VOSR-1.4B
FiDeSR
DriftSR
Inference Step
200
40
50
15
1
1
1
1
1
1
1
1
Params (M)
1,563
2,716
2,514
119
171
1,775
1,302
2,207
1,549
1,745
1,291
1,777
Time (s)
14.154
6.947
6.365
1.471
1.312
0.191
0.212
0.122
0.275
0.174
0.171
0.195
Table 2: Comparison of inference steps, runtime, and model parameters among different Real-ISR methods on 512×512 inputs.
Figure 6: Periodic artifact suppression with the pretrained SD3.5-Medium prior. (a) Comparison across training steps using the reconstruction objective with TSD, additional GAN supervision, and our Drifting loss. (b) Periodic Peak Score across training steps, computed following OP4KSR [ 7 ] , where lower scores indicate fewer periodic artifacts.
Real-world image super-resolution (Real-ISR) aims to reconstruct high-quality (HQ) images from low-quality (LQ) inputs subject to diverse real-world degradations. Recent advances have leveraged the LQ inputs and natural image priors learned by Stable Diffusion models to achieve impressive results. However, existing methods often overlook insufficient clarity of LQ inputs inevitably induce content drift in the generated HQ images. This manifests primarily as visual detail degradation and textual semantic shift, severely compromising both fidelity and perceptual quality. To address this challenge, we propose FSP-Diff, a novel one-step diffusion model featuring a dual-pathway architecture. This architecture comprises a Detail-Conditioned Pathway for injecting structured details to recover fine structures, and a Detail-Modulated Semantic Pathway that refines semantic guidance using structured details to mitigate semantic deviations. Extensive experiments on standard Real-ISR benchmarks demonstrate that FSP-Diff surpasses existing one-step diffusion methods in both quantitative and qualitative metrics.
Diffusion models excel in Real-World Image Super-Resolution (Real-ISR) due to their powerful generative priors but suffer from slow iterative sampling. Although existing one-step distillation methods accelerate inference, they typically require auxiliary teacher models that inflate training memory and restrict scalability to large-scale architectures. Furthermore, these fixed-step models lack the flexibility to trade off speed for quality. In this paper, we propose TEASR, a training-efficient any-step diffusion framework for Real-ISR that enables both one-step and multi-step restoration within a unified model. Our key idea is to perform self-adversarial distillation within a single diffusion model, eliminating the need for auxiliary teachers or discriminators. Specifically, we propose a timestep-aware rectification strategy that stabilizes one-step generation across noise levels. These two designs further enables the distillation of 20B-parameter diffusion models on a single GPU, significantly improving training efficiency. Moreover, we introduce a dual-branch diffusion transformer with decoupled timestep condition to separate the current noise state and the denoising target to enhance sampling quality. Extensive experiments demonstrate that TEASR supports seamless any-step sampling and consistently outperforms state-of-the-art methods across multiple datasets.
Diffusion-based Real-World Image Super-Resolution (Real-ISR) achieves impressive perceptual quality but suffers from high computational costs due to iterative sampling. While recent distillation approaches leveraging large-scale Text-to-Image (T2I) priors have enabled one-step generation, they are typically hindered by prohibitive parameter counts and the inherent capability bounds imposed by teacher models. As a lightweight alternative, Consistency Models offer efficient inference but struggle with two critical limitations: the accumulation of consistency drift inherent to transitive training, and a phenomenon we term "Geometric Decoupling" - where the generative trajectory achieves pixel-wise alignment yet fails to preserve structural coherence. To address these challenges, we propose GTASR (Geometric Trajectory Alignment Super-Resolution), a simple yet effective consistency training paradigm for Real-ISR. Specifically, we introduce a Trajectory Alignment (TA) strategy to rectify the tangent vector field via full-path projection, and a Dual-Reference Structural Rectification (DRSR) mechanism to enforce strict structural constraints. Extensive experiments verify that GTASR delivers superior performance over representative baselines while maintaining minimal latency. The code and model will be released at https://github.com/Blazedengcy/GTASR.
Chengyan Deng, Zhangquan Chen, Li Yu +3
University of Electronic Science and Technology of China · Tsinghua University · Nanjing University