Diffusion-based video super-resolution (VSR) has recently achieved remarkable fidelity but still suffers from prohibitive sampling costs. While distribution matching distillation (DMD) can accelerate diffusion models toward one-step generation, directly applying it to VSR often results in training instability alongside degraded and insufficient supervision. To address these issues, we propose DUO-VSR, a three-stage framework built upon a Dual-Stream Distillation strategy that unifies distribution matching and adversarial supervision for one-step VSR. Firstly, a Progressive Guided Distillation Initialization is employed to stabilize subsequent training through trajectory-preserving distillation. Next, the Dual-Stream Distillation jointly optimizes the DMD and Real-Fake Score Feature GAN (RFS-GAN) streams, with the latter providing complementary adversarial supervision leveraging discriminative features from both real and fake score models. Finally, a Preference-Guided Refinement stage further aligns the student with perceptual quality preferences. Extensive experiments demonstrate that DUO-VSR achieves superior visual quality and efficiency over previous one-step VSR approaches.
Figures & tables
Figure 2: (a) Effect of initialization on the stability of the second-stage training. The proposed progressive guided distillation initialization leads to more stable loss and gradient norm trends during the second-stage distillation. (b) Compared with the fake score model, the real score model occasionally produces outputs that are spatially shifted relative to the inputs (highlighted in green boxes in the first two cases) or contain artifacts ( blue boxes in the third case), leading to degraded supervision propagated to the student model.
Figure 3: Overview of our three-stage distillation framework. (a) We initialize the student model with trajectory-preserving Progressive Guided Distillation, which consists of CFG Distillation and Progressive Distillation steps. (b) The core of our method, Dual-Stream Distillation, jointly optimizes the DMD and RFS-GAN streams through alternating Student Update and Auxiliary Update, providing reliable and sufficient supervision. (c) In the final stage, we construct a generated preference dataset and apply DPO-based Preference-Guided Refinement to enhance perceptual quality.
Figure 4: Visual comparison on synthetic (YouHQ40), real-world (VideoLQ) and AIGC (AIGC60) datasets. Zoom in for details.
Datasets
Metrics
RealViformer
VEnhancer
MGLD
UAV
STAR
DLoRAL
DOVE
SeedVR2-7B
DUO-VSR
PSNR ↑
21.34
19.92
21.89
19.67
21.56
22.87
22.69
23.08
22.90
SSIM ↑
0.601
0.523
0.642
0.538
0.613
0.674
0.694
0.685
0.691
LPIPS ↓
0.394
0.417
0.348
0.424
0.386
0.331
0.318
0.302
0.315
NIQE ↓
4.67
4.36
3.79
3.87
6.17
3.96
4.79
4.68
3.59
MUSIQ ↑
62.13
61.10
63.43
58.52
29.08
61.42
65.27
64.74
66.91
CLIP-IQA ↑
0.3443
0.3398
0.4333
0.4582
0.3827
0.5218
0.4922
0.5073
0.5459
Table 1: Quantitative comparisons on benchmarks, including synthetic (SPMCS [ 55 ] , UDM10 [ 81 ] , YouHQ40 [ 96 ] ), real-world (VideoLQ [ 4 ] ), and AIGC (AIGC60) videos. The best and second performances are marked in red and blue respectively.
Figure 5: Comparison of temporal consistency. Extracted and stacked along the blue line in the width–temporal plane.
Metric
UAV
MGLD
VEnh.
STAR
DOVE
DLoRAL
SeedVR2
DUO-VSR
Step
30
50
15
15
1
1
1
1
Time (s)
382.1
956.7
404.5
200.4
66.7
76.6
89.7
11.3
Params (B)
0.7
1.4
2.0
2.0
5.6
0.9
8.2
1.3
Table 2: Inference efficiency comparison. Measured on a single GPU using a 21-frame 1920×1080 video. The model parameters are counted only for the generator part.
Figure 6: Visual comparison of ablation on three stage distillation. Experiment indices refer to Tab. 3 . Zoom in for details.
Exp.
Variants
Metrics
I
II
III
NIQE
MUSIQ
CLIPIQA
DOVER
Base
4.31
63.46
0.4712
87.98
(a)
✓
5.45
58.97
0.408
86.49
(b)
✓
✓
4.64
63.36
0.487
88.01
(c)
✓
✓
5.11
60.22
0.423
87.63
(d)
✓
✓
✓
4.42
63.68
0.489
88.15
Table 3: Ablation on Three Stage Distillation.
Setting
NIQE
MUSIQ
CLIPIQA
DOVER
Component-level
DMD only
4.99
61.46
0.432
87.38
RFS-GAN only
5.32
62.64
0.427
87.53
Dual-Stream (Joint)
4.42
63.68
0.489
88.15
Optimization-level
Sequential DMD → GAN (Seq.)
5.17
62.76
0.419
87.67
Table 4: Ablation on Dual-Stream Distillation Strategy. “Joint” and “Seq.” denote different optimization schemes.
Figure 7: Visual comparison of ablation on Dual-Stream Distillation Strategy. The orange and red boxes show spatial comparison in the LR. The blue box shows the temporal profile along the blue line in the LR. Zoom in for details.
Figure 8: Examples of preferred and less-preferred samples in the constructed preference dataset. Zoom in for details.
Figure 9: Noise-perturbed samples stabilize adversarial training and suppress artifacts. Zoom in for details.
Figure 10: Discriminator features from the real and fake score models used for the RFS-GAN loss computation, reduced to three dimensions via t-SNE [ 39 ] for visualization.
Method
NIQE ↓
MUSIQ ↑
CLIPIQA ↑
DOVER ↑
Real Score Model only
4.71
62.79
0.456
87.95
Fake Score Model only
4.98
62.98
0.475
87.76
RFS-GAN
4.64
63.36
0.487
88.01
Table 5: Ablation study on the discriminator design of RFS-GAN.
Figure 11: Visual comparison with base VSR model. Zoom in for details.
Metric
UltraVSR
FlashVSR
DUO-VSR
NIQE ↓
5.58
4.67
4.42
MUSIQ ↑
58.23
63.11
63.68
CLIP-IQA ↑
0.4434
0.4690
0.4886
DOVER ↑
86.45
87.49
88.15
Ewarp∗↓
1.54
1.76
1.08
Time (s)
126.5
10.7
11.3
Table 6: Quantitative comparison on the AIGC60 dataset.
Figure 12: Visual comparison of different VSR methods. DUO-VSR consistently reconstructs finer textures. Zoom in for details.
Method
Overall Quality
Visual Fidelity
Visual Quality
DUO-VSR
0%
0%
0%
Our Base VSR model
-1.3%
-3.7%
+2.3%
SeedVR2-7B
-32.7%
-13.3%
-39.2%
DOVE
-29.3%
-8.0%
-36.2%
DLoRAL
-34.0%
-10.8%
-37.8%
UltraVSR
-39.8%
-16.7%
-43.3%
Table 7: Blind user study results based on GSB test.
Video super-resolution (VSR) seeks to reconstruct high-resolution frames from low-resolution inputs. While diffusion-based methods have substantially improved perceptual quality, extending them to video remains challenging for two reasons: strong generative priors can introduce temporal instability, and multi-frame diffusion pipelines are often too expensive for practical deployment. To address both challenges simultaneously, we propose InstaVSR, a lightweight diffusion framework for efficient video super-resolution. InstaVSR combines three ingredients: (1) a pruned one-step diffusion backbone that removes several costly components from conventional diffusion-based VSR pipelines, (2) recurrent training with flow-guided temporal regularization to improve frame-to-frame stability, and (3) dual-space adversarial learning in latent and pixel spaces to preserve perceptual quality after backbone simplification. On an NVIDIA RTX 4090, InstaVSR processes a 30-frame video at 2K×2K resolution in under one minute with only 7 GB of memory usage, substantially reducing the computational cost compared to existing diffusion-based methods while maintaining favorable perceptual quality with significantly smoother temporal transitions.
Jintong Hu, Bin Chen, Zhenyu Hu +3
Insta360 Research · Peking University · Wuhan University
Real-time video super-resolution requires high spatio-temporal fidelity under strict latency constraints, challenging diffusion models due to their iterative sampling cost and limited temporal coordination. We propose a streaming-aware framework that adapts pretrained single-image latent diffusion models for efficient video super-resolution (VSR) by exploiting the sequential structure of video streams. Our Cross-Step Attention mechanism reuses intermediate denoising features across adjacent frames and diffusion steps, enabling temporal information exchange without explicit temporal modeling. We further introduce Trajectory-Coupled Diffusion Scheduling, which aligns adjacent diffusion states and provides cleaner intermediate representations for cross-step conditioning, improving temporal coherence. These components are integrated into a streaming inference pipeline that incrementally propagates latent states across frames, reducing the effective computational complexity from O(N⋅S) to O(N+S) for N frames and S diffusion steps. Experiments on REDS4 and YouHQ40-Test demonstrate improved perceptual quality and temporal realism while maintaining frame-wise stability. Our method achieves over 40 FPS at 512×512 resolution after cold start, enabling real-time VSR without explicit temporal modeling.
Harris Partaourides, Sotirios Chatzis
Ethical AI Novelties Limassol, Cyprus · Cyprus University of Technology Limassol, Cyprus
Recent video super-resolution (VSR) models achieve efficient one-step generation through diffusion distillation. However, high-resolution inference remains costly, and distilled models are difficult to align with human preferences. These challenges call for improvements in both model architecture and training strategy. We present FlashVSR+ to address both limitations. On the architecture side, we introduce hybrid attention based on the strong locality observed in pretrained VSR models, while retaining sparse global interaction for long-range consistency. It achieves up to 2× DiT speedup and 45% lower peak memory, enabling spatially untiled 4K VSR on a single 24GB RTX 4090. On the training side, we propose Reward-Yield Distribution Matching Distillation (Ry-DMD) for preference-aligned one-step generation. Ry-DMD uses reward-weighted teacher rollouts to incorporate black-box rewards into distribution matching, without backpropagating through the reward model. We further show that Ry-DMD generalizes beyond VSR to T2I generation. Together, FlashVSR+ delivers stronger restoration quality and substantially improves high-resolution efficiency, with consistent gains in user preference. We release our code, models, and training data at \href{https://www.flashvsr.tech}{\textcolor{FlashBlue}{**www.flashvsr.tech**}}.
Ruchang Yao, Shi Guo, Junhao Zhuang +7
Shanghai AI Lab · MMLAB CUHK · Tsinghua University +1