TRACE: Trajectory Synchronization for Training-Free Resolution Extension in Video Generation
Organizations: Shanghai Jiao Tong University · Huawei Technologies Ltd. · Northwest Polytechnical University · Xidian University
Abstract
More text-to-video models are available, but many remain limited to low resolutions. Training them for higher resolutions is costly, while existing training-free methods still struggle with fine detail, scene structure, and efficiency. We propose TRACE, a training-free method that synchronizes low- and high-resolution generation trajectories. During early denoising, TRACE aligns predicted scene content at corresponding noise levels. It computes high-resolution updates from low-resolution predictions and the current high-resolution state, without high-resolution model inference. The high-resolution trajectory retains fine-grained variation for generating new details. Local window attention then refines fine details in a shared high-resolution latent state. TRACE checks suspected duplicate subjects against the corresponding low-resolution layout and corrects selected regions and their solver history while preserving detail elsewhere. Experiments across all kinds of video generation backbones and resolutions show improved perceptual quality and text-video alignment over FreeSwim, a state-of-the-art training-free method, with 2.0-2.9x end-to-end speedups. Our code and models will be released at https://github.com/libozhu03/TRACE.
Figures & tables
| Method | Video Quality | VBench | Alignment | HR Fidelity | Latency | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| QA | DOVER | VS | SC | MS | BC | OC | AQ | IQ | Mean | VQA | BRISQUE | NIQE | Time (s) | |
| Wan2.1-T2V-1.3B [ 33 ] | ||||||||||||||
| Direct Inference | 4.165 | 0.5875 | 2.730 | 0.9787 | 0.9855 | 0.9755 | 0.2224 | 0.6008 | 0.6570 | 0.7366 | 0.6878 | 0.3400 | 0.2060 | 3,366 |
| C.Scaling [ 12 ] | 4.568 | 0.6546 | 2.747 | 0.9690 | 0.9810 | 0.9732 | 0.2400 | 0.6454 | 0.7111 | 0.7533 | 0.8539 | 0.3518 | 0.2063 | 3,927 |
| FreeScale [ 32 ] | 3.761 | 0.5835 | 2.718 | 0.9676 | 0.9798 | 0.9707 | 0.2344 | 0.6010 | 0.6435 | 0.7328 | 0.8207 | 0.4282 | 0.2579 | 3,968 |
| RIFLEx [ 47 ] | 4.080 | 0.5840 | 2.800 | 0.9753 | 0.9857 | 0.9735 | 0.2192 | 0.5874 | 0.6420 | 0.7305 | 0.6620 | 0.3380 | 0.2570 | 3,338 |