cs.CVMay 3, 2026

Motion-Aware Caching for Efficient Autoregressive Video Generation

Authors: Jing XuYuexiao MaXuzhe ZhengXing WangShiwei LiuChenqian YanXiawu ZhengRongrong Ji+2 more

Organizations: 1Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China · 2ByteDance · 3Max Planck Institute for Intelligent Systems, 4ELLIS Institute Tbingen, 5Tbingen AI Center

Abstract

Autoregressive video generation paradigms offer theoretical promise for long video synthesis, yet their practical deployment is hindered by the computational burden of sequential iterative denoising. While cache reuse strategies can accelerate generation by skipping redundant denoising steps, existing methods rely on coarse-grained chunk-level skipping that fails to capture fine-grained pixel dynamics. This oversight is critical: pixels with high motion require more denoising steps to prevent error accumulation, while static pixels tolerate aggressive skipping. We formalize this insight theoretically by linking cache errors to residual instability, and propose MotionCache, a motion-aware cache framework that exploits inter-frame differences as a lightweight proxy for pixel-level motion characteristics. MotionCache employs a coarse-to-fine strategy: an initial warm-up phase establishes semantic coherence, followed by motion-weighted cache reuse that dynamically adjusts update frequencies per token. Extensive experiments on state-of-the-art models like SkyReels-V2 and MAGI-1 demonstrate that MotionCache achieves significant speedups of 6.28×\textbf{6.28}\times and 1.64×\textbf{1.64}\times respectively, while effectively preserving generation quality (VBench: 1%1\%\downarrow and 0.01%0.01\%\downarrow respectively). The code is available at https://github.com/ywlq/MotionCache.

Explore similar work

CardsList