Streaming Video Generation

Overview

Streaming video generation studies how to produce video a frame or chunk at a time so users can interact with it before the full sequence is complete. Most approaches adapt diffusion transformers to causal autoregressive generation, then use few-step distillation and self-forcing to reduce latency; rolling key-value caches and learned memory help retain useful context. Applications include interactive world models, talking avatars, and live video editing, with quality evaluated on measures such as VBench and long-horizon consistency benchmarks. The central tension is balancing real-time responsiveness and bounded memory with visual fidelity, motion quality, and coherence over long sequences, since causal generation can lose information available to slower bidirectional models.

Latest papers

CardsList

99 papers21 papers in the last four weeks, up 133% on the four weeks before. 0.1% of all new papers.

  1. EARTalking: End-to-end GPT-style Autoregressive Talking Head Synthesis with Frame-wise Control

    Mar 19, 2026Yuzhe Weng, Haotian Wang, Yuanhong Yu +4Talking Head GenerationControllable Video Generation

  2. AR-CoPO: Align Autoregressive Video Generation with Contrastive Policy Optimization

    Mar 18, 2026Dailan He, Guanlin Feng, Xingtong Ge +5RL for Video GenerationStreaming Video Generation

  3. AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising

    Mar 15, 2026Liyuan Cui, Wentao Hu, Wenyuan Zhang +3Audio-Video GenerationVideo Diffusion Models

  4. OmniForcing: Unleashing Real-time Joint Audio-Visual Generation

    Mar 12, 2026Yaofeng Su, Yuming Li, Zeyue Xue +7Audio-Video GenerationStreaming Video Generation

  5. Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusion

    Mar 12, 2026Yang Yang, Tianyi Zhang, Wei Huang +6Video GenerationStreaming Video Generation

  6. Streaming Autoregressive Video Generation via Diagonal Distillation

    Mar 10, 2026Jinxiu Liu, Xuanming Liu, Kangfu Mei +3Streaming Video GenerationAutoregressive Video Generation

  7. StreamWise: Serving Multi-Modal Generation in Real-Time at Scale

    Mar 6, 2026Haoran Qiu, Gohar Irfan Chaudhry, Chaojie Zhang +4Efficient Multimodal InferenceStreaming Video Generation