Streaming Video Generation

Follow this topic Ask about this topic

Momentum

12 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 67

All topics

Surprise Forcing: What to Remember, When to Skip in Long Video Generation
Jul 20, 2026Shuwei Shi, Zhen Li, Muyao Niu +4Long-Horizon Video Generation Memory-Augmented Video Generation
Alaya Lab · The University of Tokyo
FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers
Jul 16, 2026Minguk Kang, Suha KwakEfficient Transformer Inference Transformer
Pika Labs · POSTECH
Wan-Streamer v0.2: Higher Resolution, Same Latency
Jul 5, 2026Lianghua Huang, Zhi-Fan Wu, Yupeng Shi +23Audio-Video Generation Real-Time Interactive Video Generation
Wan Team, Alibaba Group
Vidu S1: A Real-Time Interactive Video Generation Model
Jul 3, 2026Jintao Zhang, Kai Jiang, Jintao Chen +24Video Diffusion Models Real-Time Interactive Video Generation
Tsinghua University, Shengshu Technology · Shengshu Technology
Towards Memory-Efficient Autoregressive Video Generation via Instance-Specific Parametric Absorption
Jul 1, 2026Xiaomeng Fu, Jia Li, Yiming Hu +5Long-Horizon Video Generation Streaming Video Generation
Institute of Information Engineering, Chinese Academy of Sciences · AMAP, Alibaba Group · The University of Hong Kong
Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models
Jun 24, 2026Kaiwen Zheng, Guande He, Min Zhao +7Action-Conditioned Video Generation Autoregressive Diffusion
Tsinghua University · UT Austin · NVIDIA
InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars
Jun 22, 2026Quanyue Song, Yishan He, Yanfei Zhang +6Real-Time Interactive Video Generation Memory-Augmented Video Generation
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, China · China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd., China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, China +1
MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model
Jun 16, 2026Lichen Bai, Tianhao Zhang, Shitong Shao +14Audio-Video Generation Real-Time Interactive Video Generation
Catnip AI Team
GeoStream: Toward Precise Camera Controlled Streaming Video Generation
Jun 13, 2026Yizhou Zhao, Yifan Wang, Xiaoyuan Wang +11Camera-Conditioned Video Generation Camera-Controlled Video Generation
CMU · Northeastern University · UIUC +3
Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions
Jun 8, 2026Luxury, Jie Huang, Zihao Fan +25Streaming Video Generation Video Generation
1JD Explore Academy · 2USTC · 3PKU +6
Streaming Video Generation with Streaming Force Control
Jun 5, 2026Hanhui Wang, Yiming Xie, Haiwen Feng +3Streaming Video Generation Autoregressive Video Generation
1Northeastern University · 2Impossible Research · University of California, Berkeley +1
Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generation
Jun 3, 2026Yuxuan Bian, Zeyue Xue, Songchun Zhang +9Long Video Generation Memory-Augmented Video Generation
1The Chinese University of Hong Kong · 2Joy Future Academy, JD · 3The Hong Kong University of Science and Technology +4
Video-Mirai: Autoregressive Video Diffusion Models Need Foresight
Jun 2, 2026Yonghao Yu, Lang Huang, Runyi Li +2Video Diffusion Models Autoregressive Diffusion
The University of Tokyo · National Institute of Informatics · Peking University
Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs
Jun 1, 2026Sicheng Xu, Yu Deng, Shoukang Hu +5Variational Autoencoders Audio-Video Generation
1Microsoft Research · 2Microsoft AI
SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generation
May 29, 2026Weijia Dou, Hui Li, Jiahao Cui +3Video Diffusion Models Long-Horizon Video Generation
Fudan University · Meta Superintelligence Labs · Baidu
AdaState: Self-Evolving Anchors for Streaming Video Generation
May 28, 2026Yusuf Dalva, Pinar YanardagVideo Diffusion Models Streaming Video Generation
Virginia Tech
SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer
May 28, 2026Yuyang Zhao, Yicheng Pan, Qiyuan He +6Diffusion Transformer Streaming Video Generation
1NVIDIA · 3THU · 4NUS +2
minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models
May 28, 2026Min Zhao, Hongzhou Zhu, Bokai Yan +9Camera-Controlled Video Generation Video Diffusion Models
1ShengShu 2THU · 1ShengShu 3RUC · 1ShengShu +4
Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory
May 18, 2026Jinzhuo Liu, Jiangning Zhang, Wencan Jiang +5Long-Horizon Video Generation Memory-Augmented Video Generation
Zhejiang University · Tencent Youtu Lab · Huazhong University of Science and Technology +1
StreamingEffect: Real-Time Human-Centric Video Effect Generation
May 16, 2026Yiren Song, Cheng Liu, Yuxin Jiang +1Streaming Video Generation Video Editing
Show Lab, National University of Singapore
FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization
May 15, 2026Quanjian Song, Yefeng Shen, Mengting Chen +5Virtual Try-On Streaming Video Generation
Xiamen University · Alibaba Group
Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
May 14, 2026Min Zhao, Hongzhou Zhu, Kaiwen Zheng +6Autoregressive Diffusion Real-Time Interactive Video Generation
Tsinghua University · ShengShu · Renmin University of China
Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation
May 14, 2026Yuheng Wu, Xiangbo Gao, Tianhao Chen +4Real-Time Interactive Video Generation Streaming Video Generation
1KAIST · *Work done when intern at Visko · 3Texas A&M University +3
KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Exploration
May 14, 2026Ruicheng Zhang, Kaixi Cong, Jun Zhou +5RL for Video Generation Long Video Generation
Tsinghua University · Video Rebirth · HKUST
CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives
May 12, 2026Yihao Meng, Zichen Liu, Hao Ouyang +11Real-Time Interactive Video Generation Long-Horizon Video Generation
1HKUST · 2Ant Group · 3SJTU
OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation
May 12, 2026Yiren Song, Xiyao Deng, Pei Yang +2Unsupervised Domain Adaptation Streaming Video Generation
Show Lab, National University of Singapore
SWIFT: Prompt-Adaptive Memory for Efficient Interactive Long Video Generation
May 10, 2026Shanwen Tan, Hao Li, Jingtao Zhang +4Long Video Generation Memory-Augmented Video Generation
University of Science and Technology of China · Fudan University · Georgia Institute of Technology +1
RealCam: Real-Time Novel-View Video Generation with Interactive Camera Control
May 7, 2026Youcan Xu, Jiaxin Shi, Zhen Wang +5Camera-Controlled Video Generation Real-Time Interactive Video Generation
Zhejiang University, China · Xmax.AI Ltd., China · Hong Kong University of Science and Technology, China
Stream-T1: Test-Time Scaling for Streaming Video Generation
May 6, 2026Yijing Tu, Shaojin Wu, Mengqi Huang +4Streaming Video Generation Test-Time Scaling
University of Science and Technology of China · Independent Researcher
Stream-R1: Reliability-Perplexity Aware Reward Distillation for Streaming Video Generation
May 5, 2026Bin Wu, Mengqi Huang, Shaojin Wu +4Video Diffusion Models Diffusion Model Distillation
University of Science and Technology of China · Independent Researcher

Jul 20, 2026, cs.CVJ/K move · Enter open · S save

Surprise Forcing: What to Remember, When to Skip in Long Video Generation

Shuwei Shi, Zhen Li, Muyao Niu, Chuanhao Li+3

Alaya Lab · The University of Tokyo

Long-Horizon Video Generation Memory-Augmented Video Generation Streaming Video Generation Autoregressive Video Generation Diffusion Model Inference Acceleration Temporal Consistency in Video Generation

Open paper AskPDF arXiv

Streaming autoregressive diffusion makes minute-scale video synthesis practical, but its bounded context and fixed denoising schedule allocate resources uniformly across a highly non-stationary sequence. A rolling key-value cache forgets distant visual evidence even when that evidence remains important, while every generated chunk receives the same number of denoising passes irrespective of its actual difficulty. We introduce Surprise Forcing, a training-free framework that treats both limitations as online resource-allocation problems. A Surprise-Gated Memory Bank summarizes evicted frames with value-token descriptors, evaluates them using complementary global-deviation and nearest-neighbor novelty signals, and regulates admission through a feedback-controlled budget in normalized score space. Priority-based replacement and relevance-aware routing then keep the external memory compact and useful. In parallel, Surprise-Aware Denoising estimates chunk difficulty from the maximum adjacent-frame cosine distance after the first denoising pass and uses a local percentile scheduler to skip intermediate steps for comparatively easy chunks. Experiments on VBench, VBench-Long, and VBench-2.0 show that the proposed allocation strategy improves long-horizon consistency and visual quality while retaining real-time streaming throughput.

Momentum

Related topics

Latest papers 67