Video Generation

Follow this topic Ask about this topic

Momentum

32 papers in the last four weeks, up 146% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 241

All topics

MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation
Jun 8, 2026Ishaan Preetam Chandratreya, David Charatan, Basile Van Hoorick +4Video Diffusion Models Long Video Generation
Massachusetts Institute of Technology · Toyota Research Institute
BioVid: Autoregressive Video Generation with Biological Behavior Semantic Comprehension
Jun 7, 2026Tsung-Wei Pan, Jung-Hua WangVideo Generation Autoregressive Video Generation
Department of Electrical Engineering, National Taiwan Ocean University, Keelung, Taiwan · AI research center, National Taiwan Ocean University, Keelung, Taiwan
TIDE: Task-Isolated Diffusion for Unified Video Editing and Generation
Jun 6, 2026Qi Liu, Gang Yue, Mingyu Yin +7Video Diffusion Models Video Editing
Zhejiang University · Bilibili Inc.
CultureScore: Evaluating Cultural Faithfulness in Video Generation Models
Jun 5, 2026Anku Rani, Wei Dai, Shravan Nayak +3Video Generation Video Generation Evaluation
Massachusetts Institute of Technology · Mila – Quebec AI Institute · Netflix
V2V-Bench: A Comprehensive Benchmark for Video-to-Video Generation Evaluation
Jun 4, 2026Tao Liu, Leela Krishna, Gouti Pavan Kumar +2Video-Reference Video Generation Video Editing Benchmarks
Centific Global Solutions Inc.
Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Control
Jun 3, 2026Jihoon Hong, Alice Chan, Qiyue Dai +2Text-to-Video Generation Video Generation
Georgia Institute of Technology Atlanta, GA 30308
Steady-Forcing: Balancing Spatial Persistence and Motion Continuity in Long-Horizon Nature Video Diffusion
Jun 2, 2026Matiur Rahman Minar, Seunghun Oh, GangHyeon Jeong +1Physical Consistency in Video Generation Long-Horizon Video Generation
Department of Computer Science and Engineering Sogang University Seoul, Korea · Department of Artifical Intelligence Sogang University Seoul, Korea
Retrieve What's Missing: Coverage-Maximizing Retrieval for Consistent Long Video Generation
Jun 1, 2026Minseok Joo, Dogyun Park, Taehoon Lee +2Long-Horizon Video Generation Memory-Augmented Video Generation
Korea University · KAIST
Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation
Jun 1, 2026Yuheng Chen, Teng Hu, Yuji Wang +3Diffusion Model Guidance Video Diffusion Models
Shanghai Jiao Tong University Shanghai, Shanghai, China · University of Electronic Science and Technology of China Chengdu, Sichuan, China · Zhejiang University Hangzhou, Zhejiang, China
Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation
Jun 1, 2026Muhammed Burak Kizil, Enes Sanli, Niloy J. Mitra +4Camera-Controlled Video Generation Video Generation
Koç University · University College London, Adobe · Adobe +1
SafeGen-Bench: Benchmarking Safety in Image-Conditioned Text-to-Video Generation
May 31, 2026Yingzi Ma, Xiaogeng Liu, Yawen Zheng +1Image-to-Video Generation Text-to-Video Generation
University of Wisconsin-Madison, Madison · Tsinghua University · Johns Hopkins University
Knowledge-Intensive Video Generation
May 31, 2026Chenxu Wang, Mingda ChenText-to-Video Generation Video Generation
Fudan University · Shanghai Jiao Tong University
SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Models
May 30, 2026Ziheng He, Yixiang Chen, Ning Yang +11Synthetic Data Generation for Robotics Video Generation
1UCAS · 2CASIA · 3NJU +3
Real2SAM2Real: Generative 3D Caches as Complementary Context for Video Diffusion
May 29, 2026Jiayi Wu, Haoming Cai, Cornelia Fermuller +2Camera-Controlled Video Generation Video Diffusion Models
University of Maryland
Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models
May 29, 2026Jiazheng Xing, Hangjie Yuan, Lingling Cai +9Video Generation
Zhejiang University · National University of Singapore · DAMO Academy, Alibaba Group +4
TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation
May 29, 2026Ruotong Liao, Guowen Huang, Qing Cheng +6Diffusion Transformer Text-to-Video Generation
Ludwig Maximilian University of Munich · MCML · Technical University of Munich +2
AdaState: Self-Evolving Anchors for Streaming Video Generation
May 28, 2026Yusuf Dalva, Pinar YanardagVideo Diffusion Models Streaming Video Generation
Virginia Tech
YoCausal: How Far is Video Generation from World Model? A Causality Perspective
May 28, 2026You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee +3Video Diffusion Models Causal World Models
National Yang Ming Chiao Tung University · Shanda AI Research Tokyo
KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing
May 28, 2026Mingshu Cai, Miao Zhang, Chenghe Yang +3Video Diffusion Models Text-to-Video Generation
Waseda University, Japan · College of Computer Engineering, Jimei University, Xiamen, Fujian, China · Department of Language Science and Technology, The Hong Kong Polytechnic University, Hong Kong, China +1
Which Pretraining Paradigm Better Serves Spatial Intelligence? An Empirical Comparison of Vision-Language and Video Generation Models
May 27, 2026Haozhan Shen, Tiancheng Zhao, Kangjia Zhao +1Vision-Language Models Visual Spatial Reasoning
Zhejiang University · Om AI Research · Binjiang Institute of Zhejiang University
CogPortrait: Fine-Grained Eye-Region Control in Portrait Animation via Hierarchical Agent Planning
May 27, 2026He Feng, Yongjia Ma, Donglin Di +2Audio-Driven Facial Animation Video Generation
Harbin Institute of Technology · Harbin, China · Li Auto +3
SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Control
May 27, 2026Zhida Zhang, Jie Ma, Zhan Peng +5Video Generation Multi-Shot Video Generation
1NLPR, CISIA · 2Youku Moku-Lab · 3HUST
What-If World: A Causal Benchmark for General World Models in Embodied Scenarios
May 26, 2026Kunlin Cai, Rui Song, Jinghuai Zhang +7Physical Consistency in Video Generation Causal World Models
1UCLA · University of Tennessee · 3Amazon
BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generation
May 26, 2026Yutong Wang, Yunke Wang, Xinyuan Chen +1Audio-Video Generation Video Generation
The University of Sydney · Shanghai AI Laboratory
Are Video Models Zero-Shot Learners and Reasoners in Education? EduVideoBench, A Knowledge-Skills-Attitude Benchmark for Educational Video Generation
May 26, 2026Unggi Lee, Hoyoung Ahn, Yoon Choi +16Generative AI in Education Video Generation
Korea University Sejong Campus · Cardiff Metropolitan University · Seoul National University +10
PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution
May 25, 2026Wenxue Li, Jingjing Ren, Peng Zhang +4Video Diffusion Models Few-Step Diffusion Sampling
The Hong Kong University of Science and Technology (Guangzhou) · MiLM Plus, Xiaomi Inc · The Hong Kong University of Science and Technology
Test-Time Self-Adaptive Conditioning for Stable Audio-Driven Talking-Head Generation
May 25, 2026Zhicheng Zhang, Lei Wang, Yu Zhang +1Test-Time Adaptation Talking Head Generation
School of Business, University of New South Wales (UNSW), Australia · School of Engineering and Built Environment, Griffith University, Australia
Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion
May 25, 2026Ting-Hsuan Chen, Ying-Huan Chen, Tao Tu +10Video-Reference Video Generation Camera-Controlled Video Generation
University of Southern California · National Yang Ming Chiao Tung University · Cornell University +1
DexSIM: Real-time Dexterous Simulation with Unified Causal Video Diffusion
May 23, 2026Adam LeeVideo Diffusion Models Real-Time Interactive Video Generation
UC Berkeley
Loki: Representation over Architecture for Diffusion-Based Portrait Animation
May 22, 2026Pouyan Navard, Sernam LimVideo Diffusion Models 3D Morphable Models
The Ohio State University · University of Central Florida

Jun 8, 2026, cs.CVJ/K move · Enter open · S save

MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation

Ishaan Preetam Chandratreya, David Charatan, Basile Van Hoorick, Sergey Zakharov+3

Massachusetts Institute of Technology · Toyota Research Institute

Video Diffusion Models Long Video Generation Video Generation Temporal Consistency in Video Generation

Open paper AskPDF arXiv

Video generative models have become increasingly powerful, but long-range consistency remains challenging to achieve because even a few dozen frames require impractically long transformer sequence lengths. We show that this issue can be mitigated by generating video using coarse-to-fine rollout within a multi-scale token space. Our approach is simple: first, we pre-train an autoencoder that compresses each frame into a hierarchy of tokens, with levels ranging from the typical latent resolution to only a handful of tokens per frame. The coarsest levels capture the most consequential information, such as scene layout and semantics, while finer levels add high-frequency appearance and texture. Then, we train a video diffusion model to generate these tokens using coarse-to-fine rollout. By carefully controlling the level of detail at which frames are generated and used as context during each rollout step, we are able to preserve long-range consistency in geometry and object permanence while spending less compute on the long-range consistency of less perceptually relevant details. We validate this approach using a custom dataset of long Minecraft videos, where it produces substantially more consistent rollouts compared to existing baselines.

Momentum

Related topics

Latest papers 241