Overview

Video diffusion models synthesize or transform frame sequences by denoising video latents, often in diffusion transformers, conditioned on text, images, reference clips, or structured controls. Researchers use temporal attention, autoregressive chunking, and pose, camera, depth, or physics cues to improve motion, identity, geometry, and interaction; related systems support editing, restoration, avatars, and world-model prediction. Evaluation spans prompt alignment and visual quality, using benchmarks such as VBench and FVD, as well as controllability, physical plausibility, and downstream action performance. A central challenge is balancing fidelity and precise control over long videos with the speed and memory needed for streaming, while limiting drift and physically implausible events.

Latest papers

CardsList

812 papers72 papers in the last four weeks, down 36% on the four weeks before. 0.5% of all new papers.

  1. UniCaMo: Unified Camera and Motion Control for Video Diffusion Models

    Oct 31, 2026Long Vu, Tan Ngo, Animesh Karnewar +5Controllable Video GenerationCamera-Controlled Video Generation

  2. Seeing the Unseen: Unified Visible--Invisible Motion for Physically Consistent Video Generation

    Oct 30, 2026Mingyang Bao, Fangda Ye, Xihao Chen +3Physical Consistency in Video GenerationTrajectory-Guided Video Generation

  3. AB-Attention: Accurate Block Attention for Accelerating Video Diffusion Transformers

    Oct 29, 2026Bin Xu, Mo Zhang, Zhengfeiyang Zhang +6Diffusion Model Inference AccelerationBlock-Sparse Attention

  4. Regional Anchor Routing for Multi-Object Motion Transfer

    Oct 29, 2026Yuze Li, Fuchen Long, Xinlong Sun +3Controllable Video GenerationVideo Diffusion Models

  5. Seeing and Imagining as One: Unified Video Generation and 4D Perception for Embodied World Modeling

    Oct 29, 2026Haitang Feng, Zhuoman Liu, Zhennan Wang +5Embodied World ModelsMultimodal Video Generation

  6. TAPESTRY: A Single Backbone for Video Generation and Robot Control

    Oct 27, 2026Jeremy A. Collins, Seungjae Lee, Rachanon Wachakorn +4Vision-Based Robot ControlDiffusion Policy

  7. Hy-Nomas: Towards Free-form Interactive World Generation

    Oct 27, 2026Qiaoling Chen, Jiaxiang Cheng, Xueqing Deng +35Interactive World ModelsVideo Generation

  8. TriTile: Three-Tier Attention for Video Diffusion Transformers

    Oct 26, 2026Yeonjae Kim, Omin Kwon, Seong Hoon Seo +1Diffusion Model Inference AccelerationVideo Diffusion Models

  9. Beyond Distribution Matching: Self-Supervised Representation Forcing for Few-Step Video Generation

    Oct 26, 2026Junyi Chen, Haiyu Zhang, Zhoujie Fu +2Diffusion Model DistillationVideo Diffusion Models

  10. FlockWorld: Toward Population-Scale Multi-Agent Video World Models through Artificial Life Simulation

    Oct 25, 2026Meryem Koksal, Yunzhe Wang, Volkan UstunVideo World ModelsAction-Conditioned Video Generation

  11. EditDistill: Is It Possible to Guide Video Editing with Image Editing?

    Oct 25, 2026Guojun Lei, Hong Li, Hongbing Yang +3Video EditingDiffusion-Based Video Editing

  12. X-World: Transferring Video Priors to Variable-View Robot Control

    Oct 25, 2026Chun Gu, Xiaofei Wei, Yiming Chen +2Robotic ControlVision-Based Robot Control

  13. Learning the Autoregressive: Direct Score-Difference Estimation with Amortized Future Credit for Video Distillation

    Oct 25, 2026Zixuan Duan, Yabo Chen, Xunzhi Xiang +5Autoregressive Video GenerationDiffusion Model Distillation

  14. Mix Forcing: Causal Pre-Training via Mixture Attention for Interactive World Models

    Oct 24, 2026Zelin Gao, Hao Ouyang, Jiapeng Zhu +6Video GenerationCausal Video Generation

  15. SyncVid: World-Equivariant Diffusion for Synchronized Video Generation

    Oct 22, 2026Farhad G. Zanjani, Animesh Karnewar, Fatih Porikli +1Multi-View Video GenerationVideo Diffusion Models

  16. WorldForge V2: Eliciting Camera-Trajectory Alignment in Video Diffusion Models

    Oct 22, 2026Chenxi Song, Yanming Yang, Tong Zhao +3Camera-Controlled Video GenerationTrajectory-Guided Video Generation

  17. Making MLLM Latents Matter: Factor-Aware Predictive Learning for Cinematic Video Generation

    Oct 22, 2026Songlin Yang, Zhe Wang, Xiaotong Zhao +8Multimodal Video GenerationVideo Generation

  18. Latent Space Jam: Layout Guided Video Synthesis

    Oct 21, 2026Asaf Joseph, Moshe Mandel, Ohad FriedControllable Video GenerationTrajectory-Guided Video Generation

  19. RealMe: Immersive Volumetric Video from Minimal Captures

    Oct 21, 2026Chenxu Zhou, Zhiyuan Yu, Yudong Jin +44D ReconstructionSparse-View 4D Reconstruction

  20. Looking Ahead: Modeling Future Evolution in Autoregressive Video Generation

    Oct 21, 2026Ruopeng Gao, Yukun Huang, Jiarui Hu +4Autoregressive Video GenerationVideo Diffusion Models

  21. CausalAlign: Causal Alignment of Video Generation Models for Consistent Ego-Motion

    Oct 21, 2026Kai Zhu, Yintianrun Zhang, Shuwei Jiang +7Video Diffusion ModelsTemporal Consistency in Video Generation

  22. JointLight: Human-Centric Video Relighting with Asynchronous RGB-Irradiance Joint Modeling

    Oct 21, 2026Henglei Lv, Bailin Deng, Xiaoqiang Liu +4Video RelightingVideo Diffusion Models

  23. SolarRenderer: Few-Step Generative Reference Rendering

    Oct 20, 2026Guian Fang, Shengju Qian, Dongyue Lu +6Controllable Video GenerationVideo Diffusion Models

  24. MoDDiT: Simple Token Routing in Diffusion Transformers

    Oct 20, 2026Jarek Liesen, Matthew T. Jackson, Benjamin Ellis +2Diffusion TransformerAdaptive Computation for Diffusion Models

  25. Decoupling Action from Egocentric Observation for World Simulation

    Oct 20, 2026Yue Ma, Pengjie Song, Xinyu Wang +10Action-Conditioned Video GenerationHand-Object Interaction