Overview

Video diffusion models synthesize or transform frame sequences by denoising video latents, often in diffusion transformers, conditioned on text, images, reference clips, or structured controls. Researchers use temporal attention, autoregressive chunking, and pose, camera, depth, or physics cues to improve motion, identity, geometry, and interaction; related systems support editing, restoration, avatars, and world-model prediction. Evaluation spans prompt alignment and visual quality, using benchmarks such as VBench and FVD, as well as controllability, physical plausibility, and downstream action performance. A central challenge is balancing fidelity and precise control over long videos with the speed and memory needed for streaming, while limiting drift and physically implausible events.

Latest papers

CardsList

812 papers72 papers in the last four weeks, down 36% on the four weeks before. 0.5% of all new papers.

  1. InverseCrafter: Efficient Video ReCapture as a Latent Domain Inverse Problem

    Dec 5, 2025Yeobin Hong, Suhyeon Lee, Hyungjin Chung +1Camera-Controlled Video GenerationVideo Diffusion Models

  2. Delving into Latent Spectral Biasing of Video VAEs for Superior Diffusability

    Dec 5, 2025Shizhan Liu, Xinran Deng, Zhuoyi Yang +3Variational AutoencodersSpectral Regularization

  3. Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generation

    Dec 4, 2025Yanran Zhang, Ziyi Wang, Wenzhao Zheng +3Video Diffusion Models3D Scene Generation

  4. GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generation

    Nov 28, 2025Yuhao Wan, Lijuan Liu, Jingzhi Zhou +6Video Diffusion Models3D Scene Generation

  5. WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generation

    Nov 27, 2025Quanjian Song, Yiren Song, Kelly Peng +2Video Diffusion ModelsVideo World Models

  6. Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesis

    Nov 25, 2025Mohammad Mahdi, Yuqian Fu, Nedko Savov +3Camera-Conditioned Video GenerationVideo Diffusion Models

  7. Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformer

    Nov 24, 2025Haoyu Wu, Jingyi Xu, Qiaomu Miao +2Rotary Positional EmbeddingsVideo Diffusion Models

  8. Do View-Consistent Representations Matter for Camera-Controlled Video Generation?

    Nov 24, 2025Duolikun Danier, Ge Gao, Chengxi Zeng +4Camera-Controlled Video GenerationVideo Diffusion Models

  9. EgoControl: Controllable Egocentric Video Generation via 3D Full-Body Poses

    Nov 22, 2025Enrico Pallotta, Sina Mokhtarzadeh Azar, Lars Doorenbos +3Pose-Conditioned Video GenerationControllable Video Generation

  10. Loomis Painter: Learning Painting Processes by Reversing Image-to-Video Generation

    Nov 21, 2025Markus Pobitzer, Chang Liu, Chenyi Zhuang +3Image-to-Video GenerationVideo Diffusion Models

  11. InstantViR: Real-Time Video Inverse Problem Solver with Distilled Diffusion Prior

    Nov 18, 2025Weimin Bai, Suzhe Xu, Yiwei Ren +4Diffusion-Based Inverse ProblemsVideo Diffusion Models

  12. Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising

    Nov 5, 2025Shuangquan Lyu, Jian Mao, Yue MaVideo OutpaintingVideo Diffusion Models

  13. VividCam: Learning Unconventional Camera Motions from Virtual Synthetic Videos

    Oct 28, 2025Qiucheng Wu, Handong Zhao, Zhixin Shu +3Synthetic Data AugmentationCamera-Controlled Video Generation

  14. Epipolar Geometry Improves Video Generation Models

    Oct 24, 2025Orest Kupyn, Théo Uscidda, Marta Tintore Gazulla +3Geometric Consistency in Video GenerationVideo Diffusion Models

  15. Taming Text-to-Sounding Video Generation via Advanced Modality Condition and Interaction

    Oct 3, 2025Kaisi Guan, Xihua Wang, Zhengfeng Lai +5Audio-Video GenerationVideo Diffusion Models

  16. Learning to Generate Rigid Body Interactions with Video Diffusion Models

    Oct 2, 2025David Romero, Ariana Bermudez, Viacheslav Iablochnikov +3HOI GenerationPhysical Consistency in Video Generation

  17. VRWKV-Editor: Reducing quadratic complexity in transformer-based video editing

    Sep 30, 2025Abdelilah Aitrouga, Youssef Hmamouche, Amal El Fallah SeghrouchniVideo Diffusion ModelsVideo Editing

  18. CineScale: Tuning-Free High-Resolution Video Generation

    Aug 21, 2025Gordon Chen, Haonan Qiu, Ning Yu +3Rotary Positional EmbeddingsVideo Diffusion Models

  19. Compact Attention: Exploiting Structured Spatio-Temporal Sparsity for Fast Video Generation

    Aug 18, 2025Qirui Li, Guangcong Zheng, Qi Zhao +6Efficient Video GenerationSpatio-Temporal Attention

  20. NABLA: Neighborhood Adaptive Block-Level Attention

    Jul 17, 2025Dmitrii Mikhailov, Aleksey Letunovskiy, Maria Kovaleva +6Video Diffusion ModelsDiffusion Transformer

  21. When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators

    Jun 24, 2025Jintao Rong, Xin Xie, Xinyi Yu +4Video Diffusion ModelsDiffusion Models for Motion Generation

  22. PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM

    May 22, 2025Siwei Meng, Yawei Luo, Ping LiuPhysics-Informed Generative ModelingPhysical Consistency in Video Generation

  23. Learning Zero-Shot Subject-Driven Video Generation Using 1% Compute

    Apr 23, 2025Daneul Kim, Jingxu Zhang, Wonjoon Jin +4Zero-Shot LearningVideo Diffusion Models

  24. ViDE: Tuning-Free Video Coherence via Temporal Attention Reweighting and Prompt Blending

    Dec 23, 2024Xingyao Li, Hao Zhang, Fengzhuo Zhang +4Video GenerationTemporal Consistency in Video Generation

  25. LVMark: Robust Watermark for Latent Video Diffusion Models

    Dec 12, 2024Youngdong Jang, MinHyuk Jang, JaeHyeok Lee +4Diffusion Model WatermarkingVideo Diffusion Models

  26. Diffusion Model-Based Video Editing: A Survey

    Jun 26, 2024Wenhao Sun, Rong-Cheng Tu, Jingyi Liao +1Video Diffusion ModelsVideo Editing