Overview

Video diffusion models synthesize or transform frame sequences by denoising video latents, often in diffusion transformers, conditioned on text, images, reference clips, or structured controls. Researchers use temporal attention, autoregressive chunking, and pose, camera, depth, or physics cues to improve motion, identity, geometry, and interaction; related systems support editing, restoration, avatars, and world-model prediction. Evaluation spans prompt alignment and visual quality, using benchmarks such as VBench and FVD, as well as controllability, physical plausibility, and downstream action performance. A central challenge is balancing fidelity and precise control over long videos with the speed and memory needed for streaming, while limiting drift and physically implausible events.

Latest papers

CardsList

812 papers72 papers in the last four weeks, down 36% on the four weeks before. 0.5% of all new papers.

  1. VideoMaMa++: Temporally Consistent Video Matting via Preserve-and-Refine Token

    Oct 19, 2026Sangbeom Lim, Seoung Wug Oh, Heeji Yoon +2Temporal ConsistencyVideo Diffusion Models

  2. Dynamics-Aware Sparse Attention for Efficient Autoregressive Video Diffusion

    Oct 19, 2026Yuanyu He, Zhuokun Chen, Yefei He +5Video Diffusion ModelsEfficient Video Generation

  3. RECAP: Reciprocal Sparse Attention and Hierarchical Caching for Efficient Video Diffusion

    Oct 19, 2026Tiange Xu, Kai Liu, Linghe Kong +1Video Diffusion ModelsDiffusion Model Inference Acceleration

  4. Wan-Alpha++: Animating a Single RGBA Asset into Controllable Transparent Video Effects

    Oct 19, 2026Haotian Dong, Xin Wang, Wenjing Wang +7Controllable Video GenerationVideo Diffusion Models

  5. Clean Forcing: Drift-Resistant Autoregressive Video Diffusion with a Frozen Base

    Oct 19, 2026Wenqing Wang, Joonghyuk Shin, Jonathan Tremblay +2Video Diffusion ModelsAutoregressive Video Generation

  6. GeoART: Geometry-Aware Refinement via Test-Time Scaling for Camera-Conditioned Video Diffusion

    Oct 18, 2026Liudi Yang, Ziyuan LiuCamera-Conditioned Video GenerationVideo Diffusion Models

  7. GeoV2V: Geometry-Grounded Video Diffusion Model for Driving Scene Generation

    Oct 18, 2026Yuchen Xi, Yuhan Guo, Chenwei Hou +4Novel View SynthesisTrajectory-Guided Video Generation

  8. BodyBridge: Grounded Body Layers for Sim-to-Real Translation of Vulnerable Road Users

    Oct 17, 2026Mark Azer, Fabian B. FlohrSim-to-Real TransferVideo Diffusion Models

  9. Persistent Planar Memory for Video World Models

    Oct 16, 2026Yuze He, Bin Tan, Zelin Gao +4Video World ModelsMemory-Augmented Video Generation

  10. Video Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D Avatars

    Oct 16, 2026Simon Giebenhain, Tobias Kirschstein, Liam Schoneveld +33D Avatar GenerationHuman Avatar Animation

  11. Sink-Sparse Hybrid Attention for Efficient Inference in T2I/T2V Diffusion Transformers

    Oct 16, 2026Bingxin Xing, Yu Zhang, Jiatong Ding +2Diffusion Model Inference AccelerationSparse Attention

  12. OmniXRef: A Unified Framework for Multimodal Multi-Reference Video Editing

    Oct 15, 2026Xiaoyan Cong, Tianyu Wang, Hyeonho Jeong +7Video EditingVideo Diffusion Models

  13. SoftCache: Adaptive Step Size Caching for Diffusion Transformers

    Oct 15, 2026Shimon Malnick, Nadav Orenstein, Ohad Fried +1Diffusion Model CachingDiffusion Model Inference Acceleration

  14. Velox: Spatial Memory Makes World Models Efficient

    Oct 15, 2026Qiuhong Shen, Shizun Wang, Xinchao WangAttention RoutingVideo World Models

  15. StreamErase: Towards Ultra-Fast Streaming Video Erasing

    Oct 14, 2026Zhuobai Dong, Xiaobing Tu, Xiantao Zhang +4Video EditingStreaming Video Generation

  16. StateCraft: Augmenting Video World Models with Abstract-State Reasoning

    Oct 14, 2026Lorenzo Venturoli, Nedko Savov, Xi Wang +2Video World ModelsLong-Horizon Video Generation

  17. Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation

    Oct 13, 2026Nikolay Semenov, Artem Riabinin, Sergey Bassenko +8Audio-Video GenerationAudio-Driven Facial Animation

  18. Focus, Align, and Diffuse: Time-Series-Aware Keyframe Diffusion for Cardiac Dynamic Synthesis from Sparse Observations

    Oct 13, 2026Junkai Liu, Haofan Wu, Nay Aung +3Medical Image SynthesisVideo Diffusion Models

  19. GAD: Geometry Attention Distillation for Consistent Video Generation

    Oct 13, 2026Junfeng Ni, Ziyu Zhu, Fan Jiang +7Attention-Guided DistillationGeometric Consistency in Video Generation

  20. LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rollout

    Oct 13, 2026Ziyu Zhu, Zhaoxu Sun, Fan Jiang +5Long-Horizon Video GenerationVideo Diffusion Models

  21. VARI: Robust Text-to-Video Generation via Group-Structured Intent Alignment

    Oct 13, 2026Mingxuan Zhu, Hohei Chan, Shiyuan Liu +2T2V GenerationVideo Diffusion Models

  22. LinMorph: Learning to Morph Weights for Efficient Video DiT Linearization

    Oct 13, 2026Lingyi Long, Congyue Zhao, Xiaoou Li +2Diffusion Model Inference AccelerationVideo Diffusion Models

  23. Hierarchical Curriculum Learning for Surgical Video Generation: Focusing on Bilateral Axillo-Breast Approach Robotic Thyroidectomy Datasets

    Oct 13, 2026Youngbin Kong, Seungho Lee, Jae Kyung Shin +3Video GenerationT2V Generation

  24. FlashVSR+: Efficient Video Super-Resolution via Hybrid Attention and Reward-Yield Distribution Matching

    Oct 13, 2026Ruchang Yao, Shi Guo, Junhao Zhuang +7Video Super-ResolutionVideo Diffusion Models