Video Diffusion Models
Overview
Video diffusion models synthesize or transform frame sequences by denoising video latents, often in diffusion transformers, conditioned on text, images, reference clips, or structured controls. Researchers use temporal attention, autoregressive chunking, and pose, camera, depth, or physics cues to improve motion, identity, geometry, and interaction; related systems support editing, restoration, avatars, and world-model prediction. Evaluation spans prompt alignment and visual quality, using benchmarks such as VBench and FVD, as well as controllability, physical plausibility, and downstream action performance. A central challenge is balancing fidelity and precise control over long videos with the speed and memory needed for streaming, while limiting drift and physically implausible events.
Latest papers
812 papers72 papers in the last four weeks, down 36% on the four weeks before. 0.5% of all new papers.
ViDecide: Teaching Video Diffusion Models to Reason and Plan Step by Step
Online Temporal Rotations for 2 Bit KV-Cache Quantization in Video Diffusion Transformers
FlexVSR: Continuous-Scale Super-Resolution for Streaming Video Generation
StreamEgo: Streaming Exocentric-to-Egocentric Video Generation
MultiBinder: Preventing Multi-Subject Identity Leakage in Personalized Video Generation
bind-then-narrate'' paradigm. Our approach introduces a two-stage conditioning process before video diffusion. First, Cross-modal Entity Binding devises an entity-aware Q-Former to extract identity-centric features from each subject's reference image and tightly align them with its unique entity phrase, yielding disentangled identity tokens.'' Second, a Multimodal Large Language Model (MLLM) acts as a narrative director'' in the Narrative-Aware Subject Arrangement stage, capturing the action of each subject from the text prompt and synthesizes contextualized subject features that encapsulate who is doing what'' and preserve role-specific distinctions. These features are then injected into a video diffusion model via dedicated conditioning pathways, ensuring precise attribute allocation. Extensive experiments on both general and newly curated multi-subject benchmarks show that MultiBinder significantly outperforms existing methods in multi-subject identity fidelity.