Temporal Consistency in Video Generation

Overview

This field studies how video generators keep objects, characters, scenes, and actions coherent as time passes, which matters for believable clips, editing, simulation, and long-form storytelling. Common approaches include spatiotemporal attention, optical-flow and 3D geometry cues, physics constraints, keyframe or semantic planning, and memory or cache retrieval; training methods also use rollout simulation, distillation, and preference-based rewards. Recent work extends short-clip diffusion models to long autoregressive and streaming settings, while benchmarks increasingly test motion, world-state memory, and cross-shot continuity alongside visual quality. A central tension is preserving identity and scene structure without suppressing natural motion or new events, and high frame-level fidelity does not necessarily mean a sequence has coherent dynamics.

Latest papers

CardsList

396 papers31 papers in the last four weeks, down 52% on the four weeks before. 0.2% of all new papers.

  1. VRWKV-Editor: Reducing quadratic complexity in transformer-based video editing

    Sep 30, 2025Abdelilah Aitrouga, Youssef Hmamouche, Amal El Fallah SeghrouchniVideo Diffusion ModelsVideo Editing

  2. S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix

    Aug 11, 2025Peng Dai, Feitong Tan, Qiangeng Xu +6Multi-View Video GenerationImage Inpainting

  3. MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing

    Jun 1, 2025Tong Zhang, Victor Escorcia, Juan C Leon Alcazar +1Diffusion Model GuidanceVideo Editing

  4. ViDE: Tuning-Free Video Coherence via Temporal Attention Reweighting and Prompt Blending

    Dec 23, 2024Xingyao Li, Hao Zhang, Fengzhuo Zhang +4Video GenerationTemporal Consistency in Video Generation

  5. Auto-Regressive Models Need Structural Registers: Semantic Foresight Improves Coherent Driving Video Continuation

    Dec 4, 2024Ruibo Ming, Jingwei Wu, Zhewei Huang +4Video PredictionAutoregressive Video Generation