Video Generation Evaluation

Overview

The field measures whether generated videos look good and, crucially, whether they follow prompts and depict coherent events over time. It combines perceptual metrics such as FVD and human preference ratings with benchmarks for motion, physics, geometry, long-form continuity, and audio-video alignment. Recent approaches use task-specific rubrics, vision-language model judges, and interpretable diagnostics to assess failures that aggregate scores can hide. A central challenge is that automated evaluators may disagree with people, while visual realism often fails to reflect physical reasoning, causal consistency, or successful task completion.

Latest papers

CardsList

192 papers34 papers in the last four weeks, up 113% on the four weeks before. 0.2% of all new papers.

  1. Long-CODE: Isolating Pure Long-Context as an Orthogonal Dimension in Video Evaluation

    Apr 19, 2026Zhijiang Tang, Jiaxin Qi, Bing Zhao +1Long Video GenerationTemporal Consistency in Video Generation

  2. Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment

    Apr 18, 2026Minghao Zou, Gen Liu, Guanghui Yue +5Video Quality AssessmentVideo Generation Evaluation

  3. Prompt-to-Gesture: Measuring the Capabilities of Image-to-Video Deictic Gesture Generation

    Apr 16, 2026Hassan Ali, Doreen Jirak, Luca Müller +1Synthetic Data AugmentationImage-to-Video Generation

  4. ANVIL: Analogies and Videos for Lecturers

    Apr 15, 2026Yuri Noviello, Anastasiia Birillo, Gosia MigutGenerative AI in EducationVideo Generation

  5. DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment

    Apr 14, 2026Xinyue Li, Shubo Xu, Zhichao Zhang +3Video Quality AssessmentVLM Calibration

  6. GTASA: Ground Truth Annotations for Spatiotemporal Analysis, Evaluation and Training of Video Models

    Apr 12, 2026Nicolae Cudlenco, Mihai Masala, Marius LeordeanuSynthetic Data GenerationVideo Representation Learning

  7. VGA-Bench: A Unified Benchmark and Multi-Model Framework for Video Aesthetics and Generation Quality Evaluation

    Apr 11, 2026Longteng Jiang, DanDan Zheng, Qianqian Qiao +7Video Generation EvaluationVideo Quality Assessment

  8. Generative World Renderer

    Apr 2, 2026Zheng-Hui Huang, Zhixiang Wang, Jiaming Tan +6Inverse RenderingControllable Video Generation

  9. SLVMEval: Synthetic Meta Evaluation Benchmark for Text-to-Long Video Generation

    Mar 31, 2026Ryosuke Matsuda, Keito Kudo, Haruto Yoshida +2Video Generation EvaluationVideo Quality Assessment

  10. ViGoR-Bench: How Far Are Visual Generative Models From Zero-Shot Visual Reasoners?

    Mar 26, 2026Haonan Han, Jiancheng Huang, Xiaopeng Sun +7Generative AI EvaluationPhysical Reasoning

  11. OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

    Mar 25, 2026Kaihang Pan, Qi Tian, Jianwei Zhang +12Multimodal GenerationVideo Generation

  12. PROBE: Diagnosing Residual Concept Capacity in Erased Text-to-Video Diffusion Models

    Mar 23, 2026Yiwei Xie, Zheng Zhang, Ping LiuDiffusion Model UnlearningVideo Generation Evaluation

  13. MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hints

    Mar 20, 2026Yu Qi, Xinyi Xu, Ziyu Guo +10Video ReasoningVideo Generation Evaluation

  14. Measuring 3D Spatial Geometric Consistency in Dynamic Video Generation

    Mar 19, 2026Weijia Dou, Wenzhao Zheng, Weiliang Chen +3Geometric Consistency in Video GenerationVideo Generation Evaluation

  15. OSCBench: Benchmarking Object State Change in Text-to-Video Generation

    Mar 12, 2026Xianjing Han, Bin Zhu, Shiqi Hu +4T2V GenerationVideo Generation Evaluation

  16. COMIC: Agentic Sketch Comedy Generation

    Mar 11, 2026Susung Hong, Brian Curless, Ira Kemelmacher-Shlizerman +1Agentic Video GenerationComputational Creativity

  17. EduVQA: Towards Concept-Aware Assessment of Educational AI-Generated Videos

    Mar 3, 2026Baoliang Chen, Xinlong Bu, Hanwei Zhu +2Video Quality AssessmentVideo Generation Evaluation

  18. MicroVerse: A Preliminary Exploration Toward a Micro-World Simulation

    Feb 28, 2026Rongsheng Wang, Minghao Wu, Hongru Zhou +4Video GenerationVideo Generation Evaluation

  19. MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generation

    Feb 27, 2026Haoyuan Shi, Yunxin Li, Nanhao Deng +5Video Generation EvaluationMulti-Shot Video Generation

  20. SPATIALALIGN: Aligning Dynamic Spatial Relationships in Video Generation

    Feb 26, 2026Fengming Liu, Tat-Jen Cham, Chuanxia ZhengT2V GenerationDirect Preference Optimization

  21. FlowPortrait: Reinforcement Learning for Audio-Driven Portrait Video Generation

    Feb 25, 2026Weiting Tan, Andy T. Liu, Ming Tu +3Audio-Driven Facial AnimationAudio-Video Generation

  22. UniVBench: Towards Unified Evaluation for Video Foundation Models

    Feb 25, 2026Jianhui Wei, Xiaotian Zhang, Yichen Li +6Video Foundation ModelsVideo Editing Benchmarks

  23. 3DSPA: A 3D Semantic Point Autoencoder for Evaluating Video Realism

    Feb 23, 2026Bhavik Chandna, Kelsey R. AllenVideo Quality AssessmentVideo Generation Evaluation