Video-Language Model Evaluation
Overview
The field develops tests and metrics for whether models can answer questions, describe events, localize evidence, and follow instructions in videos, including long, streaming, and audio-visual settings. Common approaches include human-annotated benchmarks, controlled tests that shuffle frames or alter evidence, and measures of temporal grounding, hallucination, efficiency, and response timing. Results often show that strong question-answering scores can coexist with weak event ordering, evidence localization, and resistance to misleading cues. A central challenge is separating genuine use of video evidence from shortcuts, while making results comparable across models and realistic about deployment constraints.
Latest papers
103 papers20 papers in the last four weeks, down 5% on the four weeks before. 0.1% of all new papers.