Temporal Video Understanding

Follow this topic Ask about this topic

Momentum

23 papers in the last four weeks, up 109% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 220

All topics

VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis
May 21, 2026Jinho Park, Youbin Kim, Hogun Park +1VLM Evaluation Spatiotemporal Reasoning
Department of Artificial Intelligence, Sungkyunkwan University · Department of Artificial Intelligence, Yonsei University
GALAR-TemporalNet v2: Anatomy-Guided Dual-Branch Temporal Classification with Bidirectional Mamba and Dual-Graph GCN for Video Capsule Endoscopy -- after competition results
May 21, 2026Jiye Won, Seangmin Lee, Soon Ki JungEndoscopy Medical Imaging
Kyungpook National University · School of Computer Science and Engineering, Kyungpook National University, Daegu, Republic of Korea
Zero-Shot Temporal Action Localization Through Textual Guidance
May 21, 2026Benedetta Liberatori, Alessandro Conti, Lorenzo Vaquero +3Zero-Shot Learning Temporal Action Detection
University of Trento, Trento, Italy · Fondazione Bruno Kessler, Trento, Italy
Enhancing Multimodal Large Language Models for Safety-Critical Driving Video Analysis
May 21, 2026Tomaso Trinci, Henrique Piñeiro Monteagudo, Leonardo TaccariMultimodal Large Language Models Autonomous Driving
Verizon Connect, Florence, Italy.
ST-SimDiff: Balancing Spatiotemporal Similarity and Difference for Efficient Video Understanding with MLLMs
May 21, 2026Bingjun Luo, Tony Wang, Chaoqi Chen +1Multimodal Token Compression Video Token Compression
Tsinghua University · Shenzhen University · Xidian University
VISTA: Validation-Guided Integration of Spatial and Temporal Foundation Models with Anatomical Decoding for Rare-Pathology VCE Event Detection -- after competition results
May 21, 2026Bo-Cheng Qiu, Fang-Ying Lin, Ming-Han Sun +3Endoscopy Medical Imaging
National Cheng Kung University, Taiwan · National Yang Ming Chiao Tung University, Taiwan
Enhancing Visual Token Representations for Video Large Language Models via Training-Free Spatial-Temporal Pooling and Gridding
May 21, 2026Bingjun Luo, Tony Wang, Hanqi Chen +1Video-Language Models Multimodal Token Compression
1Tsinghua University · 2Shenzhen University · 3Xidian University
Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning
May 21, 2026Dazhao Du, Jian Liu, Jialong Qin +7Counterfactual Evaluation Video-Language Models
Hong Kong University of Science and Technology · Tencent
Flat-Pack Bench: Evaluating Spatio-Temporal Understanding in Large Vision-Language Models through Furniture Assembly
May 20, 2026Aditya Chetan, Eric Cai, Peeyush Kushwaha +5VLM Evaluation Temporal Video Grounding
Cornell University · Independent researcher · MBZUAI +2
TempGlitch: Evaluating Vision-Language Models for Temporal Glitch Detection in Gameplay Videos
May 20, 2026Yakun Yu, Ashley Wiens, Adrián Barahona-Ríos +4VLM Evaluation Automated Software Testing
University of Alberta · Sony Interactive Entertainment
VSCD: Video-based Scene Change Detection in Unaligned Scenes
May 20, 2026Jiae Yoon, Ue-Hwan KimTemporal Video Understanding
Department of AI Convergence, Gwangju Institute of Science and Technology, Gwangju, Republic of Korea · GIST InnoCORE AI-Nano Convergence Institute for Early Detection of Neurodegenerative Diseases, Gwangju Institute of Science and Technology, 61005 Gwangju, Republic of Korea.
HAVEN: Hierarchically Aligned Multimodal Benchmark for Unified Video Understanding
May 19, 2026Mengqi Shi, Haopeng ZhangMultimodal Grounding Video Summarization
Department of Information and Computer Sciences · University of Hawaii at Manoa
Towards Data-Efficient Video Pre-training with Frozen Image Foundation Models
May 18, 2026Svetlana Orlova, Niccolò Cavagnero, Gijs DubbelmanStreaming Video Understanding Vision Foundation Model Adaptation
Eindhoven University of Technology
Visual Timelines of Police Encounters in Body-Worn Camera Footage: Operational Context and Activity Cataloging for Training and Analysis in OpenBWC
May 16, 2026Angela Srbinovska, Christopher Homan, Adrian Martin +1Human Activity Recognition Video Action Recognition
Department of Computer Science Rochester Institute of Technology Rochester, NY, USA · Office of Business Intelligence Rochester Police Department Rochester, NY, USA · School of Mathematics and Statistics Rochester Institute of Technology Rochester, NY, USA
LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection
May 14, 2026Mitchell Piehl, Muchao YeInterpretable Anomaly Detection VLM Reasoning
The University of Iowa, Iowa City IA 52245, USA
SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition
May 14, 2026Sukju Oh, Sukkyu SunSurgical Video Understanding Visual SSMs
Department of Computer Science and Artificial Intelligence, Dongguk University, Seoul 04620, Republic of Korea
Video-Zero: Self-Evolution Video Understanding
May 14, 2026Ruixu Zhang, Deyi Ji, Lanyun Zhu +4Temporal Video Grounding Long-Video Understanding
1Tsinghua University · 2Tencent · 3Tongji University +1
BARISTA: A Multi-Task Egocentric Benchmark for Compositional Visual Understanding
May 12, 2026Patrick Knab, Orgest Xhelili, Inis Buzi +7Video Understanding Scene Graph Generation
Ramblr.ai Research · Technical University of Clausthal
Stabilizing Temporal Inference Dynamics for Online Surgical Phase Recognition
May 11, 2026Yang Liu, Ning Zhu, Jingjing Peng +4Surgical Video Understanding Temporal Consistency
King’s College London, London, UK · University of Electronic Science and Technology of China, Chengdu, China · Mach Drive
StreamPro: From Reactive Perception to Proactive Decision-Making in Streaming Video
May 11, 2026Ao Li, Zihan Xiao, Zihao Yue +7Streaming Video Understanding Temporal Video Understanding
1AIM3 Lab, Renmin University of China · 2MiLM Plus, Xiaomi Inc. · 3Peking University
OZ-TAL: Online Zero-Shot Temporal Action Localization
May 11, 2026Chaolei Han, Hongsong Wang, Xin Gong +1Zero-Shot Learning Temporal Action Detection
School of Cyber Science and Engineering, Southeast University, Nanjing 211102, China · Engineering Research Center of Blockchain Application, Supervision and Management (Southeast University), Ministry of Education; Purple Mountain Laboratories, Nanjing 211111, China · School of Computer Science and Engineering, Southeast University, Nanjing 211102, China
TOC-Bench: A Temporal Object Consistency Benchmark for Video Large Language Models
May 11, 2026Junzhe Chen, Siyuan Meng, Yuxi Chen +3Video-Language Model Evaluation Video-Language Models
Tianjin University
Fetal Brain Imaging: A Composite Neural Network Approach for Keyframe Detection in Ultrasound Videos
May 10, 2026Aleksander Zamojski, Kacper Jarczak, Radoslaw RoszczykUltrasound Imaging Video Frame Selection
Warsaw Universitu of Technology Warsaw, Poland · Warsaw University of Technology Warsaw, Poland
SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy
May 10, 2026Ismael Elsharkawi, Ahmed Sait, Silvio Giancola +3VLM Evaluation Sports Video Analysis
Department of Computer Science and Engineering, The American University in Cairo · Image And Visual Understanding Lab (IVUL), KAUST
Fre-Res: Frequency-Residual Video Token Compression for Efficient Video MLLMs
May 10, 2026Yigui Feng, Qinglin Wang, Yang Liu +1Efficient VLM Inference Visual Tokenization
The College of Computer Science, National University of Defense Technology, Changsha, Hunan, China · College of Computer Science, National University of Defense Technology, Deya Road 109, Changsha, Hunan 410073, China · The Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou, Guangdong, China +1
Tracking the Truth: Object-Centric Spatio-Temporal Monitoring for Video Large Language Models
May 9, 2026Tri Cao, Khoi Le, Thong Nguyen +7VLM Evaluation Object Hallucination in VLMs
National University of Singapore · VinUniversity · Nanyang Technological University
MLCR: Multi-Level Cue Refinement for Long-Term Multimodal Action Quality Assessment
May 9, 2026Qiqi Li, Pengfei Wang, Hongyu Chen +1Multimodal Fusion Action Quality Assessment
Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, Zhejiang, 310007, China · College of Computer Science and Technology, Zhejiang University, Hangzhou, Zhejiang, 310007, China · School of Software Technology, Zhejiang University, Hangzhou, Zhejiang, 310007, China +3
TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videos
May 8, 2026Hengyi Feng, Hao Liang, Mingrui Chen +6Audio-Visual Understanding Multimodal Hallucination
University of Electronic Science and Technology of China · Peking University · Zhongguancun Academy +1
Tracing the Arrow of Time: Diagnosing Temporal Information Flow in Video-LLMs
May 8, 2026Peitao Han, Fei Cheng, Lis K. Pereira +2Vision-Language Models Temporal Reasoning in Language Models
The University of Osaka · Center for Information and Neural Networks · National Institute of Information and Communications Technology +2
Jointly Learning Structured Representations and Stabilized Affinity for Human Motion Segmentation
May 7, 2026Xianghan Meng, Zhiyuan Huang, Zhengyu Tong +1Representation Learning Clustering
School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, P.R. China

May 21, 2026, cs.CVJ/K move · Enter open · S save

VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis

Jinho Park, Youbin Kim, Hogun Park, Eunbyung Park

Department of Artificial Intelligence, Sungkyunkwan University · Department of Artificial Intelligence, Yonsei University

VLM Evaluation Spatiotemporal Reasoning Synthetic Benchmark Generation Temporal Video Understanding

Open paper AskPDF arXiv

Spatio-temporal reasoning is a core capability for Multimodal Large Language Models (MLLMs) operating in the real world. As such, evaluating it precisely has become an essential challenge. However, existing spatio-temporal reasoning benchmark datasets primarily rely on static image sets or passively curated video data, which limits the evaluation of fine-grained reasoning capabilities. In this paper, we introduce VGenST-Bench, a video benchmark that employs generative models to actively synthesize highly controlled and diverse evaluation scenarios. To construct VGenST-Bench, we propose a multi-agent pipeline incorporating a human quality control stage, ensuring the quality of all generated videos and QA pairs. We establish a comprehensive 3x2x2 video taxonomy, encompassing Spatial Scale, Perspective, and Scene Dynamics to span diverse scenarios. Furthermore, we design a hierarchical task suite that decouples low-level visual perception from high-level spatio-temporal reasoning. By shifting the paradigm from passive curation to active synthesis, VGenST-Bench enables fine-grained diagnosis of spatio-temporal understanding in MLLMs.

Momentum

Related topics

Latest papers 220