Temporal Video Grounding

Follow this topic Ask about this topic

Temporal video grounding studies how to identify when a described action, event, or state occurs in a video, often returning one or more time intervals. Methods range from proposal-based models and cross-modal alignment to zero-shot video-language models, query-guided frame selection, and agents that search long videos in stages. Training commonly uses temporal annotations and benchmarks such as QVHighlights, Charades-STA, and ActivityNet-Captions, while newer work explores weak supervision, reinforcement learning, and open-world queries. A central challenge is that fluent answers and broad event recognition do not guarantee precise, faithful evidence localization, especially in long videos or when queries are ambiguous or match multiple moments.

Latest papers

169 papers28 papers in the last four weeks, up 115% on the four weeks before. 0.2% of all new papers.

Two-Pass Zero-Shot Temporal-Spatial Grounding of Rare Traffic Events in Surveillance Video
May 2, 2026Jiantang HuangTemporal Video Grounding Large Vision-Language Models
Static and Dynamic Graph Alignment Network for Temporal Video Grounding
May 1, 2026Zhanjie Hu, Bolin Zhang, Jianhua Wang +5Temporal Video Grounding Temporal GNNs
Faculty of Electronic Engineering and Computer Science, Ningbo University, Ningbo, China · College of Computer Science, Inner Mongolia University, Hohhot, China · College of Computing and Engineering, Hunan Normal University, Changsha, China +4
ClipTBP: Clip-Pair based Temporal Boundary Prediction with Boundary-Aware Learning for Moment Retrieval
Apr 30, 2026Ji-Hyeon Kim, Ho-Joong Kim, Seong-Whan LeeTemporal Video Grounding Cross-Modal Alignment
Dept. of Artificial Intelligence, Korea University, Seoul 02841, Republic of Korea
OmniVTG: A Large-Scale Dataset and Training Paradigm for Open-World Video Temporal Grounding
Apr 28, 2026Minghang Zheng, Zihao Yin, Yi Yang +2Temporal Video Grounding LLM Self-Correction
Wangxuan Institute of Computer Technology, Peking University · Central Media Technology Institute, Huawei Technologies Ltd. · State Key Laboratory of General Artificial Intelligence, Peking University +1
FCMBench-Video: Benchmarking Document Video Intelligence
Apr 28, 2026Runze Cui, Fangxin Shang, Yehui Yang +3VLM Evaluation Document Understanding
AI Lab, Qifu Technology, Beijing, China · School of Future Technology, South China University of Technology, Guangzhou, China · Pazhou Lab, Guangzhou, China +1
StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoning
Apr 25, 2026Xuanyue Zhong, Yuqiang Xie, Guanqun Bi +2Temporal Video Grounding Video Understanding
Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong · SkyReels, Skywork AI · Independent Researcher
Towards Temporal Compositional Reasoning in Long-Form Sports Videos
Apr 24, 2026Siyu Cao, Lu Zhang, Ruizhe Zeng +1Temporal Video Grounding Temporal Reasoning
MAIS, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · Nanjing Artificial Intelligence Research of IA, Nanjing, 211100, China
Grounding Video Reasoning in Physical Signals
Apr 23, 2026Alibay Osmanli, Zixu Cheng, Shaogang GongTemporal Video Grounding Video QA
Queen Mary University of London
Unlocking the Potential of Grounding DINO in Videos: Parameter-Efficient Adaptation for Limited-Data Spatial-Temporal Localization
Apr 14, 2026Zanyi Wang, Fan Li, Dengyang Jiang +4Temporal Video Grounding VLM Adaptation
SGIT AI Lab, State Grid Corporation of China · University of HongKong · Zhejiang University of Technology
ViLL-E: Video LLM Embeddings for Retrieval
Apr 13, 2026Rohit Gupta, Jayakrishnan Unnikrishnan, Fan Fei +3Video-Language Models Vision-Language Models
LVSum: A Benchmark for Timestamp-Aware Long Video Summarization
Apr 11, 2026Alkesh Patel, Melis Ozyildirim, Ying-Chang Cheng +1Video Summarization Video-Language Model Evaluation
Apple
How Should Video LLMs Output Time? An Analysis of Efficient Temporal Grounding Paradigms
Apr 10, 2026Shengji Jin, Yuanhao Zou, Victor Zhu +2Temporal Video Grounding Efficient VLM Inference
The University of Central Florida · Axon
UniversalVTG: A Universal and Lightweight Foundation Model for Video Temporal Grounding
Apr 9, 2026Joungbin An, Agrim Jain, Kristen GraumanTemporal Video Grounding
The University of Texas at Austin
Bridging Time and Space: Decoupled Spatio-Temporal Alignment for Video Grounding
Apr 9, 2026Xuezhen Tu, Jingyu Wu, Fangyu Kang +4Vision-Language Grounding Temporal Video Grounding
Shanghai Jiao Tong University China · ZTE Corporation China
Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding
Apr 9, 2026Muyang Zheng, Tong Zhou, Geyang Wu +3Video Anomaly Detection Temporal Video Grounding
University of California, Davis Davis, California, USA · Virginia Polytechnic Institute and State University Blacksburg, Virginia, USA
Spatio-Temporal Grounding of Large Language Models from Perception Streams
Apr 8, 2026Jacob Anderson, Bardh Hoxha, Georgios Fainekos +2Spatiotemporal Reasoning LLM Grounding
Toyota Motor North America Research & Development, Ann Arbor, MI, USA
A Paradigm Shift: Fully End-to-End Training for Temporal Sentence Grounding in Videos
Apr 3, 2026Allen He, Qi Liu, Kun Liu +2Temporal Video Grounding Parameter-Efficient Fine-Tuning
BASIS International School Park Lane Harbour · UCAS · JD Explore Academy +1
GroundVTS: Visual Token Sampling in Multimodal Large Language Models for Video Temporal Grounding
Apr 2, 2026Rong Fan, Kaiyan Xiao, Minghao Zhu +3Temporal Video Grounding Video-Language Models
Newcapec AI Research · Fudan University · Tongji University
VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification
Apr 2, 2026Jiahao Meng, Yue Tan, Qi Xu +9Video-Language Model Evaluation Long-Video QA
PKU · WHU · CASIA +2
GRAZE: Grounded Refinement and Motion-Aware Zero-Shot Event Localization
Apr 1, 2026Syed Ahsan Masud Zaidi, Lior Shamir, William Hsu +2Sports Video Analysis Temporal Action Localization
Kansas State University, Manhattan, KS, USA · Albright College, Reading, PA, USA
Incentivizing Temporal-Awareness in Egocentric Video Understanding Models
Mar 28, 2026Zhiyang Xu, Tian Qin, Bowen Jin +4Egocentric Video Understanding RL for VLMs
Virginia Tech · Harvard University · UIUC +2
SlotVTG: Object-Centric Adapter for Generalizable Video Temporal Grounding
Mar 26, 2026Jiwook Han, Geo Ahn, Youngrae Kim +1Temporal Video Grounding VLM Adaptation
Kyung Hee University · University of Southern California
CVA: Context-aware Video-text Alignment for Video Temporal Grounding
Mar 26, 2026Sungho Moon, Seunghun Lee, Jiwan Seo +1Temporal Video Grounding Vision-Language Alignment
Daegu Gyeongbuk Institute of Science and Technology (DGIST), Republic of Korea
Knowledge-Refined Dual Context-Aware Network for Partially Relevant Video Retrieval
Mar 25, 2026Junkai Yang, Qirui Wang, Yaoqing Jin +3Information Retrieval Temporal Video Grounding
School of Software Engineering, Xi’an Jiaotong University · Faculty of Computer Science, Electrical Engineering and Information Technology, Universität Stuttgart
ForeSea: AI Forensic Search with Multi-modal Queries for Video Surveillance
Mar 24, 2026Hyojin Park, Yi Li, Janghoon Cho +8Video Surveillance Multimodal IR
Qualcomm AI Research, San Diego, CA, USA · Kyunghee University, Gyeonggi, South Korea
GenSpan: Generation-Calibrated Motion Span Priors for Multi-Verb Video Corpus Moment Retrieval
Mar 23, 2026Yunzhuo Sun, Xinyue Liu, Yanyang Li +4Video Moment Retrieval Video Retrieval
Dalian University of Technology
Learning Consistent Temporal Grounding between Related Tasks in Sports Coaching
Mar 19, 2026Arushi Rai, Adriana KovashkaTemporal Video Grounding Temporal Attention
University of Pittsburgh, Pittsburgh PA 15260, USA
Learning Transferable Temporal Primitives for Video Reasoning via Synthetic Videos
Mar 18, 2026Songtao Jiang, Sibo Song, Chenyi Zhou +12VLM Post-Training Temporal Video Understanding
Zhejiang University · Qwen Team, Alibaba Group · Shanghai Jiao Tong University +1
VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Prompting
Mar 15, 2026Daeun Lee, Shoubin Yu, Yue Zhang +1RL for Video Reasoning Video Reasoning
University of North Carolina, Chapel Hill, USA
4D Synchronized Fields: Motion-Language Gaussian Splatting for Temporal Scene Understanding
Mar 15, 2026Mohamed Rayan Barhdadi, Samir Abdaljalil, Rasul Khanbayov +24D Scene Understanding Dynamic Scene Reconstruction
Texas A&M University · Hamad Bin Khalifa University

May 2, 2026J/K move · Enter open · S save

Two-Pass Zero-Shot Temporal-Spatial Grounding of Rare Traffic Events in Surveillance Video

Jiantang Huang

Temporal Video Grounding Large Vision-Language Models Anomaly Localization Vision-Language Grounding

Open paper AskPDF arXiv

Grounding traffic accidents in real CCTV footage is a rare-event problem where training on labeled accident video is often prohibited, yet accurate joint localization in time, space, and collision type is required. We present a no-fine-tuning pipeline that elicits this joint output from frozen vision-language models through two ideas. First, a coarse-to-fine two-pass decomposition: a full-video pass at 1 fps produces a coarse (t, x, y, c) tuple, then a second pass at 5 fps within a +/- 3 s window refines time and location, with two deterministic confidence gates that revert to the coarse estimate on boundary hedges or edge-clamped coordinates. Second, a specialist role assignment: Qwen3-VL-Plus handles grounding, Gemini 3.1 Flash-Lite handles typing on a centered video clip. On the ACCIDENT@CVPR 2026 benchmark (2,027 real CCTV videos) we reach ACC^S = 0.539 (95% CI [0.525, 0.553]): +0.127 over the benchmark paper's best-of-baselines oracle (0.412), +0.143 over the strongest single-VLM baseline (Molmo-7B, 0.396), and +0.250 over the naive baseline (0.289). The VLM path uses up to three API calls per video (17% fall back to physics on API failures); the full run costs ~$20.