Temporal Video Grounding

Follow this topic Ask about this topic

Momentum

15 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 109

All topics

The Visual Bottleneck: Sparse-Frame Adaptation of MLLMs for Joint Spatial-Temporal Video Grounding
Jul 27, 2026Jiameng Zhang, Srikanth MadikeriTemporal Video Grounding VLM Adaptation
University of Zurich
TimePLE: Rethinking Temporal Representation for Video Temporal Grounding
Jul 27, 2026Yuhui Zeng, Xinyu Mao, Xiaokun Liu +4Temporal Video Grounding Representation Learning
Media Analytics and Computing Lab, Xiamen University, Xiamen, China · Kling Team, Kuaishou Technology, China · The Chinese University of Hong Kong, HKSAR, China +1
OmniReasoner: Thinking with Long Audio-Video via Native Tool Use
Jul 21, 2026Yu Chen, Caorui Li, Ziyu Xiong +8Temporal Video Grounding Audio-Visual Understanding
University of Chinese Academy of Sciences · Institute of Automation, CAS · Southeast University +3
Mitigating Modality and Language-Style Gaps for Zero-Shot Video Moment Retrieval
Jul 21, 2026Jihyun Lee, Cheol-Ho Cho, Woojin Jun +2Temporal Video Grounding Vision-Language Alignment
Sungkyunkwan University, Suwon, Republic of Korea
TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs
Jul 19, 2026Yuhan Zhu, Changlian Ma, Xiangyu Zeng +12Temporal Video Grounding Reinforcement Learning
Nanjing University · Shanghai AI Laboratory · Shanghai Jiao Tong University +3
Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QA
Jul 17, 2026Ce Zhang, Ziyang Wang, Yulu Pan +6Temporal Video Grounding Tool-Using Vision-Language Agents
University of North Carolina at Chapel Hill · Sony
Modularized Dynamic-Granularity Video LLM for Multi-Event Long Video Understanding
Jul 17, 2026Wei Feng, Xin Wang, Yu-Wei Zhan +2Temporal Video Grounding Video-Language Models
Department of Computer Science and Technology, Tsinghua University · Beijing National Research Center for Information Science and Technology, Tsinghua University
ScanFocus: A Coarse-to-Fine Framework for Spatio-Temporal Video Grounding
Jul 15, 2026Kai Chen, Ming Dai, Wenxuan Cheng +1Temporal Video Grounding Vision-Language Grounding
Southeast University
Evidence-Backed Video Question Answering
Jul 13, 2026Shijie Wang, Honglu Zhou, Ziyang Wang +5Temporal Video Grounding Video QA
Salesforce, Palo Alto, CA, USA · Brown University, Providence, RI, USA
Overview of the NLPCC 2026 Shared Task 1: Difficulty-Aware Multilingual and Multimodal Medical Instructional Video Understanding Evaluation
Jul 7, 2026Shenxi Liu, Kan Li, Mingyang Zhao +2Multimodal IR Temporal Video Grounding
School of Computer Science and Technology, Beijing Institute of Technology · Department of Computing, The Hong Kong Polytechnic University · Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences
Video-Text Temporal Localization via Multi-Scale Convolution and Dynamic Routing
Jul 6, 2026Gengtian Shi, Jinze Yu, Chenhao Wu +5Temporal Video Grounding Temporal Convolutional Networks
Graduate School of Fundamental Science and Engineering, Waseda University, Tokyo, Japan · Generative AI Innovation Center, Amazon Web Services, Japan · Amazon, Germany
TimeThink: Reasoning with Time for Video LLMs
Jul 6, 2026Handong Li, Longteng Guo, Zikang Liu +8Temporal Video Grounding Process Reward Models
School of Artificial Intelligence, University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · OPPO AI Center, OPPO Inc.
EventCoT: Event-centric Video Chain-of-thought for Reasoning Temporal Localization
Jul 6, 2026Youngkil Song, Yoonjae Baek, Dongwon Kim +3Temporal Video Grounding Multimodal CoT Reasoning
1Pohang University of Science and Technology, Pohang, South Korea · 2Korea Advanced Institute of Science and Technology, Daejeon, South Korea · 3Handong Global University, Pohang, South Korea
QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding
Jul 6, 2026Wei Ao, Lan Wang, Vishnu Naresh BoddetiTemporal Video Grounding Streaming Video Understanding
Michigan State University, East Lansing MI 48824, USA
Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning
Jul 3, 2026Wenzheng Zeng, Siyi Jiao, Chen Gao +2Temporal Video Grounding Video Captioning
National University of Singapore, Singapore
S-EMBER: A Large-Scale Benchmark for Streaming Egocentric Memory Retrieval
Jul 2, 2026Xiaodong Wang, Xuanyi Zhao, Pedro Rodriguez +7Temporal Video Grounding Episodic Memory
1FAIR, Meta · 2Reality Labs, Meta
AnyGroundBench: A Multi-Domain Adaptation Benchmark for Video Grounding in VLMs
Jul 2, 2026Rintaro Otsubo, Ryo Fujii, Reina Ishikawa +6VLM Evaluation Temporal Video Grounding
Keio University · Keio AI Research Center · Keio University School of Medicine +1
LongEgoRefer: A Benchmark for Long-Form Egocentric Video Referring Expression Comprehension
Jul 2, 2026Shunya Kato, Taiki Miyanishi, Shuhei Kurita +3Temporal Video Grounding Video Understanding
Woven by Toyota, Japan · The University of Tokyo, Japan · National Institute of Informatics, Japan +3
DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding
Jul 1, 2026Zhengbo Zhang, Mark He Huang, Zhigang Tu +1Temporal Video Grounding VLM Reasoning
Singapore University of Technology and Design · Wuhan University · University of California, Merced
VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
Jul 1, 2026Seohyun Lee, Seoung Choi, Dohwan Ko +2Temporal Video Grounding Temporal IR
KAIST, Daejeon, Republic of Korea · Korea University, Seoul, Republic of Korea
Efficient Spatio-Temporal Grounding with Multimodal Large Models via Second-Level Tracking and RL Verification
Jun 27, 2026Tianshu Zhang, Yan Wang, Ji Qi +1Temporal Video Grounding Efficient Multimodal Inference
Tsinghua University
EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence
Jun 23, 2026Linpeng Huang, Weixing Chen, Zexin Chen +2VLM Evaluation Temporal Video Grounding
Sun Yat-sen University · Shenzhen University · Peng Cheng Laboratory
SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards
Jun 23, 2026Sheng Xia, Zhengqin Lai, Tianxiang Jiang +4Temporal Video Grounding Video Reasoning
Nanjing University · Shanghai Innovation Institute · Harbin Institute of Technology, Shenzhen +2
TimeProVe: Propose, then Verify for Efficient Long Video Temporal Reasoning in Activities of Daily Living
Jun 18, 2026Arkaprava Sinha, Dominick Reilly, Siddharth Krishnan +2Temporal Video Grounding Efficient VLM Inference
University of North Carolina, Charlotte
Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos
Jun 15, 2026Ke Li, Di Wang, Yongshan Zhu +5Remote Sensing Image Understanding Temporal Video Grounding
School of Computer Science and Technology, Xidian University, Xi’an 710071, China · Interdisciplinary Institute of Artificial Intelligence, Xidian University, Xi’an, Shaanxi 710126, China · School of Artificial Intelligence, Xidian University, Xi’an 710071, China +2
Conditional Multi-Event Temporal Grounding in Long-Form Video
Jun 13, 2026Yuanhao Zou, Arthad Kulkarni, Lucas Tonanez +12Temporal Video Grounding Long-Video Understanding
University of Central Florida · 2Qualcomm AI Research
Natural-Language Temporal Grounding in Hour-Long Videos is a Search Problem: A Benchmark and Empirical Decomposition
Jun 10, 2026Sukmin Seo, Geewook KimTemporal Video Grounding Temporal IR
NAVER Cloud AI · NAVER Cloud AI KAIST AI
Kwai Keye-VL-2.0 Technical Report
Jun 9, 2026Kwai Keye Team, Bin Wen, Changyi Liu +50Temporal Video Grounding Long-Context Modeling
Temporal-Aware Reasoning Optimization for Video Temporal Grounding
Jun 8, 2026Minghang Zheng, Zihao Yin, Yi Yang +2Temporal Video Grounding Temporal Reasoning
Wangxuan Institute of Computer Technology, Peking University · Central Media Technology Institute, Huawei Technologies Ltd. · State Key Laboratory of General Artificial Intelligence, Peking University.
CACR:Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoning
Jun 7, 2026Muge Qi, Rong Fu, Pengbin Feng +7Temporal Video Grounding Video Understanding
National Biomedical Imaging Center, Peking University, Beijing, China · University of Macau, Macau, China · University of Southern California, Los Angeles, USA +3

Jul 27, 2026, cs.CVJ/K move · Enter open · S save

The Visual Bottleneck: Sparse-Frame Adaptation of MLLMs for Joint Spatial-Temporal Video Grounding

Jiameng Zhang, Srikanth Madikeri

University of Zurich

Temporal Video Grounding VLM Adaptation Vision-Language Grounding Video Frame Selection

Open paper AskPDF arXiv

Large-scale video platforms process millions of uploads hourly, requiring moderation systems that can localize when and where policy violations occur within each video. Processing every frame is infeasible at scale, so systems are constrained to sparse inputs of 8 to 16 frames per video. Yet state-of-the-art multimodal large language models (MLLMs) are pretrained on dense sequences of hundreds of frames, creating a fundamental mismatch between training and deployment conditions. This mismatch causes severe performance collapse: the Qwen3-VL 8B model drops from 56.0% to 22.3% temporal mIoU when frames are reduced to 16, a 60.2% relative degradation. We present a systematic empirical study of training strategies to close this gap for spatial-temporal video grounding. Our results suggest that visual feature extraction is the dominant bottleneck under sparse-frame inputs. Adapting only the final three ViT layers, 4% of total parameters, achieves 68.8% temporal mIoU and surpasses a zero-shot 8B model using dense inputs by 12.8 points. Language model fine-tuning, by contrast, offers negligible or negative returns. A boundary-aware sampling strategy, Hybrid16, further improves temporal mIoU by 26 points over uniform sampling when temporal boundaries are available. We conclude that for sparse-frame video grounding, training strategy dominates model scale: a fine-tuned 2B model consistently outperforms a zero-shot 8B model, with or without dense frame access.

Momentum

Related topics

Latest papers 109