Temporal Video Understanding

Follow this topic Ask about this topic

Momentum

23 papers in the last four weeks, up 109% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 220

All topics

LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video
Jun 4, 2026Shiqiang Lang, Jing Liu, Haoyang He +6Visual Spatial Reasoning Multimodal Large Language Models
Beijing University of Posts and Telecommunications · Zhongguancun Academy · Institute of Automation, Chinese Academy of Sciences +2
GOPAgen: Motion-Aware and Efficient Agentic Long-Video Understanding with Structural Memory and Hierarchical Reasoning
Jun 3, 2026Haozhe Chi, Yang Jin, Yadong MuVideo QA Long-Video Understanding
Peking University
NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models
Jun 3, 2026Yong Cao, Chuqiao Li, Xianghui Xie +2VLM Evaluation Temporal Video Understanding
University of Tübingen, Tübingen AI Center, Germany · Max Planck Institute for Informatics, Saarland Informatics Campus, Germany
Benchmarking Visual State Tracking in Multimodal Video Understanding
Jun 2, 2026Sihyun Yu, Nanye Ma, Pinzhi Huang +8Multimodal Large Language Models Video Reasoning
New York University · KAIST
Where Do We (Not) Need Temporal Context in Low-Resource Video Task Adaptation?
Jun 2, 2026Luc P. J. Sträter, Hazel DoughtyLinear Probing Vision Foundation Model Adaptation
Leiden University
Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events
Jun 1, 2026Xiaolin Liu, Yilun Zhu, Xiangyu Zhao +9VLM Evaluation Video QA
Shandong University · Southeast University · Shanghai Jiao Tong University +1
Question-Aware Evidence Ledgers for Video Relational Reasoning
Jun 1, 2026Yilin Ou, Mengshi Qi, Huadong MaVisual Spatial Reasoning Relational Reasoning
State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications, China
PaSBench-Video: A Streaming Video Benchmark for Proactive Safety Warning
Jun 1, 2026Yusong Zhao, Yuejin Xie, Youliang Yuan +4Traffic Accident Anticipation Video-Language Models
The Chinese University of Hong Kong, Shenzhen · Tsinghua University
Understanding-Enhanced Model Collaboration for Long-Tailed Egocentric Mistake Detection
Jun 1, 2026Boyu Han, Qianqian Xu, Shilong Bao +3Egocentric Video Understanding Temporal Video Understanding
State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · School of Computer Science and Tech., University of Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence +2
CoSTL: Comprehensive Spatial-Temporal Representation Learning for Moment Retrieval and Highlight Detection
May 31, 2026Xin Dong, Wenjia Geng, Wenfeng Deng +1Temporal Video Grounding Video Representation Learning
Shenzhen International Graduate School, Tsinghua University · Pengcheng Laboratory
Temporal Evidence Routing with Structured Visual Evidence for TimeLogicQA
May 31, 2026Yuyang Sun, Yongliang Wu, Xingyu Zhu +8Video QA Structured Reasoning
Southeast University · National University of Singapore · Independent Researcher +2
FROST-STA: Frozen Dense Features for the Ego4D Short-Term Object Interaction Anticipation
May 30, 2026Chaoyang Wang, Lexuan XuEgocentric Video Understanding Temporal Video Understanding
Beihang University
Pause and Think: A Dataset and Benchmark for Video-Grounded Assistive Action Suggestion
May 30, 2026Shivam Singh, Saptarshi Majumder, Pratik Prabhanjan Brahma +2Vision-Language Grounding Video Reasoning
IIIT Hyderabad · Work done during Shivam Singh’s internship at Advanced Micro Devices, Inc. (AMD). · Advanced Micro Devices, Inc. (AMD)
ConTrans: Learning Text-enhanced Local-global Temporal Representations for Zero-shot Temporal Action Localization
May 29, 2026Kanchan Keisham, Thenukan Pathmanathan, Thangarajah AkilanZero-Shot Learning Hybrid CNN-Transformer Architectures
Vellore Institute of Technology, India · Lakehead University, Canada
Masked Diffusion Vision-Language Models for Temporal Action Localization
May 28, 2026Fengshun Wang, Zhengbo Zhang, Zhigang TuHuman Activity Recognition Video-Language Models
Wuhan University · Singapore University of Technology and Design
Multi-Stage VLM Pipeline for Zero-Shot Traffic Accident Understanding
May 28, 2026Fumiya Tatematsu, Fumihiko TakahashiVLMs for Autonomous Driving Temporal Video Understanding
GO Drive Inc.
Mining Multi-Modality Spatio-Temporal Cues for Video Important Person Identification
May 27, 2026Xiao Wang, Minglei Yang, Bin Yang +4Temporal Video Understanding
School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, Hubei 430065, China and Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology,Wuhan 430065, China · School of Computer Science, National Engineering Research Center for Multimedia Software, Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University, China · College of Computing and Data Science, Nanyang Technological University
VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfer
May 27, 2026Rui Lin, Chuanming Wang, Huadong MaVLM Adaptation Video Representation Learning
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, China
ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning
May 27, 2026Crystal Cai, Ziyi Wang, Zhengjie Zhang +3Temporal Attention Temporal Video Understanding
Shanghai Jiao Tong University, Shanghai, 200240, China. · The Hong Kong University of Science and Technology, Guangzhou, 511453, China.
Tensor Memory: Fixed-Size Recurrent State for Long-Horizon Transformers
May 26, 2026Kabir Swain, Sijie Han, Daniel Karl I. Weidele +2Memory-Augmented Neural Networks Memory-Augmented Language Models
Massachusetts Institute of Technology, Cambridge, MA, USA · University of Toronto, Toronto, Canada · IBM Research, Cambridge, MA, USA
Pop-Up Distractions Reveal Bag-of-Events Behavior in Video Large Language Models
May 26, 2026Oscar Chew, Serhii Honcharenko, Qian-Hui Chen +4Temporal Video Grounding Video-Language Model Evaluation
Texas A&M University · National Taiwan University · Stanford University +1
DynFrame: Adaptive Reasoning-Driven Multimodal Framework with Dynamic Frame Augmentation for Complex Video Understanding
May 26, 2026Peng Zhang, Guanghao Zhang, Wanggui He +10Multimodal Large Language Models Video Reasoning
Zhejiang University · Alibaba Group
Not All Modalities Are Equal: Instruction-Aware Gating for Multimodal Videos
May 25, 2026Bonan Ding, Umair Nawaz, Ufaq Khan +5Cross-Modal Learning Multimodal Large Language Models
Mohamed bin Zayed University of Artificial Intelligence · Tianjin University · Chongqing University +1
STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models
May 25, 2026Yiming Liang, Yixiao Chen, Yiyang Zhou +8Efficient VLM Inference Latent Visual Reasoning
1Purdue · 2Harvard · 3UNC +3
TempRet: Temporal Enhancement and Two-Stage Reranking for CVPR 2026 EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge
May 23, 2026Zixu Li, Yupeng Hu, Zhiwei Chen +4Learning to Rank Cross-Modal Retrieval
Shandong University · Harbin Institute of Technology (Shenzhen)
U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025
May 22, 2026Duc-Nhuan Le, Hoang-Phuc Nguyen, Thanh-Duy Lam +2Multimodal IR Information Retrieval
Faculty of Information Technology, University of Science, VNU-HCM · Vietnam National University, Ho Chi Minh City, Vietnam
The TIME Machine: On The Power of Motion for Efficient Perception
May 21, 2026Mantas Skackauskas, Xinyue Hao, Laura Sevilla-LaraRepresentation Learning Video Representation Learning
School of Informatics University of Edinburgh
Which Way Did It Move? Diagnosing and Overcoming Directional Motion Blindness in Video-LLMs
May 21, 2026Jongseo Lee, Hyuntak Lee, Sunghun Kim +3Video-Language Models Temporal Video Understanding
Kyung Hee University · Princeton University
Improving Viewpoint-Invariance and Temporal Consistency for Action Detection
May 21, 2026Yannick Porto, Renato Martins, Thomas Chalumeau +1Video Action Recognition Invariant Representation Learning
⋆Universit Bourgogne Europe, CNRS, ICB · † TEB Group, Prynel SAS
Swift Sampling: Selecting Temporal Surprises via Taylor Series
May 21, 2026Dahye Kim, Bhuvan Sachdeva, Karan Uppal +3Video Frame Selection Long-Video QA
Boston University · Microsoft Research India

Jun 4, 2026, cs.CVJ/K move · Enter open · S save

LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video

Shiqiang Lang, Jing Liu, Haoyang He, Peiwen Sun+5

Beijing University of Posts and Telecommunications · Zhongguancun Academy · Institute of Automation, Chinese Academy of Sciences+2

Visual Spatial Reasoning Multimodal Large Language Models Temporal Video Understanding

Open paper AskPDF arXiv

Multimodal Large Language Models (MLLMs) have advanced image and video understanding and can increasingly handle longer visual inputs. Long-horizon tasks such as autonomous driving and robotic navigation require more than recognizing the current view, as models must remember and retrieve previously observed spatial layouts, routes, viewpoint changes, and object states. To evaluate this capability, we introduce LongSpace-Bench, a room-tour video benchmark for long-horizon spatial memory, covering scene perception, spatial relations, and spatial memory. In this work, we further propose LongSpace, a memory framework for long-video spatial reasoning. LongSpace models long videos as sequential chunks, incorporates 3D structural cues into early decoder layers, and constructs layer-aware memory for question-guided retrieval. Experiments on multiple spatial reasoning benchmarks show that LongSpace improves long-video spatial understanding, further demonstrating explicit spatial memory as a key capability for long-horizon video MLLMs.

Momentum

Related topics

Latest papers 220