Spatiotemporal Reasoning

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 45

All topics

VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis
May 21, 2026Jinho Park, Youbin Kim, Hogun Park +1VLM Evaluation Spatiotemporal Reasoning
Department of Artificial Intelligence, Sungkyunkwan University · Department of Artificial Intelligence, Yonsei University
GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoning
May 21, 2026Deshui Miao, Xingsen Huang, Yameng Gu +3Visual Spatial Reasoning Spatiotemporal Reasoning
Harbin Institute of Technology, Shenzhen · Hainan University · Pengcheng Laboratory +2
From Prompts to Pavement Through Time: Temporal Grounding in Agentic Scene-to-Plan Reasoning
May 19, 2026Ahmed Y. Gado, Omar Y. Goba, Alaa Hassanein +2Spatiotemporal Reasoning Autonomous Driving Planning
Computer Science & Engineering Department, German University in Cairo (GUC), Egypt · C-DRiVeS Lab: Cognitive Driving Research in Vehicular Systems, Cairo, Egypt
LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue
May 19, 2026Chaoyue Li, Yongxue Xu, Jie Feng +1Spatiotemporal Reasoning Multimodal Large Language Models
Huazhong University of Science and Technology · Sun Yat-sen University · Beihang University +1
STT-Arena: A More Realistic Environment for Tool-Using with Spatio-Temporal Dynamics
May 18, 2026Tingfeng Hui, Hao Xu, Pengyu Zhu +5Spatiotemporal Reasoning LLM Planning
Hong Kong Institute of AI for Science, City University of Hong Kong · Beijing University of Posts and Telecommunications · Li Auto Inc. +2
QSTRBench: a New Benchmark to Evaluate the Ability of Language Models to Reason with Qualitative Spatial and Temporal Calculi
May 18, 2026Anthony G. Cohn, Robert E. BlackwellSpatial Reasoning Benchmarks LLM Evaluation
School of Computer Science, The University of Leeds, Woodhouse Lane, Leeds, LS2 9JT, UK · The Alan Turing Institute, British Library, 96 Euston Road, London, NW1 2DB, UK · Tongji University, Shanghai, China
LASAR: Towards Spatio-temporal Reasoning with Latent Cognitive Map
May 16, 2026Jinzhou Tang, Sidi Liu, Waikit Xiu +2Spatiotemporal Reasoning State Representation Learning
1Sun Yat-sen University
STAR: Failure-Aware Markovian Routing for Multi-Agent Spatiotemporal Reasoning
May 11, 2026Ruiyi Yang, Lihuan Li, Hao Xue +1Multi-Agent LLM Systems Spatiotemporal Reasoning
University of New South Wales · The Hong Kong University of Science and Technology (Guangzhou)
HOME-KGQA: A Benchmark Dataset for Multimodal Knowledge Graph Question Answering on Household Daily Activities
May 10, 2026Shusaku Egami, Aoi Ohta, Tomoki Tsujimura +5Multi-Hop QA Spatiotemporal Reasoning
National Institute of Advanced Industrial Science and Technology (AIST) Koto-ku, Tokyo, Japan
ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation
May 6, 2026Wei Li, Jizhihui Liu, Li Yixing +3Multi-View Consistency Spatiotemporal Reasoning
Harbin Institute of Technology, Shenzhen · State Key Laboratory of Mobile Network and Mobile Multimedia Technology, ZTE, China · Shenzhen Loop Area Institute
EO-Gym: A Multimodal, Interactive Environment for Earth Observation Agents
May 2, 2026Sai Ma, Zhuang Li, Sichao Li +4Spatiotemporal Reasoning Remote Sensing
The Australian National University · Royal Melbourne Institute of Technology · University of Sydney +1
Predictive Spatio-Temporal Scene Graphs for Semi-Static Scenes
Apr 30, 2026Miguel Saavedra-Ruiz, Charlie Gauthier, Kumaraditya Gupta +4Spatiotemporal Reasoning Spatiotemporal Forecasting
Department of Computer Science and Operations Research, Universit´e de Montr´eal, Montr´eal, QC, Canada. · Mila - Quebec AI Institute, Montreal, QC, Canada. · Independent Researcher. +1
SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments
Apr 24, 2026Chih-Ting Liao, Xi Xiao, Chunlei Meng +6Spatial Reasoning Benchmarks Visual Spatial Reasoning
The University of New South Wales · The University of Alabama at Birmingham · Fudan University +4
Exploring High-Order Self-Similarity for Video Understanding
Apr 22, 2026Manjin Kim, Heeseung Kwon, Karteek Alahari +1Spatiotemporal Reasoning Video Action Recognition
POSTECH · RLWRLD Inc. · INRIA Grenoble Rhône-Alpes
SurgCoT: Advancing Spatiotemporal Reasoning in Surgical Videos through a Chain-of-Thought Benchmark
Apr 22, 2026Gui Wang, YongSong Zhou, Kaijun Deng +4Spatiotemporal Reasoning Healthcare
School of Computer Science and Software Engineering, Shenzhen University · University of Nottingham · School of AI, Shenzhen University +1

May 21, 2026, cs.CVJ/K move · Enter open · S save

VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis

Jinho Park, Youbin Kim, Hogun Park, Eunbyung Park

Department of Artificial Intelligence, Sungkyunkwan University · Department of Artificial Intelligence, Yonsei University

VLM Evaluation Spatiotemporal Reasoning Synthetic Benchmark Generation Temporal Video Understanding

Open paper AskPDF arXiv

Spatio-temporal reasoning is a core capability for Multimodal Large Language Models (MLLMs) operating in the real world. As such, evaluating it precisely has become an essential challenge. However, existing spatio-temporal reasoning benchmark datasets primarily rely on static image sets or passively curated video data, which limits the evaluation of fine-grained reasoning capabilities. In this paper, we introduce VGenST-Bench, a video benchmark that employs generative models to actively synthesize highly controlled and diverse evaluation scenarios. To construct VGenST-Bench, we propose a multi-agent pipeline incorporating a human quality control stage, ensuring the quality of all generated videos and QA pairs. We establish a comprehensive 3x2x2 video taxonomy, encompassing Spatial Scale, Perspective, and Scene Dynamics to span diverse scenarios. Furthermore, we design a hierarchical task suite that decouples low-level visual perception from high-level spatio-temporal reasoning. By shifting the paradigm from passive curation to active synthesis, VGenST-Bench enables fine-grained diagnosis of spatio-temporal understanding in MLLMs.

Momentum

Related topics

Latest papers 45