Spatiotemporal Reasoning

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 45

All topics

SpaTime: Streaming Vision-Language Models for Spatio-temporal Reasoning
Oct 6, 2026Hairong Yin, Huangying Zhan, Shin-Fang Chng +2Vision-Language Models Spatiotemporal Reasoning
Department of Computer Science, Purdue University, USA · Goertek Alpha Labs, USA
Why Do Conventional World Models Fail to Learn Cellular Automata?
Sep 30, 2026Shaoyang Guo, Ziming LiuWorld Model Learning Spatiotemporal Reasoning
Meta Circle(元环智能) · Peking University · Tsinghua University
Long Time No See: Benchmarking VLMs for Out-of-Sight Spatiotemporal Reasoning in Egocentric Videos
Sep 28, 2026Fangzhou Ma, Ivo Alexander Ban, Eren Homburg +5Temporal Video Grounding Visual Spatial Reasoning
ETH Zurich · Microsoft Spatial AI Lab · Bocconi University
MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perception
Sep 27, 2026Yuhao Li, Louie Hong Yao, Tianyi Shi +4Spatiotemporal Reasoning Positional Encoding
Wave Intelligence Lab · Department of Computer Science and Engineering, The Chinese University of Hong Kong · Shanghai Artificial Intelligence Laboratory
OCC4M: Object-Centric 4D Memory for Spatiotemporal Reasoning in Long-Horizon Manipulation
Sep 23, 2026Jack B. Jedlicki, Tanguy Dieudonné, Heng YangLong-Horizon Robotic Manipulation Spatiotemporal Reasoning
Harvard University · ETH Zürich
ReSTI: A Source-Grounded Audit and Repair of STI-Bench
Sep 21, 2026Pengzhan Sun, Ramanathan Rajaraman, Shiu-Hong Kao +2Spatial Reasoning Benchmarks Spatiotemporal Reasoning
National University of Singapore · University of Science and Technology of China
Do LiDAR Language Models Really Understand Spatio-temporal Relationships?
Sep 21, 2026Runyi Yang, Murat Akkoyun, Di Wen +8VLM Evaluation Hallucination Detection in VLMs
INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria · Karlsruhe Institute of Technology, Germany · Hunan University, China
Unified Vision-Centric Pedestrian Crossing Action Prediction via Adaptive Patch Projection and Proactive Spatial Rectification
Sep 7, 2026Yao Tian, Le Yang, Binglu WangPedestrian Intention Prediction VLMs for Autonomous Driving
School of Electronics and Control Engineering, Chang’an University, Xi’an 710064, China · School of Astronautics, Northwestern Polytechnical University, Xi’an 710072, China
GESTO: Human-Centric Spatio-Temporal Memory for Reasoning in Dynamic Scenes
Aug 11, 2026Ermanno Bartoli, Buwei He, Dennis Rotondi +6Spatiotemporal Reasoning Graph-Based Agent Memory
Department of Robotics, Perception and Learning, KTH Royal Institute of Technology, Sweden · Socially Intelligent Robotics Lab at the Institute for Artificial Intelligence, University of Stuttgart, Germany · Intl. Max Planck Research School for Intelligent Systems (IMPRS-IS) +2
PULSE: An Executable Contract Language for Spatiotemporal Knowledge Graph Engineering
Jul 26, 2026Dongxu Yang, Ziyi LiangKG Construction Spatiotemporal Reasoning
DeepLethe
Structure over Depth: A Single-Block Spatio-Temporal Transformer for Multi-Entity Reasoning
Jul 25, 2026Narthana Sivalingam, Santhirarajah Sivasthigan, Buddhi Wijenayake +3Spatiotemporal Reasoning Human Activity Recognition
Department of Electrical and Electronic Engineering University of Peradeniya Peradeniya, Sri Lanka
From Scalars to Time Series: Rethinking Implicit Neural Representations for Time-Varying Volumetric Data
Jul 23, 2026Weihan Zhang, Xuan Zhao, Yenwen Peng +2Implicit Neural Representations Spatiotemporal Reasoning
School of Computer Science and Engineering, Sun Yat-sen University · Department of Computer Science, Hong Kong Baptist University · School of Computer Science and Engineering, Sun Yat-sen University, Guangdong Province Key Laboratory of Computational Science, and National Supercomputer Center in Guangzhou
ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
Jul 23, 2026Han Li, Si Liu, Zehao Huang +6VLM Evaluation Spatial Reasoning Benchmarks
School of Artificial Intelligence, Beihang University, Beijing 100191, China · Zhongguancun Academy, Beijing 100094, China · School of Engineering, Westlake University, Hangzhou 310030, China
Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs
Jul 17, 2026Like Liu, Zhengzheng Xu, Haitao He +3Multimodal Grounding Aerial Robotics
Northwestern Polytechnical University Xi’an, Shaanxi, China
GeoChrono: Benchmarking and Rethinking Long-Term Temporal Understanding in Remote Sensing
Jul 17, 2026Yujie Li, Jiancheng Pan, Zhiwei Wei +3Spatiotemporal Reasoning Geospatial Representation Learning
Beijing University of Posts and Telecommunications Haidian, Beijing, China · Tsinghua University Haidian, Beijing, China · Hunan Normal University Changsha, Hunan, China +1
From Continuous Deployment to Queryable Dataset: Terabyte-Scale AIS-Aligned Passive Acoustic Labelling
Jul 15, 2026Wayne Renaud, Priyanka Aravindan, Gabriel SpadonSpatiotemporal Reasoning Passive Acoustic Monitoring
Faculty of Computer Science, Dalhousie University, Halifax, Canada
DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs
Jul 14, 2026Rongxin Gao, Yuzhi Huang, Dongxuan Liu +8Spatiotemporal Reasoning Visual Object Tracking
1Xiamen University · 2Shenzhen International Graduate School, Tsinghua University · 3China University of Mining and Technology +1
Discovering Frequent Closed Embedded Sub-DAGs in Spatio-Temporal Event Data
Jul 7, 2026Piotr S. MaciągSpatiotemporal Reasoning
Institute of Computer Science, Warsaw University of Technology, Nowowiejska 15/19, 00-661, Warsaw
An Event-Driven Framework for Fly-Inspired Visual Motion Detection
Jul 6, 2026Qinbing Fu, Jingyu Huang, Yan Xie +2Event-Based Vision Visual Attention
School of Mathematics and Information Science, Guangzhou University, China
STRATOS: Bridging the Symbolic-to-Numeric Gap in Spatio-Temporal Text-to-SQL for Meteorological Data
Jul 3, 2026Yi Zhang, Farhad Nooralahzadeh, Jonathan Fürst +4Spatiotemporal Reasoning Text-to-SQL
Zurich University of Applied Sciences · National Oberservatory of Athens
What We are Missing in Multimodal LLM Evaluation?
Jun 24, 2026Po-han Li, Shenghui Chen, Sandeep Chinchali +1Spatiotemporal Reasoning Multimodal Large Language Models
The University of Texas at Austin, USA
MotionHalluc: Diagnosing Kinematic Hallucinations in Fine-Grained Motion Reasoning
Jun 22, 2026Weile Guo, Shenghong He, Danying Mo +3VLM Evaluation Spatiotemporal Reasoning
1Sun Yat-Sen University · 2Shenzhen University
Efficient Continuous Semantic Mapping based on Spatio-Temporal Awareness
Jun 21, 2026My Le Pham, Dinh Trieu Duong, Xiem HoangVan +1Spatiotemporal Reasoning 3D Semantic Segmentation
University of Engineering and Technology, Vietnam National University, 10000, Hanoi, Vietnam. · School of Information Science, Japan Advanced Institute of Science and Technology, Nomi, 923-1211, Ishikawa, Japan.
Beyond Time Series: Spatial Reasoning for Epidemic Forecasting via Multimodal Learning
Jun 20, 2026Diana Guadalupe Gomez, Chenwei Wu, Zhiyi Wang +2Epidemic Forecasting Spatiotemporal Reasoning
University of Michigan Ann Arbor, MI, USA
Monitoring Diameters of Causal Communication Graph with Spatio-Temporal Logic
Jun 19, 2026Lydia Bakiri, Jérémy Dubut, Sergio MoverReachability Analysis Spatiotemporal Reasoning
LIX, CNRS, École polytechnique, Institut Polytechnique de Paris, Palaiseau, France
UrbanWell: Benchmarking Multimodal Large Language Models for Spatio-Temporal Urban Wellbeing Analytics
Jun 14, 2026Yanxin Xi, Xiang Su, Jie Feng +3Spatiotemporal Reasoning Multimodal Large Language Models
Department of Computer Science, University of Helsinki, Helsinki, Finland · Department of Computer Science, Department of Agricultural Sciences, University of Helsinki, Helsinki, Finland · Zhongguancun Academy, Beijing, China +2
OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning
Jun 14, 2026Maonan Wang, Zhengyan Huang, Kemou Jiang +13Autonomous Driving Datasets Spatiotemporal Reasoning
The Chinese University of Hong Kong, Shenzhen · Shanghai AI Lab · Beihang University +3
OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs
Jun 2, 2026Yifei Li, Pengyiang Liu, Yuhang Zang +4Spatial Reasoning Benchmarks Spatiotemporal Reasoning
Tsinghua University · Shanghai AI Laboratory · Beihang University
TravelEval: A Comprehensive Benchmarking Framework for Evaluating LLM-Powered Travel Planning Agents
May 31, 2026Weiyi Chen, Shuaixiong Wang, Ziyun Gao +5Spatiotemporal Reasoning LLM Agent Evaluation
Zhejiang University · Hangzhou, China · Hong Kong Polytechnic University +5
Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amap
May 27, 2026Sicong Wang, Ruiting Dong, Yue Liu +7Spatiotemporal Reasoning CoT Distillation
AMAP, Alibaba Group, Beijing, China

Oct 6, 2026, cs.CVJ/K move · Enter open · S save

SpaTime: Streaming Vision-Language Models for Spatio-temporal Reasoning

Hairong Yin, Huangying Zhan, Shin-Fang Chng, Yi Xu+1

Department of Computer Science, Purdue University, USA · Goertek Alpha Labs, USA

Vision-Language Models Spatiotemporal Reasoning VLM Reasoning 3D VLMs Temporal Video Understanding

Open paper AskPDF arXiv

Embodied agents must reason about 3D space while the video is still arriving, answering questions as soon as they have observed enough of the scene. VLMs that incorporate 3D geometric priors achieve strong spatial reasoning, but they operate offline, i.e., the full video must be available before they produce an answer. Streaming VLMs process frames causally and decide for themselves when to respond, yet they lack explicit 3D representations. We present SpaTime, a streaming VLM that fuses causal geometry tokens into the language model at every frame, using only the frames observed so far. To supervise when the model answers, we propose a response-time loss that maps per-frame response probabilities to a differentiable expected response time and penalizes the distance from the ground-truth frame. For evaluation, we construct StreamVSTI-Bench and StreamVSI-Bench, streaming adaptations of VSTI-Bench and VSI-Bench. On StreamVSTI-Bench, SpaTime reaches 49.2% overall accuracy and reduces the mean response-time error by 66% relative to the strongest streaming baseline.

Momentum

Related topics

Latest papers 45