Multimodal Spatial Reasoning

Follow this topic Ask about this topic

Latest papers

42 papers6 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction
Oct 16, 2026Wajeeha Tahir, Anna Tegon, Lionnus Kesting +4Spatial Context Modeling Visual Spatial Reasoning
Integrated Systems Laboratory, ETH Zürich, Switzerland · Pázmány Péter Catholic University, Hungary
EgoP $^{2}$ C: Internalizing Plan-Perceive-Compose for Spatial Reasoning in Egocentric Video
Oct 15, 2026Chaoyu Li, Arka Sadhu, Yuliang Li +3Visual Spatial Reasoning Multimodal Spatial Reasoning
Arizona State University · Meta
MJev-Spatial: System One Spatial Intelligence via Native Attention Matching
Oct 15, 2026Luozheng Qin, Yuhan Zhu, Changhai Zhou +9Spatial Reasoning in Language Models Visual Spatial Reasoning
Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models
Oct 13, 2026Mahdieh Mallahnezhad, Masoud Jafaripour, Mohamadali Tofigh +2Multimodal Spatial Reasoning Multimodal Large Language Models
Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada. · Alberta Machine Intelligence Institute (Amii) Fellow, CIFAR Fellow.
What Makes a Good Visual Representation for Spatial Understanding in MLLMs?
Oct 13, 2026Xiaohu Huang, Yumin Guo, Kai HanMultimodal Spatial Reasoning Multimodal Large Language Models
The University of Hong Kong
S-Space: Exploring Spatial Workspace in Multimodal Language Models
Oct 9, 2026Zhiyuan Shi, Xiang Li, Xingzhuo Guo +8Spatial Reasoning in Language Models Spatial Reasoning
Seek-and-View Reasoning for Multi-View Spatial Understanding
Oct 8, 2026Qixiang Chen, Cheng Zhang, Fucai Ke +3Multimodal Spatial Reasoning Visual Spatial Reasoning
Monash University · The Chinese University of Hong Kong
Have I Scene This Before? Spatially Grounded Conversational Memory for Complex Queries in Egocentric Assistants
Oct 4, 2026Jiazhou Liang, Liam Gallagher, Kiko Chen +4Conversational Memory Egocentric Video Understanding
University of Toronto
Seeing, Saying, but Not Using: From Reportable Spatial Facts to Usable States in Multimodal Large Language Models
Oct 2, 2026Jinchang Zhang, Guoyu LuMultimodal Spatial Reasoning Multimodal Large Language Models
Intelligent Vision and Sensing (IVS) Lab Indiana University Bloomington Bloomington, IN, USA
Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering
Sep 29, 2026Jaewoo Jung, Hyeonseo Yu, Honggyu An +103D Spatial Reasoning 3D Scene Representation
KAIST AI · ETH Zürich · Google +2
SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning
Sep 27, 2026Yang Cao, Jiaxin Zhang, Dave Zhenyu Chen +4Visual Spatial Reasoning Multi-View 3D Reconstruction
Hong Kong University of Science and Technology · Harbin Institute of Technology · Huawei Noah’s Ark Lab
MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling
Sep 7, 2026Jin Xu, Xiaojian Huang, Zhuodong Luo +6Spatial Reasoning Benchmarks 3D Spatial Reasoning
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China, China · Huawei Noah’s Ark Lab · Hefei University of Technology, China
SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation
Aug 14, 2026Jinsheng Quan, Jianhua Li, Siyi Xie +7Multimodal Spatial Reasoning 3D Spatial Reasoning
Zhejiang University · SenseTime Research · Peking University
Trace, Verify, and Correct: A Training-Free Framework for Spatial Reasoning in Multimodal LLMs
Aug 5, 2026Yang Yang, Jiawei Chen, Tairan Chen +1Multimodal Grounding Visual Spatial Reasoning
Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University · Zhongguancun Academy · Stevens Institute of Technology
SpatialQuery: Benchmarking Geometry-Grounded Multi-Instance Spatial Reasoning in Vision-Language Models
Aug 3, 2026Hai Nguyen, Tung Vu, Cong TranSpatial Reasoning Benchmarks 3D Spatial Reasoning
Posts and Telecommunications Institute of Technology, Hanoi, Vietnam
Explainable and Resource-Efficient Spatial Reasoning in Multimodal LLMs for Decision-Critical Applications
Jul 29, 2026Piyush Jain, Kousik Dasgupta, Rajarshi Roy +1Visual Spatial Reasoning 3D Spatial Reasoning
Heritage Institute of Technology, Kolkata, India · Kalyani Government Engineering College, Kalyani, India · IAIRO, India +1
Spatial-IQ: Deconstructing Spatial Intelligence via Hierarchical Capability Tests
Jul 24, 2026Patrick Rim, Tom Long, Ekta Prashnani +63D Spatial Reasoning Visual Spatial Reasoning
1NVIDIA Research · 2Yale University
LenGuard-GPC: Length Guarding with Guided-Prompt Consistency for Spatial Reasoning Reinforce Learning
Jul 19, 2026Xingjian Tao, Yiwei Wang, Yujun Cai +1Visual Spatial Reasoning Reward Shaping
HKUST(GZ) · UC Merced · University of Queensland +1
Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understanding
Jul 16, 2026Xiao Lin, Xiaohu Huang, Kai HanVisual Spatial Reasoning Vision Foundation Models
The University of Hong Kong
MentalThink: Shaping Thoughts in Mental SVG World
Jul 3, 2026Kangheng Lin, Jisheng Yin, Dingming Li +11Visual Spatial Reasoning Latent Visual Reasoning
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications · University of Chinese Academy of Sciences · StepFun
OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping
Jul 1, 2026Xudong Li, Mengdan Zhang, Peixian Chen +7Visual Spatial Reasoning 3D Spatial Reasoning
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China · Tencent Youtu Lab · Beijing Institute of Technology
Spatial Reasoning via Modality Switching Between Language and Symbolic Representations
Jun 30, 2026Shreya Rajpal, Tanawan Premsri, Parisa KordjamshidiMultimodal Reasoning Spatial Reasoning
Department of Computer Science and Engineering Michigan State University Michigan, USA
AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration
Jun 26, 2026Haotian Li, Yida Wang, Leyuan Wang +7Multi-View Consistency Multimodal Spatial Reasoning
Beijing University of Posts and Telecommunications · University of Electronic Science and Technology of China · Tsinghua University +1
Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning
Jun 10, 2026Chaofan Ma, Zhenjie Mao, Yuhuan Yang +5Visual Spatial Reasoning 3D Spatial Reasoning
Cooperative Medianet Innovation Center, Shanghai Jiao Tong University · Shanghai Jiao Tong University · Tongji University
CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence
Jun 9, 2026Yiming Zhang, Ruoxuan Cao, Zhihang ZhongMultimodal Understanding Multimodal Large Language Models
2Cornell University · 1Shanghai Jiao Tong University
Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models
Jun 2, 2026Mahtab Bigverdi, Linjie Li, Weikai Huang +8Multimodal Understanding Spatial Reasoning
University of Washington · 2Allen Institute for AI · 3Microsoft +1
Spectral-Progressive Thought Flow for Lightweight Multimodal Reasoning
Jun 1, 2026Yixian Shen, Zhiheng Yang, Qi Bi +6Efficient Multimodal Inference Visual Spatial Reasoning
Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands · University of Thessaly, Volos, Greece · Department of Computer Science, University College London +3
SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes
May 29, 2026Tianhui Liu, Jie Feng, Zhiheng Zheng +6Vision-Language Agents Visual Spatial Reasoning
1The Hong Kong University of Science and Technology (Guangzhou) · 2Zhongguancun Academy · 3Tsinghua University +1
Grounded 3D-Aware Spatial Vision-Language Modeling
May 28, 2026An-Chieh Cheng, Yang Fu, Yatai Ji +12Visually Grounded Reasoning 3D Spatial Reasoning
UCSD · NVIDIA · MIT
EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchy
May 23, 2026Jinzhao Li, Yinuo Chen, Dongxu Piao +9Embodied Reasoning LLM Evaluation
College of AI, Tsinghua University · 2ByteDance · 3State Key Laboratory of General Artificial Intelligence, BIGAI

Oct 16, 2026J/K move · Enter open · S save

Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction

Wajeeha Tahir, Anna Tegon, Lionnus Kesting, Gamze İslamoğlu+3

Integrated Systems Laboratory, ETH Zürich, Switzerland · Pázmány Péter Catholic University, Hungary

Spatial Context Modeling Visual Spatial Reasoning Multimodal Spatial Reasoning

Open paper AskPDF arXiv

Spatial context prediction requires visual grounding and spatial reasoning to identify vacant regions relative to objects in a scene. Spatial relationships and physical constraints remain challenging for large vision-language models (VLMs). Recursive reasoning has demonstrated strong performance on discrete and abstract reasoning tasks, motivating its use for improving spatial context prediction in natural images. Weight sharing enables higher accuracy with a small trainable parameter count. We introduce Spatial-TRM, a compact recursive model with frozen vision-language features, a convex region decoder, and just 11.2M trainable parameters. This weight-tied reasoner supports six spatial relationships, three reference frames, and open-vocabulary anchor objects. On the RoboSpatial-Home benchmark, Spatial-TRM achieves 29.51% context accuracy, a gain of 9.02 percentage points (44.0% relative) over a separately trained single-step model with the same parameter count. Including the frozen encoders, the model has 877.8M total parameters, approximately

15\times

fewer than the reported 13B size of RoboPoint. These results show that repeated refinement improves spatial context prediction from pretrained vision-language features at a fixed trainable parameter count on this benchmark.