Limits of Spatial Imagery Reasoning in Frontier LLM Models
Organizations: Institute of Mathematics and Statistics – University of S˜ao Paulo, Brazil
Abstract
Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, yet they struggle with spatial tasks that require mental simulation, such as mental rotation. This paper investigates whether equipping an LLM with an external Imagery Module'' -- a tool capable of rendering and rotating 3D models -- can bridge this gap, functioning as a cognitive prosthetic.'' We conducted experiments using a dual-module architecture in which a reasoning module (an MLLM) interacts with an imagery module on 3D model rotation tasks. Performance was lower than expected, with accuracy reaching at most 62.5%. Further investigation suggests that even when the burden of maintaining and manipulating a holistic 3D state is outsourced, the system still fails. This reveals that current frontier models lack the foundational visual-spatial primitives required to interface with imagery. Specifically, they lack: (1) the low-level sensitivity to extract spatial signals such as (a) depth, (b) motion, and (c) short-horizon dynamic prediction; and (2) the capacity to reason contemplatively over images, dynamically shifting visual focus and balancing imagery with symbolic and associative information.
Figures & tables
| SpatialViz - 3DR | |
|---|---|
| Evaluated Entity | Accuracy (%) |
| Human Performance ( Wang et al., 2025c ) | 79.16 |
| Baseline Models | |
| Llama-4-Maverick-17B-128E-Instruct ( Wang et al., 2025c ) | 40.00 |
| Claude-3.7-Sonnet ( Wang et al., 2025c ) | 36.25 |
| Baseline Models - Our Re-evaluation | |
| True Direction | Angle | Model Prediction | Outcome |
|---|---|---|---|
| Left | Right | ✗ | |
| Right | Right | ✓ | |
| Up | Right ( ) | ✗ | |
| Down | Up (reason: top visible) | ✗ | |
| Clockwise | Right ( ) | ✗ | |
| Counter-Clockwise | Up | ✗ |
Visual Spatial Reasoning
Visual spatial reasoning studies how AI systems infer geometry, object relations, viewpoints, and physical change from images and video.
See all 250 papers