EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents
Organizations: Harbin Institute of Technology · Zhongguancun Academy · DeepCybo · Huazhong University of Science and Technology ·
Abstract
Spatial reasoning agents can inspect tool outputs and repair errors, but reusing these lessons requires preserving both the computation and the conditions that make it valid. We introduce EvoSpatial, a framework that learns from execution experience by updating a library of linked skills and tools. Skills describe procedures, geometric assumptions, and verification steps; tools implement the operations those procedures require. When solving a task, the agent retrieves relevant skills and synthesizes reusable computational functions if existing tools are insufficient. After each task, execution feedback and evidence checks guide skill revision and tool consolidation, without ground-truth answers or benchmark scores. Across 20 benchmarks, EvoSpatial averages 63.9, 4.0 percentage points above the average reported by SpatialClaw. The evolved library also improves held-out and cross-benchmark performance when updates are disabled, and trajectories generated with evolved skills improve supervised fine-tuning, even without external skills at evaluation. Keeping checked procedures on record, together with the tools that support them, lets an agent carry spatial reasoning experience from one task to the next.
Figures & tables
| Model | Capability | Reference |
| Depth Anything 3 | Depth, camera parameters, and 3D reconstruction | ( Lin et al., 2026 ) |
| VGGT | Camera parameters, depth maps, and 3D point maps | ( Wang et al., 2025a ) |
| Pi3X | Multi-view 3D reconstruction | ( Wang et al., 2026b ) |
| MapAnything | Metric 3D reconstruction | ( Keetha et al., 2026 ) |
| SAM 3 | Image segmentation and video segmentation/tracking | ( Carion et al., 2026 ) |
| SAM 3.1 Object Multiplex | Multi-object video segmentation/tracking | ( Carion et al., 2026 ) |
Tool-Using Agents
Tool-using agents plan and act through external tools, APIs, software interfaces, and environments to complete tasks beyond language generation.
See all 277 papers