VehAnchor: Metadata-Free Metric Scale Recovery from Vehicle Cues in Aerial Imagery
Organizations: Dimension Gate, Haidian District, Beijing 100083, China. · New York University, New York, NY, USA.
Abstract
Autonomous aerial robots operating in GPS-denied or communication-degraded environments frequently lose access to camera metadata and telemetry, leaving onboard perception systems unable to recover the absolute metric scale of the scene. As LLM/VLM-based planners are increasingly adopted as high-level agents for embodied systems, their ability to reason about physical dimensions becomes safety-critical -- yet our experiments show that five state-of-the-art VLMs suffer from spatial scale hallucinations, with median area estimation errors exceeding 50%. We propose VehAnchor, a lightweight, deterministic Geometric Perception Skill designed as a callable tool that any LLM-based agent can invoke to recover Ground Sample Distance (GSD) from ubiquitous environmental anchors: small vehicles detected via oriented bounding boxes, whose modal pixel length is robustly estimated through kernel density estimation and converted to GSD using a pre-calibrated reference length. The tool returns both a GSD estimate and a composite confidence score, enabling the calling agent to autonomously decide whether to trust the measurement or fall back to alternative strategies. On the DOTAv1.5 benchmark, VehAnchor achieves 6.87% median GSD error on 306images. Integrated with SAM-based segmentation for downstream area measurement, the pipeline yields 19.7% median error on a 100-entry benchmark -- with 2.6 lower category dependence and 4 fewer catastrophic failures than the best VLM baseline -- demonstrating that equipping agents with deterministic geometric tools is essential for safe autonomous spatial reasoning.
Figures & tables
| Detector | Evaluated | Median Err | Mean Err | 10% | 20% |
|---|---|---|---|---|---|
| YOLOv8m-OBB (v1) | 310 | 7.17% | 14.88% | 63.2% | 80.0% |
| YOLOv8 l -OBB (v2) | 310 | 6.87% | 13.44% | 65.2% | 82.3% |
| YOLO11 l -OBB (v3) | 306 | 6.87% | 12.89% | 66.0% | 83.3% |
| GT Baseline (all) | 269 | 6.88% | 8.54% | 67.7% | 92.6% |
| YOLO11 l -OBB (v3, intersection) | 267 | 6.22% | 9.41% | 71.9% | 89.5% |
| GT Baseline (intersection) | 267 | 6.88% | 8.56% | 67.4% | 92.5% |
| Model | Med. Err. | Mean Err. | 10% | 25% | 50% | 100% |
|---|---|---|---|---|---|---|
| Zero-shot (no scale information): | ||||||
| Qwen2.5-VL-72B | 38.3% | 84.5% | 19% | 35% | 61% | 84% |
| Claude Opus 4.6 | 47.2% | 72.9% | 24% | 35% | 55% | 73% |
| Qwen-VL-Max | 50.3% | 97.1% | 13% | 27% | 49% | 75% |
| Qwen-VL-Plus | 51.3% | 190.3% | 22% | 33% | 49% | 68% |
| GPT-4 o | 51.9% | 69.4% | 17% | 34% | 48% | 93% |
| Factor | Setting | Med. Err | 20% |
|---|---|---|---|
| Aggregation method (E2E): | |||
| KDE (ours) | 6.87% | 83.3% | |
| Median | 7.31% | 84.0% | |
| Mean | 8.27% | 83.7% | |
| Reference length : | |||
| 4.5 m | 10.59% | 80.3% | |
VLMs for Robotics
Vision-language models for robotics connect visual and linguistic understanding to grounded navigation, manipulation, and robot control.
See all 657 papers