cs.CVJul 13, 2026

FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry

Authors: Muxin Liu, Xiaoyang Lyu, Tianhe Ren, Peng Dai, Xiaoshan Wu, Zhiyue Zhang, Jiaqi Zhang, Jiehong Lin, +2 more

Organizations: The University of Hong Kong · Voyager Research, DiDi Chuxing

Abstract

We present FoundationGeo, a two-stage framework that explicitly bridges relative and metric prediction via spatial calibration and principled data design. Stage 1 learns a high-fidelity, affine-invariant geometry model by initializing with DINOv3 and training on a curated 10.2M-sample multi-domain corpus with complementary local-detail supervision, yielding sharp boundaries and strong cross-domain generalization. Stage 2 moves beyond global scaling by introducing lightweight pixel-wise calibration fields for metric estimation: a scale field for spatially varying metric alignment and a ray-direction correction field that mitigates directional bias in point-map geometry, together producing metrically consistent 3D point maps. Beyond model design, we identify camera intrinsic coverage, especially focal length distribution mismatch between training and test data, as a key bottleneck for zero-shot metric generalization: performance drops sharply when test intrinsics fall outside the training distribution. To address this, we synthesize additional training data across diverse focal lengths using a Blender-based data engine, repairing under-covered focal regimes and improving robustness under intrinsic shift. Extensive zero-shot evaluations across seven benchmarks show that FoundationGeo significantly strengthens cross-domain robustness, staying near the top across diverse domains while avoiding the sharp cross-domain performance drops observed in other methods. This consistency translates into the best overall performance, surpassing heavier baselines by over 5.2% on average.

Explore similar work

CardsList
  1. Honey, I Shrunk the Arc de Triomphe!

    Jun 1, 2026Yuanbo Xiangli, Hanyu Chen, Xueqing Tsang +1Depth EstimationLight Detection And Ranging

  2. StereoGeo: an end-to-end stereo camera calibration method

    Jun 12, 2026Imane Meddour, Andréa Macario Barros, Cédric Gouy-PaillerCamera IntrinsicsStereo Vision