cs.RONov 19, 2026

Stereo Visual Odometry with In-the-Loop Geometric Feed-Forward Models Towards Dense Metric Mapping

Authors: Fahira Afzal Maken, Sagun Man Singh Shrestha, Edward Vanderfeen, Lucas Carvalho de Lima, Rongxin Li, Changming Sun, Milad Ramezani

Organizations: CSIRO Robotics, Technology, CSIRO, Brisbane, Australia. · School of Electrical Engineering and Robotics, Queensland University of Technology (QUT), Brisbane, Australia.

Abstract

We present a stereo visual odometry (SVO) framework that integrates geometric feed-forward models (GFMs) for dense depth prediction with factor-graph-based visual odometry to achieve accurate localisation and dense metric mapping. Our key idea is to exploit sparse but reliable metric geometry estimated from stereo and temporal multi-view observations to calibrate dense GFM predictions, while retaining the robustness and efficiency of model-based SVO. Rather than directly conditioning the GFM on potentially noisy stereo depth, optimised 3D landmarks are used to jointly estimate a scale-shift transformation over all keyframes within each local submap, yielding metrically consistent dense depth predictions. To balance accuracy and computational efficiency, we introduce a hierarchical factor-graph architecture. At the local level, sliding-window optimisation estimates high-frequency camera poses and multi-view-refined 3D landmarks. Dense predictions are generated only for selected keyframes and registered within each submap using SE(3) Generalised ICP. Consecutive submaps are further aligned in Sim(3) using their shared geometry, allowing residual scale inconsistencies to be corrected. These intra- and inter-submap constraints are incorporated into a global factor graph to produce a consistent trajectory and dense metric reconstruction. Extensive experiments on public and in-house datasets demonstrate that the proposed framework achieves competitive odometry accuracy against geometric and learning-based baselines while providing accurate dense metric reconstruction and improved robustness to failures in learned depth prediction.

Figures & tables

Explore similar work

CardsList
  1. SFVO: Decoupled Confidence-Guided Stereo-Flow Visual Odometry with Bidirectional PnP

    Sep 18, 2026Kai Zhang, Guoyang Zhao, Jun MaVisual OdometryCamera Pose Estimation

  2. Accord: Universal Online Metric Localization and Dense Mapping from one Camera and an IMU

    Nov 18, 2026Jaafar Mahmoud, Arthur Movsesyan, Cuong Huynh +3Simultaneous Localization and MappingMetric Depth Estimation

  3. FoundationVIO: Enforcing Metric Scale in Feed-forward Visual-Inertial Odometry

    Oct 10, 2026Jin Rhee, Yuhao Zhang, Frank Dellaert +1Visual-Inertial SLAMVisual-Inertial Odometry