cs.CVFeb 21, 2026

Marginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimates

Authors: Shengjie Zhu, Ahmed Abdelkader, Mark J. Matthews, Xiaoming Liu, Wen-Sheng Chu

Organizations: Google · Michigan State University

Abstract

Structure-from-Motion (SfM) is a fundamental 3D vision task for recovering camera parameters and scene geometry from multi-view images. While recent deep learning advances enable accurate Monocular Depth Estimation (MDE) from single images without depending on camera motion, integrating MDE into SfM remains a challenge. Unlike conventional triangulated sparse point clouds, MDE produces dense depth maps with significantly higher error variance. Inspired by modern RANSAC estimators, we propose Marginalized Bundle Adjustment (MBA) to mitigate MDE error variance leveraging its density. With MBA, we show that MDE depth maps are sufficiently accurate to yield SoTA or competitive results in SfM and camera relocalization tasks. Through extensive evaluations, we demonstrate consistently robust performance across varying scales, ranging from few-frame setups to large multi-view systems with thousands of images. Our method highlights the significant potential of MDE in multi-view 3D vision.

Figures & tables

Explore similar work

CardsList
  1. DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motion

    Jul 10, 2026Sithu Aung, Viktor Kocur, Yaqing Ding +2Multi-View Geometry3D Reconstruction

  2. M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo

    Aug 21, 2026Byeonggwon Lee, Sanggi Lee, Siwoo Lee +2Multi-View Depth EstimationMulti-View 3D Reconstruction

  3. MV-RoMa: From Pairwise Matching into Multi-View Track Reconstruction

    Mar 29, 2026Jongmin Lee, Seungyeop Kang, Sungjoo YooImage MatchingCross-View Image Matching