Recent advances in deep monocular visual Simultaneous Localization and Mapping (SLAM) have achieved impressive accuracy and dense reconstruction capabilities, yet their robustness to scale inconsistency in large-scale indoor environments remains largely unexplored. Existing benchmarks are limited to room-scale or structurally simple settings, leaving critical issues of intra-session scale drift and inter-session scale ambiguity insufficiently addressed. To fill this gap, we introduce the ScaleMaster Dataset, the first benchmark explicitly designed to evaluate scale consistency under challenging scenarios such as multi-floor structures, long trajectories, repetitive views, and low-texture regions. We systematically analyze the vulnerability of state-of-the-art deep monocular visual SLAM systems to scale inconsistency, providing both quantitative and qualitative evaluations. Crucially, our analysis extends beyond traditional trajectory metrics to include a direct map-to-map quality assessment using metrics like Chamfer distance against high-fidelity 3D ground truth. Our results reveal that while recent deep monocular visual SLAM systems demonstrate strong performance on existing benchmarks, they suffer from severe scale-related failures in realistic, large-scale indoor environments. By releasing the ScaleMaster dataset and baseline results, we aim to establish a foundation for future research toward developing scale-consistent and reliable visual SLAM systems.
Figures & tables
Fig. 1: Representative example of scale inconsistency. During Sim(3) pose-graph optimization, the SLAM trajectory experiences a sudden scale explosion (highlighted), resulting in an abnormally enlarged reconstruction that diverges from the previously estimated map.
Fig. 2: A diagram illustrating the components of the scale estimation problem.
Dataset
Sequences
Avg. Length
Image Resolution
Multi-floor & Elevation
Pure Rotation
Complex Indoor
Scale Study Feasibility
EuRoC
11
81.2 m
752×480
△
X
X
X
TUM-RGBD
∼ 39
12.2 m
640×480
X
X
X
X
7-Scenes
7
64.3 m
640×480
X
X
X
X
ARKitScenes
>5,000
<100 m
1920×1440
X
O
X
X
Ours (ScaleMaster dataset)
25
152.2 m
1920×1440
O
O
O
O
TABLE I: Comparison of public benchmark datasets with ours.
Fig. 3: A visual comparison of trajectory scales between our proposed ScaleMaster dataset and existing standard benchmarks. This distinct contrast visually demonstrates why existing room-scale benchmarks are insufficient for evaluating long-term scale consistency failures.
Sequence Name
Frames
Path Length (m)
Duration (s)
Environment
Tags
Basement_01
2036
29.11
67
Basement area followed by a staircase ascent.
Indoor, Short trajectory, 3D Map
HotelRoom_01
4217
29.07
141
Interior traversal of a hotel room.
Indoor, Repetitive view, Short trajectory
Lab_01
2167
25.85
72
In-place rotations inside a lab room.
Indoor, Repetitive view, Short trajectory
LargeHall_01
22830
884.12
761
Full loop covering the entire LargeHall.
Indoor, Very long trajectory
LargeHall_02
6576
241.89
219
Evening traversal of a large open hall, low-light.
Indoor, Long trajectory, 3D Map
LargeHall_03
2764
109.89
92
Short loop inside the LargeHall at night.
Indoor, Low-texture risk, Medium trajectory
TABLE II: Summary of collected sequences and their characteristics.
Fig. 4: Our overall experimental pipeline, illustrating the process from data acquisition with our custom rig (left), through ground truth map generation and SLAM processing (center), to the final map-to-map error calculation (right).
TABLE IV: Absolute Trajectory Error (unit: meter) on our dataset.
Sequence Name
Threshold
Chamfer Distance(m)
Drop Rate (%)
Analysis
Library_01
1
0.36
42.5
Severe Failure
10
6.43
0.9
Significant map distortion.
Library_06
1
0.08
1.1
Success
10
0.10
0.0
High-fidelity reconstruction.
Library_07
1
0.52
89.1
Catastrophic Failure
10
9.99
0.0
Near-total map collapse.
TABLE V: 3D Reconstruction Quality of MASt3R-SLAM
Fig. 5: Qualitative comparison of 3D reconstruction of the Library_06 sequence. (a) Ground truth point cloud from LiDAR, color-coded by height. (b) The map reconstructed by MASt3R-SLAM. (c) The alignment of the MASt3R-SLAM map onto the ground truth. (d) Point-to-point distance error visualization, where warmer colors (red) indicate larger geometric inconsistencies between the two maps
Fig. 6: Qualitative comparison on Library_07 demonstrating that low trajectory error does not guarantee correct map scale. (a) The LiDAR ground-truth and (b) the MASt3R-SLAM reconstruction. (c) The overlay and (d) top-down cross-section are generated after applying the single global Sim(3) transformation calculated to align the camera trajectories.
Fig. 7: Short-term scale inconsistency of MASt3R-SLAM on the Station_01 sequence. The repetitive structure and vertical motion cause a severely distorted and overlapping 3D map. This demonstrates the system’s vulnerability even in short, challenging trajectories.
Fig. 8: A long-term optimization failure case for MASt3R-SLAM on the Parking_01 sequence.
Fig. 9: A failure case of inter-session scale ambiguity in MASt3R-SLAM. The image shows the result of processing a single sequence as three independent sessions. The resulting map fragments cannot be aligned into a consistent map as each was generated with a different, inconsistent scale.
Cameras are ubiquitous sensors in robotics due to their compact form factor and the perceptual richness captured through visual information. Monocular SLAM enables robots to understand the environment with a minimum setup, however, it inherently suffers from scale ambiguity. A common solution is to provide multi-modal sensor configurations, such as visual-inertial systems, where scale is observable unless the robot navigates under a constant-velocity motion, a common scenario in mobile robotics. With the advent of deep-learning, geometric foundation models have been used to address this problem, but the depths maps are often noisy and scale-inconsistent across frames. In this paper, we propose Scalix, a real-time monocular SLAM framework that achieves metric-scale state estimation by integrating learned depth cues into a probabilistic factor-graph formulation. By augmenting existing monocular depth models with both per-pixel depth uncertainty and per-frame scale uncertainty, Scalix treats scale predictions as independent measurements within its optimization, leading to improved scale consistency through multi-view data associations. Experiments in large-scale outdoor and indoor environments demonstrate state-of-the-art performance on both metric and up-to-scale benchmarks while maintaining real-time operation and generalization.
Sebastian Barbas Laina, Tianyi Zhang, Panagiotis Petropoulakis +5
Monocular SLAM historically suffers from scale ambiguity and tracking failure in dynamic environments. While recent vision foundation models (VFMs) provide remarkable zero-shot depth priors, naively integrating these deterministic predictions ignores predictive uncertainty and frame-to-frame scale inconsistencies. We propose PRISM-SLAM, a real-time framework that rigorously integrates VFM priors into a structured Bayesian factor graph to achieve scale-aware, metric-consistent localization and mapping. Specifically, we introduce a Plücker Ray-Distance Factor to anchor monocular observations in absolute space within a globally consistent metric coordinate system, mathematically resolving scale drift by making the metric scale Fisher-identifiable. To handle environmental dynamics, we derive an epistemic uncertainty proxy from temporal depth consistency and formulate a Dynamic Scene Uncertainty Gating (DSUG) mechanism. This soft-gating approach probabilistically down-weights dynamic distractors without incurring the heavy computational overhead associated with traditional semantic segmentation masks. By employing a multi-process architecture that asynchronously processes VFM inference and geometric tracking, PRISM-SLAM provides verified metric output at 30 FPS using solely RGB input, bridging the gap between foundation models and real-world robotic applications. Evaluated on the TUM RGB-D and 7-Scenes benchmarks, PRISM-SLAM achieves a metric SE(3) Absolute Trajectory Error (ATE) nearly identical to its oracle-aligned Sim(3) error. This demonstrates that our system can produce deployment-ready metric trajectories by delivering robust metric SLAM solutions without any post-hoc scale correction. Project page: https://prismslam-cmd.github.io/prismslam_pr/
Visual SLAM is a well-established technology utilized in a wide range of real-world applications. However, its performance still degrades under challenging visual conditions, such as low texture, severe motion blur, and poor illumination. Systems based on deep learning outperform classical geometry-based ones and achieve state-of-the-art results by combining learned 2D data association and uncertainty with differentiable geometric optimization in recurrent architectures. Still, it remains unclear exactly which components are fundamentally responsible for this success. In this paper, we ask: Is the superior performance of deep learning-based systems driven primarily by learned 2D data association, the combination of learned 2D data association and uncertainty, or the recurrent architecture itself? We investigate this question empirically by conducting a controlled study. Our findings reveal that the success of DL-based V-SLAM systems hinges on learned 2D data association and uncertainty rather than their recurrent architecture, underscoring the necessity of learning-based paradigms for the design of these components.
Giovanni Cioffi, Davide Scaramuzza
Robotics and Perception Group, Department of Informatics, University of Zurich, Switzerland