MR.ScaleMaster: Scale-Consistent Collaborative Mapping from Crowd-Sourced Monocular Videos
Organizations: Department of Robotics and Mechatronics Engineering, DGIST, Daegu, Republic of Korea.
Abstract
Crowd-sourced cooperative mapping combines monocular sessions from different front-ends, each an independently reconstructed keyframe sequence. Each session has its own local coordinate frame and may follow an incompatible scale convention. We present MR.ScaleMaster, a backend that accepts image, Sim(3) pose, and point-map packets without requiring a common reconstruction model, camera intrinsics, or front-end-provided metric scale. Our Cross-Front-End Loop Factor (CFL) uses a shared matcher for image correspondences but retrieves matched 3D points from the input point maps, so its scale estimates the inter-session ratio. Scale Preconditioning (SPC) initializes session scales for a Sim(3) anchor-node graph, which then corrects residual scale and drift. For front-ends exposing an incremental scale trajectory, an agent-side Scale Collapse Alarm (SCA) rejects or rolls back false intra-session loops that would otherwise collapse the session scale. We evaluate seven front-ends on KITTI and five on CODa. Based on ground-truth path lengths, session scales in our heterogeneous KITTI setting differ by 57-103x. CFL reduces mean ATE by 37% and inter-session scale error by 60% relative to loop factors from independent pairwise reconstructions. Adding SPC raises the reductions to 74% and 77%, respectively. On CODa, five-session fusion improves mean ATE over single-session runs for all five front-ends, while joint fusion registers 15 sessions from three different front-ends in a single map. Code will be released.
Figures & tables
| System class | Agent-side reconstruction assumption | Scale treatment |
| Metric cooperative SLAM [ 3 , 4 , 5 ] | metric local estimates from visual–inertial, stereo, or range sensing | shared metric scale |
| Shared-pipeline monocular collaboration [ 16 , 17 , 18 ] | common learned reconstruction pipeline across agents | monocular gauges coordinated within the common pipeline |
| MR.ScaleMaster | heterogeneous front-ends via session-local packets | independent session scale conventions aligned during fusion |
| Symbol | Scale | Quantity |
| – | keyframe image | |
| session-local pose | ||
| per-pixel point map |
| Configuration | ATE RMSE [m] |
| backend opt. | 137.26 |
| anchor-only opt. | 18.92 |
| full opt. | 16.61 |
| ATE RMSE [m] | ||||||
| Seq | (A) RayOpt | (B) CFL | (C) CFL SPC | (A) | (B) | (C) |
| KITTI 00 | 134.78 | 25.05 | 19.43 | 1.285 | 0.153 | 0.133 |
| KITTI 02 | 296.39 | 280.43 | 78.32 | 1.284 | 0.614 | 0.228 |
| KITTI 05 | 56.22 | 18.52 | 9.79 | 0.696 | 0.369 | 0.112 |
| KITTI 07 | 21.20 | 6.39 | 10.85 | 0.808 | 0.136 | 0.218 |
| KITTI 08 | 247.58 | 146.45 | 80.71 | 1.343 | 0.872 | 0.541 |
| Front-end | 00 | 02 | 05 | 07 | 08 | Mean |
| MASt3R-SLAM | ||||||
| CUT3R | ||||||
| TTT3R | ||||||
| VGGT-SLAM 2.0 | ||||||
| LoGeR |
| Sequence | Length | 1 | 1 (tuned) | 5 | 10 | 15 |
| KITTI 00 | 3.7 km | TL | 103.07 | 48.69 | 19.66 | 16.61 |
| KITTI 02 | 5.1 km | TL | 158.49 | 113.36 | 83.06 | 88.54 |
| KITTI 05 | 2.2 km | TL | 147.15 | 13.33 | 10.82 | 12.01 |
| KITTI 07 | 0.7 km | TL | 2.04 | 7.05 | 9.79 | 8.67 |
| KITTI 08 | 3.2 km | TL | 88.16 | 166.68 | 104.83 | 85.91 |
| Mean | – | 99.78 | 69.82 | 45.63 | 42.35 |
| Sequence Info | Same front-end: five sessions MR.ScaleMaster / single session | Single-session long-context references | |||||||||
| Seq. | [m] | Dur. [s] | KF | CUT3R [ 9 ] | TTT3R [ 10 ] | VGGT-SLAM 2.0 [ 28 ] | LoGeR [ 11 ] | LingBot-Map [ 12 ] | VGGT-Long [ 13 ] | SwiftVGGT [ 14 ] | VGGT-Align [ 15 ] |
| 0 | 617.7 | 821.3 | 579 | 35.07 / 77.95 | 11.96 / 15.19 | 26.37 / 15.31 | 2.32 / 9.72 | 3.30 / 11.39 | 41.04 | 68.35 | 65.93 |
| 3 | 1004.7 | 1472.8 | 1180 | 54.92 / 71.46 | 10.91 / 37.61 | 30.23 / 34.83 | 8.43 / 22.96 | 8.41 / 27.71 | 54.75 | 71.32 | 65.75 |
| 4 | 620.8 | 823.7 | 361 | 41.26 / 58.37 | 39.94 / 65.12 | 34.69 / 18.97 | 2.34 / 31.93 | 7.31 / 17.67 | 72.56 | 72.16 | 71.82 |
| 6 | 1142.2 | 1358.2 | 1663 | 52.88 / 110.72 | 29.50 / 47.73 | 35.89 / 121.57 | 6.35 / 59.73 | 8.04 / 55.91 | 86.84 | 105.77 | 119.08 |
| 16 | 1404.5 | 1706.5 | 2325 | 102.87 / 125.00 | 50.82 / 103.22 | 46.11 / 144.57 | 11.54 / 38.67 | 13.66 / 77.64 | 100.73 | 129.56 | 142.28 |
| Cat. | Segment | OFF | ON | |
| Straight | S1 LargeHall_01 (14600–18600) | 5.56 | 3.61 | |
| S2 LargeHall_02 (1400–5400) | DIV | 8.44 | – | |
| S3 Parking_01 (5000–7500) | 2.07 | 1.66 | ||
| S4 Parking_01 (800–3300) | 23.03 | 0.39 | ||
| S5 Stairs_01 (3200–4700) | 11.72 | 0.43 | ||
| S6 Library_01 (3400–4900) | 0.32 | 0.27 |
Simultaneous Localization and Mapping
Simultaneous localization and mapping estimates a robot’s motion while building a map of an unknown environment.
See all 197 papers