Accord: Universal Online Metric Localization and Dense Mapping from one Camera and an IMU
Organizations: Biomechatronics and Energy-Efficient Robotics (BE2R) Lab, ITMO University, Saint Petersburg, Russia
Abstract
Dense metric mapping from a single camera and IMU remains challenging: visual-inertial odometry (VIO) provides metric motion but sparse geometry, whereas feed-forward depth models predict dense structure without ensuring metric scale. We present Accord, which constructs an accurate online dense metric map from any camera with an IMU. A VIO filter publishes metric poses, a depth foundation model conditioned on them predicts depth for short keyframe windows, and a factor graph fuses the resulting submaps. Recent work has explored several approaches to this problem. What is essential is the multi-view agreement (Accord), which is considered in SLAM as a source of geometric self-consistency. Accord anchors each keyframe window to metric 3D points triangulated from the filter poses, then exploits bidirectional dense depth agreement between co-visible images to estimate and correct per-image scale errors while preserving the metric scale established by the anchors. Context keyframes further improve depth prediction, and the resulting submaps are fused in a factor graph. We evaluate a single mapping configuration across five public camera-IMU setups and a new Phone-rig/GoPro dataset. With nothing tuned per dataset/setup and every map aligned only by Accord's own trajectory, Accord achieves consistently best/second-best mean F-score at 5 cm on every platform. Accord is open-source along with the phone-rig dataset for the benefit of the research community
Figures & tables
| Setup | Platform, scene | Camera | Seq. | Time, path |
| EuRoC | drone, rooms | gray | 6 | 11 min, 0.4 km |
| TUM-VI | hand-held, lab | gray fisheye | 6 | 14 min, 0.7 km |
| ORI | hand-held, buildings | color fisheye | 5 | 11 min, 0.5 km |
| Hilti-Oxford | survey rig, heritage | gray fisheye | 5+5 | 26 min, 1.0 km |
| Oxford Spires | hand-held, outdoors | color fisheye | 3 | 28 min, 1.7 km |
| Phone-rig (ours) | two smartphones, campus | color | 11+10 | 59 min, 2.5 km |
| Dense map: F-score at 5 cm | Trajectory error (cm) | |||||||
| EuRoC | ORI | Hilti-Oxford | Oxford Spires | EuRoC | TUM-VI | Hilti-Oxford | Oxford Spires | |
| System | drone, rooms | hand-held, buildings | survey rig | outdoors | drone, rooms | hand-held | survey rig | outdoors |
| ORB-SLAM3 [ 3 ] | – | – | – | – | 3.2 | 2.0 | 68.2 | – |
| OKVIS2-X [ 1 ] | – | – | – | – | 6.0 | 1.4 | 17.1 | – |
| MASt3R-Fusion [ 41 ] | 0.41 | 0.53 | 0.13 | 7.0 | 3.0 | 83.7 | – | |
| VGGT-SLAM 2.0 [ 17 ] † | 0.49 | 0.18 | 0.04 | 0.05 | 7.4 | 25.0 | 438.3 | 382.5 |
| Note 9, 10 walks | iPhone, 11 walks | |||||
|---|---|---|---|---|---|---|
| System | F@5 | F@10 | ATE (m) | F@5 | F@10 | ATE (m) |
| ORB-SLAM3 [ 3 ] | – | – | 0.71 | – | – | 0.88 |
| OKVIS2-X [ 1 ] | – | – | – | – | – | 0.34 |
| MASt3R-Fusion [ 41 ] | 0.04 | 0.08 | 1.88 | – | ||
| VGGT-SLAM 2.0 [ 17 ] † | 0.07 | 0.14 | 4.76 | 0.09 | 0.16 | 2.72 |
| ScaRF-SLAM’s mapper [ 38 ] ‡ | 0.14 | 0.26 | – | 0.10 | 0.18 | – |
| EuRoC rooms | Hilti-Oxford | |
|---|---|---|
| DAVIO [ 19 ] | 0.381 | – |
| our mapper, no anchor or context | 0.488 | 0.120 |
| + the anchor | 0.547 | 0.147 |
| + context keyframes (Accord) | 0.570 | 0.164 |
| Depth model | EuRoC Rooms, F | ORI, F | GPU (GB) |
|---|---|---|---|
| DA3-Giant | 0.570 | 0.782 | 8.9 |
| DA3-Large | 0.521 | 0.698 | 5.1 |
| DA3-Base | 0.499 | 0.677 | 2.5 |
| System | Speed (FPS) | GPU (GB) | RAM (GB) |
|---|---|---|---|
| Accord | 18 | 11.1 | 2.4 |
| FoundationVIO | 15 | 13.2 | 7.1 |
| MASt3R-Fusion | 12 | 4.9 | 6.8 |
| VGGT-SLAM 2.0 | 23 | 6.8 | 9.9 |
| ScaRF-SLAM’s mapper | 15 | 9.4 | 5.6 |
Appendix figures & tables20 assets
Supplementary material from the paper’s appendix.
Appendix
| Setting | Value |
| Windows | |
| keyframes per window | 5 |
| keyframes two windows share | 2 |
| seconds between keyframes | 0.5 |
| seconds a window may wait for the worker | 2 |
| Context keyframes | |
| EuRoC rooms | ORI | |||||
|---|---|---|---|---|---|---|
| System | traj. | rigid | sim. | traj. | rigid | sim. |
| Accord, DA3-Giant | 0.570 | 0.601 | 0.632 | 0.782 | 0.788 | 0.852 |
| Accord, DA3-Large | 0.521 | 0.561 | 0.588 | 0.698 | 0.711 | 0.798 |
| Accord, DA3-Base | 0.499 | 0.539 | 0.562 | 0.677 | 0.693 | 0.751 |
| MASt3R-Fusion [ 41 ] | 0.411 | 0.434 | 0.442 | 0.525 | 0.533 | 0.556 |
| VGGT-SLAM 2.0 [ 17 ] † | 0.490 | 0.539 | 0.547 | 0.184 | 0.198 | 0.202 |
| Accord | MASt3R-Fusion | VGGT-SLAM 2.0 † | ScaRF ‡ | |||||||
| Seq. | traj. | rigid | sim. | traj. | rigid | sim. | traj. | rigid | sim. | traj. |
| V1_01 | 0.536 | 0.569 | 0.649 | 0.457 | 0.458 | 0.458 | 0.580 | 0.628 | 0.627 | 0.251 |
| V1_02 | 0.728 | 0.734 | 0.744 | 0.542 | 0.548 | 0.550 | 0.476 | 0.505 | 0.522 | 0.133 |
| V1_03 | 0.518 | 0.550 | 0.591 | 0.476 | 0.483 | 0.480 | 0.456 | 0.507 | 0.512 | 0.130 |
| V2_01 | 0.513 | 0.588 | 0.635 | 0.216 | 0.327 | 0.341 | 0.456 | 0.575 | 0.582 | 0.328 |
| V2_02 | 0.614 | 0.626 | 0.627 | 0.362 | 0.363 | 0.378 | 0.476 | 0.522 | 0.528 | 0.179 |
| V1_01 | V1_02 | V1_03 | V2_01 | V2_02 | V2_03 | mean | |
| ORB-SLAM3 [ 3 ] | 0.020 | 0.025 | 0.054 | 0.048 | 0.028 | 0.021 | 0.032 |
| OKVIS2 [ 1 ] , final | 0.034 | 0.021 | 0.040 | 0.131 | 0.055 | 0.077 | 0.060 |
| MASt3R-Fusion, real-time | 0.146 | 0.115 | 0.093 | 0.268 | 0.129 | 0.312 | 0.177 |
| MASt3R-Fusion, global ‡ | 0.064 | 0.028 | 0.039 | 0.195 | 0.042 | 0.052 | 0.070 |
| VGGT-SLAM 2.0 † | 0.058 | 0.080 | 0.077 | 0.079 | 0.066 | 0.083 | 0.074 |
| Accord, the filter | 0.040 | 0.054 | 0.057 | 0.066 | 0.053 | 0.187 | 0.076 |
| F-score at 5 cm | ATE (m) | Windows | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Seq. | runs | built | corr. | rigid | sim. | filter | final | mapped | not | loops |
| Giant | V1_01 | 3 | 0.588 | 0.536 | 0.569 | 0.649 | 0.040 | 0.041 | 88.3 | 9.3 | 3.3 |
| Giant | V1_02 | 3 | 0.658 | 0.728 | 0.734 | 0.744 | 0.054 | 0.044 | 53.0 | 0.3 | 7.0 |
| Giant | V1_03 | 3 | 0.486 | 0.518 | 0.550 | 0.591 | 0.057 | 0.054 | 66.0 | 0.0 | 6.0 |
| Giant | V2_01 | 3 | 0.503 | 0.513 | 0.588 | 0.635 | 0.066 | 0.066 | 70.0 | 2.7 | 0.0 |
| Giant | V2_02 | 3 | 0.510 | 0.614 | 0.626 | 0.627 | 0.053 | 0.051 | 73.3 | 4.3 | 9.3 |
| Sequence | Site | Reference | Scan | |
|---|---|---|---|---|
| development | exp14 Basement 2 | building | dense | yes |
| exp11 Lower Gallery | building | points | yes | |
| exp15 Attic to Upper Gallery | building | points | yes | |
| exp05 Construction Upper Level 2 | site | points | no | |
| exp07 Long Corridor | site | points | none | |
| exp02 Construction Multilevel | site | points | – |
| Noise | RMSE |
|---|---|
| the dataset’s first configuration | 0.627 |
| densities as measured, 1 / 1.5 / 2 / 3 | 0.167 / 0.201 / 0.296 / 0.415 |
| and walks at their bounds, 1 / 3 / 10 | 0.154 / 0.159 / 0.173 |
| development | evaluation | |||||||||
| System | exp14 | exp05 | exp07 | exp11 | exp15 | exp18 | exp16 | exp04 | exp01 | exp21 |
| ORB-SLAM3 [ 3 ] | fail | 0.170 / 1.7 | fail | 0.291 / 3.0 | 0.234 / 2.2 | 0.127 | 0.157 / 3.3 | fail | 0.948 / 0.0 | 1.495 / 0.0 |
| OKVIS2 [ 1 ] , final | 0.054 / 27.5 | 0.162 / 5.0 | 0.589 / 0.0 | 0.147 / 6.0 | 0.224 / 0.0 | 0.205 / 20.0 | 0.229 / 3.3 | 0.108 / 22.9 | 0.104 / 15.4 | 0.210 / 0.0 |
| MASt3R-Fusion [ 41 ] | 0.178 / 0.0 | 0.368 / 0.0 | 0.808 / 0.0 | 0.120 / 8.0 | 0.328 / 0.0 | 0.139 | div. | 0.458 / 1.4 | 1.578 / 0.0 | 1.174 / 0.0 |
| VGGT-SLAM 2.0 [ 17 ] † | 1.009 / 0.0 | 4.737 / 0.0 | div. | 2.592 / 0.0 | 6.631 / 0.0 | 6.464 | 4.647 / 0.0 | 4.689 / 0.0 | 3.690 / 0.0 | 2.424 / 0.0 |
| OKVIS2, live | 0.093 / 20.0 | 0.173 / 1.7 | 0.785 / 0.0 | 0.230 / 4.0 | 0.305 / 0.0 | 0.230 / 20.0 | 0.322 / 0.0 | 0.195 / 4.3 | 0.160 / 10.0 | 0.464 / 0.0 |
| development | evaluation | |||||||||||
| exp14 | exp11 | exp15 | exp18 | exp16 | exp21 | |||||||
| System | traj. | rigid | traj. | rigid | traj. | rigid | traj. | rigid | traj. | rigid | traj. | rigid |
| MASt3R-Fusion [ 41 ] | 0.313 | 0.409 | 0.180 | 0.281 | 0.183 | 0.199 | 0.288 | 0.299 | div. | div. | 0.093 | 0.186 |
| VGGT-SLAM 2.0 [ 17 ] † | 0.076 | 0.088 | 0.064 | 0.064 | 0.031 | 0.034 | 0.032 | 0.033 | 0.028 | 0.028 | 0.057 | 0.064 |
| ScaRF-SLAM’s mapper [ 38 ] ‡ | 0.209 | 0.242 | 0.153 | 0.157 | 0.073 | 0.129 | 0.120 | 0.129 | 0.107 | 0.112 | 0.053 | 0.138 |
| Accord, DA3-Base | 0.384 | 0.398 | 0.205 | 0.277 | 0.174 | 0.232 | 0.176 | 0.213 | 0.179 | 0.181 | 0.066 | 0.147 |
| System | room1 | room2 | room3 | room4 | room5 | room6 | mean |
|---|---|---|---|---|---|---|---|
| ORB-SLAM3 [ 3 ] | 0.021 | 0.018 | 0.040 | 0.018 | 0.013 | 0.007 | 0.020 |
| OKVIS2 [ 1 ] , final | 0.012 | 0.014 | 0.012 | 0.013 | 0.013 | 0.021 | 0.014 |
| OKVIS2, live | 0.024 | 0.019 | 0.057 | 0.023 | 0.281 | 0.033 | 0.073 |
| MASt3R-Fusion, real-time | 0.168 | 0.519 | 0.513 | 0.139 | 0.196 | 0.313 | 0.308 |
| MASt3R-Fusion, global § | 0.020 | 0.037 | 0.041 | 0.022 | 0.019 | 0.041 | 0.030 |
| VGGT-SLAM 2.0 † | 0.247 | 0.268 | 0.467 | 0.126 | 0.209 | 0.182 | 0.250 |
| Accord: map | FoundationVIO: map | Trajectory (m) | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Seq. | built | corrected | P | R | F | P | R | Accord | filter | FVIO |
| CC02 | 0.131 | 0.137 | 0.16 | 0.12 | 0.082 | 0.13 | 0.06 | 1.09 | 0.63 | 1.13 |
| CC03 | 0.242 | 0.265 | 0.25 | 0.29 | 0.191 | 0.28 | 0.15 | 0.30 | 0.39 | 0.16 |
| CC05 | 0.185 | 0.187 | 0.21 | 0.17 | 0.074 | 0.11 | 0.06 | 0.80 | 0.82 | 1.86 |
| Mean | 0.186 | 0.196 | 0.21 | 0.19 | 0.116 | 0.17 | 0.09 | 0.73 | 0.61 | 1.05 |
| Map: F-score at 5 cm | Trajectory (m) | |||||||
|---|---|---|---|---|---|---|---|---|
| CC02 | CC03 | CC05 | mean | CC02 | CC03 | CC05 | mean | |
| MASt3R-Fusion | – | – | – | 0.000 3 | failed | failed | failed | – 3 |
| VGGT-SLAM 2.0 † | 0.042 | 0.096 | – | 0.046 1 | 7.12 | 0.53 | failed | 3.82 1 |
| ScaRF mapper ‡ | 0.044 | 0.063 | 0.041 | 0.049 | – | – | – | – |
| FoundationVIO | 0.082 | 0.191 | 0.074 | 0.116 | 1.13 | 0.16 | 1.86 | 1.05 |
| DAVIO, as released | – | – | – | 0.000 3 | 0.87 | 0.52 | failed | 0.70 1 |
| F-score at 5 cm (%), its protocol | APE (m) | ||||||
| FoundationVIO | Accord | FoundationVIO | |||||
| Seq. | its paper | our run: tool | our run: its rule | tool | its rule | its paper | our run |
| R01 | 76.2 | 63.1 | 67.9 | 72.8 | 77.4 | 0.188 | 0.272 |
| R02 | 74.4 | 61.0 | 65.4 | 66.1 | 71.9 | 0.070 | 0.093 |
| R03 | 75.7 | 61.8 | 65.4 | 72.9 | 77.2 | 0.064 | 0.128 |
| R04 | 72.6 | 53.7 | 57.1 | 70.5 | 74.3 | 0.127 | 0.255 |
| Walk | Scene | Time | Path (m) | Closures | Note 9 (s) | iPhone (s) | ARKit (m) |
| VIO01 | indoor: corridors of a building | 3:36 | 128 | 28 | 221 | 120 | 0.15 |
| VIO02 | indoor: corridors and a stairwell over several floors | 6:32 | 249 | 44 | 394 | 130 | 0.17 |
| VIO03 | outdoor: paved courtyard with bicycle racks | 3:58 | 180 | 10 | – | 238 | 0.23 |
| VIO04 | outdoor: courtyard with planters and steps | 5:13 | 223 | 3 | 316 | 120 | 0.14 |
| VIO05 | outdoor: road around a block, parked cars | 4:45 | 283 | 41 | 286 | 238 | 0.44 |
| VIO06 | outdoor: park with playground equipment | 6:30 | 294 | 58 | 396 | 120 | 0.14 |
| Recording | MASt3R-F. | VGGT-SLAM † | ScaRF ‡ | FVIO | DAVIO | Accord |
|---|---|---|---|---|---|---|
| Note 9 | ||||||
| VIO01 | 0.19 | 0.06 | 0.21 | 0.17 | 0.26 | 0.41 |
| VIO02 | 0.00 | 0.02 | 0.00 | 0.11 | 0.00 | 0.00 |
| VIO04 | 0.00 | 0.15 | 0.17 | 0.08 | 0.14 | 0.26 |
| VIO05 | 0.08 | 0.06 | 0.08 | 0.07 | 0.08 | 0.11 |
| VIO06 | 0.00 | 0.15 | 0.17 | 0.19 | 0.26 | 0.30 |
Simultaneous Localization and Mapping
Simultaneous localization and mapping estimates a robot’s motion while building a map of an unknown environment.
See all 216 papers