VGGT-SLAM++
Organizations: Indian Institute of Technology Delhi · Addverb Technologies · Brown University
Abstract
We introduce VGGT-SLAM++, a complete visual SLAM system that leverages the geometry-rich outputs of the Visual Geometry Grounded Transformer (VGGT). The system comprises a visual odometry (front-end) fusing the VGGT feed-forward transformer and a Sim(3) solution, a Digital Elevation Map (DEM)-based graph construction module, and a back-end that jointly enable accurate large-scale mapping with bounded memory. While prior transformer-based SLAM pipelines such as VGGT-SLAM rely primarily on sparse loop closures or global Sim(3) manifold constraints - allowing short-horizon pose drift - VGGT-SLAM++ restores high-cadence local bundle adjustment (LBA) through a spatially corrective back-end. For each VGGT submap, we construct a dense planar-canonical DEM, partition it into patches, and compute their DINOv2 embeddings to integrate the submap into a covisibility graph. Spatial neighbors are retrieved using a Visual Place Recognition (VPR) module within the covisibility window, triggering frequent local optimization that stabilizes trajectories. Across standard SLAM benchmarks, VGGT-SLAM++ achieves state-of-the-art accuracy, substantially reducing short-term drift, accelerating graph convergence, and maintaining global consistency with compact DEM tiles and sublinear retrieval.
Figures & tables
| Method | Uncalib. | 00 | 01 | 02 | 03 | 04 | 05 | 06 | 07 | 08 | 09 | 10 | Avg. |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Classical feature-based SLAM | |||||||||||||
| ORB-SLAM2 (w/o LC) [ 55 ] | ✗ | 40.65 | 502.20 | 47.82 | 0.94 | 1.30 | 29.95 | 40.82 | 16.04 | 43.09 | 38.77 | 5.42 | 69.73 |
| ORB-SLAM2 (w/ LC) [ 55 ] | ✗ | 6.03 | 508.34 | 14.76 | 1.02 | 1.57 | 4.04 | 11.16 | 2.19 | 38.85 | 8.39 | 6.63 | 54.82 |
| LDSO [ 25 ] | ✗ | 9.32 | 11.68 | 31.98 | 2.85 | 1.22 | 5.10 | 13.55 | 2.96 | 129.02 | 21.64 | 17.36 | 22.43 |
| Learning-based SLAM | |||||||||||||
| DROID-SLAM [ 77 ] | ✗ | 92.10 | 5344.60 | 107.61 | 2.38 | 1.00 | 118.50 | 62.47 | 21.78 | 161.60 | 72.32 | 118.70 | 554.82 |
| Method | Uncalib. | 360 | desk | desk2 | floor | plant | room | rpy | teddy | xyz | Avg. |
|---|---|---|---|---|---|---|---|---|---|---|---|
| ORB-SLAM3 [ 9 ] | ✗ | 0.017 | 0.210 | – | 0.034 | – | – | – | 0.009 | N/A | N/A |
| DeepV2D [ 75 ] | ✗ | 0.243 | 0.166 | 0.379 | 1.653 | 0.203 | 0.246 | 0.105 | 0.316 | 0.064 | 0.375 |
| DeepFactors [ 14 ] | ✗ | 0.159 | 0.170 | 0.253 | 0.169 | 0.305 | 0.364 | 0.043 | 0.601 | 0.035 | 0.233 |
| DPV-SLAM [ 44 ] | ✗ | 0.112 | 0.018 | 0.029 | 0.057 | 0.021 | 0.330 | 0.030 | 0.084 | 0.010 | 0.076 |
| DPV-SLAM++ [ 44 ] | ✗ | 0.132 | 0.018 | 0.029 | 0.050 | 0.022 | 0.096 | 0.032 | 0.098 | 0.010 | 0.054 |
| GO-SLAM [ 94 ] | ✗ | 0.089 | 0.016 | 0.028 | 0.025 | 0.026 | 0.052 | 0.019 | 0.048 | 0.010 | 0.035 |
| Method | Uncalib. | chess | fire | heads | office | pumpkin | kitchen | stairs | Avg. |
|---|---|---|---|---|---|---|---|---|---|
| NICER-SLAM3 [ 97 ] | ✗ | 0.033 | 0.069 | 0.042 | 0.108 | 0.200 | 0.039 | 0.108 | 0.086 |
| DROID-SLAM [ 77 ] | ✗ | 0.036 | 0.027 | 0.025 | 0.066 | 0.127 | 0.040 | 0.026 | 0.050 |
| MASt3R-SLAM [ 56 ] | ✗ | 0.053 | 0.025 | 0.015 | 0.097 | 0.088 | 0.041 | 0.011 | 0.047 |
| DROID-SLAM* [ 77 ] | ✓ | 0.047 | 0.038 | 0.034 | 0.136 | 0.166 | 0.080 | 0.044 | 0.078 |
| MASt3R-SLAM* [ 56 ] | ✓ | 0.063 | 0.046 | 0.029 | 0.103 | 0.114 | 0.074 | 0.032 | 0.066 |
| VGGT-SLAM (Sim3) [ 50 ] | ✓ | 0.037 | 0.026 | 0.018 | 0.104 | 0.133 | 0.061 | 0.093 | 0.067 |
| Method | Uncalib. | Clone | Fog | Morning | Overcast | Rain | Sunset | Avg. |
|---|---|---|---|---|---|---|---|---|
| Sequence 01 | ||||||||
| DROID-SLAM [ 77 ] | ✗ | 1.03 | 1.87 | 0.99 | 1.01 | 0.78 | 1.15 | 1.14 |
| CUT3R [ 37 ] | ✗ | 43.30 | 63.19 | 50.60 | 38.73 | 51.55 | 43.79 | 48.53 |
| VGGT-SLAM (Sim(3)) [ 50 ] | ✓ | 1.44 | 3.20 | 0.82 | 0.78 | 1.56 | 3.02 | 1.80 |
| VGGT-SLAM (SL(4)) [ 50 ] | ✓ | 3.32 | 9.02 | 1.46 | 1.74 | 5.99 | 6.21 | 4.62 |
| VGGT-SLAM++ | ✓ | 1.03 | 3.06 | 1.28 | 1.68 | 2.43 | 3.28 | 2.13 |
| Method | 00 | 01 | 02 | 03 | 04 | 05 | 06 | 07 | 08 | 09 | 10 | Avg. |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VGGT-SLAM++ (default) | 119.00 | 109.64 | 223.21 | 4.50 | 0.95 | 25.21 | 13.65 | 12.17 | 155.00 | 35.26 | 15.71 | 64.936 |
| Mean reducer (no softmax) | 120.49 | 109.64 | 223.21 | 4.50 | 0.95 | 25.21 | 13.65 | 12.17 | 155.00 | 35.26 | 15.71 | 65.072 |
| Softmax ( ) | 119.00 | 109.64 | 223.21 | 4.50 | 0.95 | 25.21 | 13.65 | 12.17 | 155.00 | 35.26 | 15.71 | 64.936 |
| Softmax ( ) | 120.49 | 109.64 | 219.25 | 4.50 | 0.95 | 25.21 | 13.65 | 12.17 | 155.00 | 35.26 | 15.71 | 64.711 |
| Half resolution | 116.53 | 109.64 | 171.42 | 4.50 | 0.95 | 20.79 | 5.85 | 12.17 | 155.00 | 35.26 | 15.71 | 58.893 |
| High resolution | 132.54 | 109.64 | 223.21 | 4.50 | 0.95 | 23.32 | 13.65 | 12.17 | 155.00 | 35.26 | 15.71 | 65.995 |
| Method | Uncalib. | MH01 | MH02 | MH03 | MH04 | MH05 | Avg. |
|---|---|---|---|---|---|---|---|
| ORB-SLAM [ 54 ] | ✗ | 0.071 | 0.067 | 0.071 | 0.082 | 0.060 | 0.070 |
| DSM [ 98 ] | ✗ | 0.039 | 0.036 | 0.055 | 0.057 | 0.067 | 0.051 |
| ORB-SLAM3 [ 54 ] | ✗ | 0.016 | 0.027 | 0.028 | 0.138 | 0.072 | 0.056 |
| DeepFactors [ 14 ] | ✓ | 1.587 | 1.479 | 3.139 | 5.331 | 4.002 | 3.108 |
| DROID-SLAM [ 77 ] | ✓ | 0.013 | 0.014 | 0.022 | 0.043 | 0.043 | 0.027 |
| VGGT-SLAM (Sim(3)) [ 50 ] | ✓ | 1.740 | 2.890 | 2.270 | 3.390 | 4.400 | 2.938 |
Visual SLAM
Visual simultaneous localization and mapping (SLAM) estimates camera motion while building maps from images for navigation and scene understanding.
See all 106 papers