cs.CVNov 8, 2026

Map2SLAM: From Streaming Map Prediction to Real-Time SLAM

Authors: Jian Gao, Lin-Zhuo Chen, Yihang Chen, Jiagang Chen, Jiacheng Dong, Xun Cao, Nan Xue, Yinghao Xu, 

Organizations: Nanjing University · Robbyant, Ant Group · HKUST · Wuhan University · 

Abstract

Streaming 3D foundation models (3DFMs) estimate camera poses and dense geometry online, but they fall short of SLAM: their predictions are fixed once emitted, so loop closures cannot correct accumulated drift. With such models already providing strong geometric capability, a central question for SLAM becomes how to schedule their inference and how to keep its results as revisable state. We present Map2SLAM, which keeps LingBot-Map frozen, trains only a lightweight retrieval head, and builds SLAM on the model's inference interface, turning its predictions into observations of an external persistent SLAM state. The front-end tracks every incoming frame with the model's causal streaming inference and decides which frames are written to the persistent state as keyframes. The back-end asynchronously decides when and which past frames to re-observe, re-running the model's joint inference over them with fresh context; verified loop observations correct the trajectory online, and segment observations refine dense geometry after the sequence. All invocations share a single frame encoder pass per image, whose cached features also drive loop retrieval, so frequent re-invocation incurs no additional encoding cost. Map2SLAM achieves state-of-the-art performance on KITTI, VBR, and Oxford Spires, reducing mean ATE by over 40% compared with the best uncalibrated baselines, while maintaining real-time tracking at over 28 FPS at a resolution of 518×154518\times154 on an NVIDIA RTX 5090D GPU. Please visit our project page at https://robbyant-research.github.io/Map2SLAM/.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend

    Sep 17, 2026Hengyi Wang, Lourdes AgapitoVisual SLAM

  2. F2^2 SLAM: Turning Feed-Forward Geometry into Persistent Factors for SLAM

    Oct 4, 2026Zhisong Xu, Fan Zhu, Jiawei Qian +3Simultaneous Localization and MappingFactor Graph Optimization

  3. UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization

    Aug 3, 2026Inha Lee, Dongjae Jeong, Junhee Lee +1Simultaneous Localization and MappingPose Graph Optimization