Streaming 3D Reconstruction

Overview

Streaming 3D reconstruction estimates camera motion and scene geometry as frames arrive, producing point maps, meshes, or renderable Gaussian-splat scenes for robotics, mapping, and interactive viewing. Methods range from causal vision and geometry transformers and recurrent state models to SLAM pipelines with bundle adjustment, pose graphs, and incremental Gaussian or TSDF mapping; test-time training and external memories carry context across long sequences. To bound cost, systems compress or retrieve tokens, retain spatial anchors, and gate updates using novelty, confidence, or motion, while dynamic-scene methods add temporal deformation and semantic or object tracking. Evaluation on indoor RGB-D datasets such as 7-Scenes, ScanNet, and TUM, and outdoor driving sequences such as KITTI, measures pose drift, geometric accuracy, rendering quality, speed, and memory; the central challenge is preventing drift and forgetting without making updates too slow or unresponsive to scene changes.

Latest papers

CardsList

111 papers14 papers in the last four weeks, up 27% on the four weeks before. 0.1% of all new papers.

  1. OCLDA-GS: Object-Centric Local Deformation-Aware Gaussian Streaming

    Nov 17, 2026Ashim Dahal, Nikesh Subedi, Rabab Abdelfattah +13D Gaussian SplattingStreaming 3D Reconstruction

  2. Eco3R: Pinned-Key Inference for Efficient and Streamable Feed-Forward 3D Reconstruction from Long Videos

    Nov 13, 2026Hongsen Cao, Shanxin Yuan, Mona Jaber +13D ReconstructionMulti-View 3D Reconstruction

  3. Sim(3)-TurboReg: Robust and Efficient Scale-Aware Registration via Tri-Scale Consistency

    Nov 10, 2026Zijun Zhou, Shaocheng Yan, Zhenjun Zhao +5Point Cloud RegistrationLarge-Scale 3D Reconstruction

  4. Video2Asset: Online Construction of Persistent 3D Street-Scene Assets

    Nov 6, 2026Zihan Zheng, Chunlei Cai, Zhenlong Wu +43D Reconstruction3D Scene Representation

  5. MetricTrail: Revisiting the Power of Metric Depth and Local Optimization for Long-Sequence Streaming 3D Reconstruction

    Nov 5, 2026Jingnan Gao, Jiahui Huang, Sven Elflein +8Streaming 3D ReconstructionMonocular 3D Reconstruction

  6. Mamba3R: Fixed-Capacity Selective State Memory for Long-Sequence 3D Reconstruction

    Nov 3, 2026Zhenxiang Xiong, Tianchen Deng, Nailin Wang +3Streaming 3D Reconstruction3D Reconstruction

  7. Solv3R: 3D Looped Transformer as a Multi-view Solver

    Nov 2, 2026Jeong-gi Kwak, Andrea Tagliasacchi, Sho Kagami +23D ReconstructionMulti-View 3D Reconstruction

  8. SceneBound: How Much Should a Streaming 3D Reconstruction Model Remember?

    Oct 31, 2026Ziming Wang, Chuyue Gong, Chutian Wang +4Streaming 3D ReconstructionVideo Frame Selection

  9. LingGS: Decoupling Feed-Forward Geometry Prediction from Camera Tracking for High-Fidelity Gaussian SLAM

    Oct 27, 2026Da Li, Yihan Zang, Ivan Viola +23DGS SLAMStreaming 3D Reconstruction

  10. PosePlaner: Denoising Any Feed-Forward Pose Predictor from Pairwise Planar Geometry

    Oct 26, 2026Yihang Chen, Bin Tan, Yujun Shen +2Relative Pose EstimationMulti-View Geometry

  11. KoalaGS: Complexity-Aware Continuous Level of Detail for Gaussian Splatting

    Oct 20, 2026Radu Beche, Raoul de Charette3D Gaussian Splatting3DGS Training

  12. RoMo-GS: Efficient Online 3D Gaussian Splatting for Robot Mapping via Exposure-Integrated Motion Blur

    Oct 17, 2026Sangwoo Jung, Di Deng, Jiahui Fu +33D Gaussian Splatting3D Mapping

  13. LonGaussian: Tracking Foundation Priors for Long-Context Feedforward Gaussian Reconstruction

    Oct 16, 2026Zhoufeng Xie, Guanjun Wu, Shuai Zhang +2Feed-Forward 3D ReconstructionStreaming 3D Reconstruction

  14. Remember, Revisit, Revise: Scaffold Memory for Long-Horizon 3D Geometry

    Oct 14, 2026Soumick Sarker, Mengmi Zhang3D ReconstructionStreaming 3D Reconstruction

  15. Gaussian Splatting for Real-Time Scene Reconstruction: Methods, Systems, and Trade-offs

    Oct 13, 2026Ashim Dahal, Rabab Abdelfattah, Nick Rahimi3D Gaussian Splatting3D Reconstruction

  16. BAT3R: Robust Online 3D Reconstruction with Bayesian Adaptive State Updates

    Oct 12, 2026Lijian Li, Yuanpeng He, Yudian Zheng +6Streaming 3D ReconstructionBayesian Filtering

  17. Drive3R: Block-wise Streaming Geometric Foundation Models for Autonomous Driving

    Oct 10, 2026Tianyi Yang, Haojun Yang, Jipeng Xiao +43D Foundation ModelsStreaming 3D Reconstruction

  18. Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstruction

    Oct 8, 2026Xiyuan Zhang, Yanming Yang, Kaiyuan Xu +2Streaming 3D Reconstruction3D Reconstruction

  19. DynStream: Online Streaming 4D Gaussian Reconstruction of Dynamic Worlds from Unposed Video

    Oct 7, 2026Dingwei Xian, Xiaoyu Zhou, Yajiao Xiong +24D ReconstructionDynamic Scene Reconstruction

  20. S2Tok: Streaming 3D Gaussian Reconstruction with Persistent Spatial Tokens

    Oct 6, 2026Fang Li, Jiraphon Yenphraphai, Quentin Herau +5Streaming 3D Reconstruction3D Scene Representation

  21. VGGT-Bridge: Beyond Sequential Pose Graphs via Coarse-Stride Skip Edges

    Oct 5, 2026Sungjae Choi, Hanna Bae, Sunghyun Baek +13D ViTsStreaming 3D Reconstruction

  22. CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction

    Oct 1, 2026Moyang Li, Zihan Zhu, Wei Zhang +23D Foundation ModelsStreaming 3D Reconstruction

  23. RegVGGT: Sustainable Visual Geometry Grounding for Streaming via Regulated Memory

    Sep 20, 2026Hongbo Mao, Junjun Jiang, Youyu Chen +3Streaming 3D ReconstructionFeed-Forward 3D Reconstruction

  24. Info3R: Information-Adaptive Test-Time Training for 3D Reconstruction

    Sep 18, 2026Sunghyun Baek, Hanna Bae, Minchan Kwon +1Video Depth EstimationStreaming 3D Reconstruction

  25. Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction

    Sep 18, 2026Jingke Zhou, Chenhang Ma, Zhizhou Zhong +63D ReconstructionStreaming 3D Reconstruction