cs.CVSep 18, 2026

Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction

Authors: Jingke Zhou, Chenhang Ma, Zhizhou Zhong, Mingkai Liu, Zhuang Zhou, Yicheng ji, Binghua Su, Bo Cai, +1 more

Organizations: Zhejiang University · Fudan University · Peking University · Beijing Institute of Technology

Abstract

We propose LoG-VGGT, a memory-efficient framework for long-sequence 3D reconstruction that balances local temporal modeling with global camera consistency. Instead of relying on full global attention, our method introduces cross-window attention at a small subset of transformer blocks, enabling effective information propagation across adjacent temporal windows while keeping memory usage bounded. To mitigate long-term pose drift, we further design a global camera consistency refinement module, where camera tokens interact with compact register tokens via cross-attention to enforce scene-level constraints across the entire sequence. This design enables joint optimization of camera representations and significantly improves long-horizon pose stability without incurring the high cost of sequence-wide attention. Extensive experiments demonstrate that LoG-VGGT achieves improved depth accuracy and robust camera pose estimation across multiple long-sequence benchmarks, while delivering competitive streaming reconstruction performance.

Explore similar work

CardsList
  1. Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval

    May 10, 2026Zichen Zou, Xiaosong Jia, Zuxuan Wu +13D ViTsStreaming 3D Reconstruction

  2. HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction

    May 22, 2026Chong Cheng, Peilin Tao, Nanjie Yao +93D ViTsStreaming 3D Reconstruction

  3. Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction

    Aug 27, 2026Jiarong Han, Jincheng Xiong, Yuzhou Liu +6Streaming 3D Reconstruction3D Reconstruction