cs.ROSep 13, 2026

GLAM: Training a latent world model over global spatiotemporal memory for active exploration and navigation

Authors: I-Tak Ieong, Ruizhi Feng, Zhaoyang Lu, Yifei Cao, Jiayao Zhao, Leon Li, Senhua Zhu, Wenbo Ding

Organizations: Tsinghua University · Lab for Brain-Inspired Embodied Intelligence, EBKernel Technologies Co., Ltd · Northeastern University · University of California, Los Angeles · 

Abstract

Active exploration and semantic navigation require an embodied agent to build memory from partial observations, predict how the evolution of observed spatial memory may support future motion, and convert that prediction into actionable plans. We present GLAM, a goal-conditioned latent world model trained over global spatiotemporal memory, and GLAM NAV, the complete navigation system built around it. Given historical map tokens, a navigation goal, and the current robot pose, GLAM jointly predicts future map representations and robot-centric waypoint latents, allowing future spatial context and navigation intent to be inferred in a shared representation space. The model follows a JEPA-like latent prediction paradigm, operates directly on map-level latent tokens rather than RGB reconstruction, and uses a pretrained waypoint encoder-decoder to supervise and decode navigation plans within GLAM NAV. Training data are collected by replaying ObjectNav expert trajectories in Habitat over HM3D v0.2 scene assets and slicing them into multi-timescale prediction samples. On a controlled HM3D-ObjectNav subset reproduction setting, GLAM NAV improves over a reproduced BSC-Nav baseline in both success rate and success weighted by path length.

Figures & tables

Explore similar work

CardsList
  1. Predicting Consequences and Reinforcing Navigation Policies with Latent World Models

    Aug 23, 2026Zengmao Wang, Wei Gao, Shuhan ShenWorld Models for RoboticsAction-Conditioned World Models

  2. G2^2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigation

    Oct 12, 2026Ke Gui, Chenghao Shi, Ziyue Wang +3Scene Coordinate RegressionImage-Goal Navigation

  3. Enhancing Latent World Models with Associative Memory

    Oct 14, 2026Yuwei Sun, Siyu ZhuWorld Model LearningWorld Models for Robotics