Long-horizon navigation requires an agent to revise its intermediate objectives as evidence accumulates. Full visual histories are costly to process, while compact summaries may omit details needed to reconsider earlier decisions. We introduce NavProbe, a hierarchical zero-shot navigation agent that couples a dynamic subgoal agenda with active evidence retrieval. A compact index links summaries of visited places, transitions, and landmarks to their visual and geometric records. When the current context is insufficient, a task executive retrieves targeted evidence to generate, revise, or resolve subgoals. Reusable conclusions are used to update the index, and a skill policy converts the revised task state into parameterized navigation actions. NavProbe achieves 71.7% SR and 55.8% SPL on R2R-CE and 55.3% SR and 38.6% SPL on RxR-CE, outperforming strong zero-shot baselines. It also achieves 79.3% SR on HM3D-v2 ObjectNav, with qualitative real-robot demonstrations illustrating physical deployment. Code is available at https://github.com/liujy25/NavProbe.
Figures & tables
Fig. 1: NavProbe’s formulate–probe–verify–act cycle. The task executive maintains a dynamic subgoal agenda using the current observation, task-state memory, and compact episodic-memory index. It retrieves historical evidence when needed to generate, revise, or resolve subgoals, and consolidates reusable conclusions into entity knowledge. The skill policy combines the updated task state and retrieval conclusions with the current observation to select a parameterized navigation action. Geometric routines execute the action, producing observations and trajectories for subsequent decisions.
Method
VLN-CE R2R Val-Unseen
VLN-CE RxR Val-Unseen
NE ↓
OSR ↑
SR ↑
SPL ↑
NE ↓
SR ↑
SPL ↑
nDTW ↑
Supervised Learning (Training Method)
StreamVLN [ 21 ]
4.98
64.2
56.9
51.9
6.22
52.9
46.0
61.9
NavFoM [ 22 ]
5.01
64.9
56.2
51.2
5.51
57.4
49.4
60.2
OmniNav [ 23 ]
3.74
74.6
69.5
66.1
3.77
73.6
62.0
–
InternVLA-N1 [ 24 ]
4.83
63.3
58.2
54.0
5.91
53.5
46.1
65.3
TABLE I: Main results on R2R-CE and RxR-CE val-unseen. Bold and underlined values denote the best and second-best results, respectively, within the zero-shot block. † denotes our rerun of Uni-LaViRA using GPT-5.5 on the R2R-CE subset.
Method
SR ↑
SPL ↑
VLFM [ 35 ]
62.6
31.0
InstructNav [ 4 ]
58.0
20.9
ApexNav [ 36 ]
76.2
38.0
DSCD-Nav [ 37 ]
73.0
38.7
ReMemNav [ 38 ]
67.8
36.6
Uni-LaViRA [ 15 ]
77.7
46.1
TABLE II: Main results on HM3D-v2 ObjectNav. Bold and underlined values denote the best and second-best results, respectively.
Fig. 2: Qualitative results of retrieval-supported recovery. (a) In VLN, retrieved transition evidence guides route reassessment, followed by successful navigation to the dining room. (b) In ObjectNav, retrieved landmark evidence prompts renewed search after a false TV detection, leading to successful termination near a real TV.
Variant
NE ↓
OSR ↑
SR ↑
SPL ↑
NavProbe (Ours)
3.45
78.0
71.7
55.8
w/o Task-State Memory
3.94
72.0
63.3
51.4
w/o EKM
4.20
67.7
65.0
51.1
w/o Retrieval & EKM
4.65
69.3
57.3
43.1
Full Graph
3.83
70.3
62.0
48.8
TABLE III: Ablation results on R2R-CE.
Fig. 3: Real-world deployment of NavProbe on a Galaxea R1Pro. Each row shows key execution stages and corresponding onboard observations for a multi-stage navigation instruction.
Query dimension
Queries
Share
Action execution
2,643
68.44%
Spatial/route relation
2,152
55.72%
Landmark/target identification
1,122
29.05%
≥2 dimensions
1,863
48.24%
TABLE IV: Semantic dimensions of 3,862 retrieval queries pooled across R2R-CE and RxR-CE. Labels are non-exclusive.
Zero-shot vision-and-language navigation (VLN) requires an agent to use past observations without navigation-specific training. We study what information an 8B-scale navigation system should retain and how it should be organized for subsequent decisions. Our agent combines instruction progress, hierarchically compressed observation history anchored to poses, and accumulated geometry in complementary task, temporal, and spatial memories. An 8B observer summarizes observations, and an 8B reasoner uses the memories to select waypoint intents or request additional views, a geometric controller executes the selected targets. A semantic information perspective motivates the distinction between retaining evidence, making it accessible to the reasoner, and acquiring further observations. On R2R-CE val-unseen, the complete system achieves the highest among the evaluated Qwen3-based zero-shot baselines. Removing temporal memory reduces SR and sharply increases average path length from 16.9 to 39.1m, removing the spatial-map and planning component reduces SR as well. Real-world experiments on a Unitree Go2 show that our zero-shot method achieves higher success rates than the post-trained baseline in both corridor and office environments, suggesting better transfer to the evaluated real-world settings. As a complementary evaluation, LAW2 uses paired instruction interventions to examine behavioral responses, instruction following ability beyond endpoint success. These results support preserving task progress, observation history, and geometry in structured memory for zero-shot navigation with smaller open models.
Yuhang Peng, Zhikai Wang, Ziyi Wang +5
The Hong Kong Polytechnic University · Tsinghua University · Shanghai Jiao Tong University
Zero-shot object navigation requires agents to locate unseen targets in unfamiliar environments without prior maps or task-specific training. Despite the commonsense reasoning ability of vision-language models (VLMs), existing mapless navigators often suffer from repeated exploration and premature stopping caused by limited historical context and false-positive target predictions. We propose ReMemNav, a training-free framework that combines lightweight semantic grounding, memory-based decision correction, and target verification. RAM-derived semantic priors guide panoramic direction selection, while a geometry-triggered correction mechanism retrieves historical scene descriptions when the selected direction points toward previously visited regions. When a target is predicted to be visible, ReMemNav verifies the corresponding single-view observation before the final approach. Depth-based action sampling then converts the high-level decision into collision-free motion. Experiments on HM3D and MP3D show that ReMemNav achieves higher success rates and path efficiency than existing training-free zero-shot baselines. Specifically, ReMemNav achieves absolute SR/SPL gains of 1.7%/5.3% on HM3D v0.1, 18.2%/11.1% on HM3D v0.2, and 8.7%/6.9% on MP3D.
Vision-Language Navigation in Continuous Environments (VLN-CE) requires an embodied agent to execute long-horizon instructions in unknown environments. Existing zero-shot VLN-CE systems typically maintain spatial states through geometric localization or coordinate-based representations. Recent geometry-constrained navigation removes depth and globally consistent coordinates, but maintaining persistent spatial awareness for place confirmation, progress verification, and recovery remains challenging. We present Navi-Agent, a zero-shot VLN-CE agent that constructs a coordinate-free spatial state from visual observations and executed motion histories. Navi-Agent organizes this state as a navigation topology, where nodes represent visual places and edges represent motion transitions. This representation enables observation-based approximate self-localization, task progress verification, and visual revisitation-based recovery. Navi-Agent performs closed-loop navigation by decomposing instructions into sub-goals, executing local visual navigation, and verifying visited places through the constructed spatial state. Experiments on zero-shot VLN-CE benchmark and real-world robot platforms show that Navi-Agent achieves state-of-the-art performance among geometry-constrained methods while remaining competitive with approaches relying on geometric localization.
Wenyuan Xie, Mengyang Hong, Yongzhong Wang +9
Shanghai Jiao Tong University · Southern University of Science and Technology · Xinjiang University of Finance and Economics +1