ReMemNav: Memory-Based Decision Correction and Target Verification for Zero-Shot Object Navigation
Organizations: Fudan University · Tongji University
Abstract
Zero-shot object navigation requires agents to locate unseen targets in unfamiliar environments without prior maps or task-specific training. Despite the commonsense reasoning ability of vision-language models (VLMs), existing mapless navigators often suffer from repeated exploration and premature stopping caused by limited historical context and false-positive target predictions. We propose ReMemNav, a training-free framework that combines lightweight semantic grounding, memory-based decision correction, and target verification. RAM-derived semantic priors guide panoramic direction selection, while a geometry-triggered correction mechanism retrieves historical scene descriptions when the selected direction points toward previously visited regions. When a target is predicted to be visible, ReMemNav verifies the corresponding single-view observation before the final approach. Depth-based action sampling then converts the high-level decision into collision-free motion. Experiments on HM3D and MP3D show that ReMemNav achieves higher success rates and path efficiency than existing training-free zero-shot baselines. Specifically, ReMemNav achieves absolute SR/SPL gains of 1.7%/5.3% on HM3D v0.1, 18.2%/11.1% on HM3D v0.2, and 8.7%/6.9% on MP3D.
Figures & tables
| Methods | TF | ZS | MP3D | HM3D_v0.1 | HM3D_v0.2 | |||
| SR | SPL | SR | SPL | SR | SPL | |||
| Habitat-Web ( Ramrakhya et al. 2022 ) | ✗ | ✗ | 31.6 | 8.5 | 41.5 | 16.0 | – | – |
| OVRL ( Yadav et al. 2023b ) | ✗ | ✗ | 28.6 | 7.4 | – | – | – | – |
| ZSON ( Majumdar et al. 2022 ) | ✗ | 15.3 | 4.8 | 25.5 | 12.6 | – | – | |
| PixNav ( Cai et al. 2024 ) | ✗ | – | – | 37.9 | 20.5 | – | – | |
| PSL ( Sun et al. 2024 ) | ✗ | 18.9 | 6.4 | 42.4 | 19.2 | – | – | |
| Method | SR (%) | SPL (%) |
|---|---|---|
| VLMNav | 41.5 | 11.7 |
| UniGoal | 43.3 | 21.7 |
| InstructNav | 53.5 | 21.1 |
| ReMemNav (Ours) | 56.2 | 21.8 |
| Variant | SR (%) | SPL (%) |
|---|---|---|
| Full ReMemNav | 56.2 | 21.8 |
| w/o Semantic Grounding | 55.4 | 21.3 |
| w/o Memory-Based Correction | 52.8 | 21.4 |
| w/o Target Verification | 45.9 | 21.0 |
Robot Navigation
Robot navigation studies how robots perceive, localize, plan, and move safely toward goals in static or changing environments.
See all 536 papers