cs.RONov 17, 2026

Beyond Episodic Recall: Experience-to-Knowledge Evolution for Lifelong Embodied Navigation

Authors: Weitao An, Chenghao Xu, Xu Yang, Cheng Deng

Organizations: Xidian University Xi’an, China · Hohai University Nanjing, China

Abstract

Lifelong embodied navigation requires agents to accumulate experience through continuous interaction and reuse it for subsequent goal searches. Existing memory-enhanced methods typically retain historical observations or construct structured scene representations. However, storing observations or high-dimensional semantic embeddings incurs growing storage costs. Meanwhile, structured representations support retrieval and semantic reasoning but do not explicitly evolve accumulated experience into environment-specific knowledge. To address these limitations, we propose Experience-Evolving Memory (EvoNav), a novel two-timescale memory framework. It organizes semantic observations, spatial relations, and task-feedback cues into sparse experience atoms. During online operation, experience atoms continually consolidate repeated observations and form dynamic links based on transitions. At the slower timescale, EvoNav distills accumulated category co-occurrences and feedback signals into environment-specific structural knowledge without relying on predefined object--room relations. For each new goal, EvoNav combines direct goal evidence from experience atoms with learned structural knowledge to guide goal-directed search on the current traversability map. Experiments on single-goal, sequential multi-floor, and multimodal navigation demonstrate effective experience reuse and improved path efficiency with compact persistent memory, together with successful transfer to a real robot.

Figures & tables

Explore similar work

CardsList
  1. RetroNav: Scene-Grounded Retrospection and Retry for Self-Evolving Lifelong Navigation

    Oct 26, 2026Diantao Tu, Yangdong Liu, Niannian Dai +2Robot NavigationEmbodied Navigation

  2. Ask to Evolve: A Unified Harness for Lifelong Embodied Navigation with Hybrid Action Space and Persistent Memory

    Oct 29, 2026Kai Sheng, Liuyi Wang, Jinlong Li +3Embodied NavigationLifelong Learning Agents

  3. NavHarness: Towards Lifelong Embodied Navigation

    Sep 28, 2026Xunyi Zhao, Jian Zhou, Sihao Lin +6Embodied NavigationMemory-Augmented Agents