Vision-Language Navigation (VLN) aims to empower robots with the ability to perform long-horizon navigation in unfamiliar environments based on complex linguistic instructions. Its success critically hinges on establishing an efficient language-understanding -- visual-perception -- embodied-execution'' closed loop. Existing methods often suffer from perceptual distortion and decision drift in complex, long-distance tasks due to the cognitive overload of a single agent. Inspired by distributed cognition theory, this paper proposes MA-CoNav, a Multi-Agent Collaborative Navigation framework. This framework adopts a Master-Slave'' hierarchical agent collaboration architecture, decoupling and distributing the perception, planning, execution, and memory functions required for navigation tasks to specialized agents. Specifically, the Master Agent is responsible for global orchestration, while the Subordinate Agent group collaborates through a clear division of labor: an Observation Agent generates environment descriptions, a Planning Agent performs task decomposition and dynamic verification, an Execution Agent handles simultaneous mapping and action, and a Memory Agent manages structured experiences. Furthermore, the framework introduces a ``Local-Global'' dual-stage reflection mechanism to dynamically optimize the entire navigation pipeline. Empirical experiments were conducted using a real-world indoor dataset collected by a Limo Pro robot, with no scene-specific fine-tuning performed on the models throughout the process. The results demonstrate that MA-CoNav comprehensively outperforms existing mainstream VLN methods across multiple metrics.
Figures & tables
Figure 1: The overall architecture of MA-CoNav.
Category
Method
NL (Steps) ↓
NE (Meters) ↓
SR (%) ↑
OSR (%) ↑
SPL (%) ↑
KPA (%) ↑
Single-Agent
NavGPT [ 29 ]
18.67
6.78
0
2.00
0
14.14
MapGPT [ 5 ]
11.21
5.97
0
4.80
0
21.82
Multi-Agent
CoELA [ 3 ]
34.78
5.71
2.80
5.20
1.15
32.01
RCTAMP [ 24 ]
38.59
4.27
8.40
12.80
5.04
34.54
MA-CoNav (Ours)
33.56
2.93
25.60
37.60
15.62
69.89
Table 1: Comparison of MA-CoNav with State-of-the-Art Methods
Model
NL (Steps) ↓
NE (Meters) ↓
SR (%) ↑
OSR (%) ↑
SPL (%) ↑
KPA (%) ↑
MLLM
32.17
4.05
17.60
32.80
10.56
51.92
MLLM + LLM
33.56
2.93
25.60
37.60
15.62
69.89
Table 2: Comparison of Different LLM Configurations under the MA-CoNav Framework
Method
NL (Steps) ↓
NE (Meters) ↓
SR (%) ↑
OSR (%) ↑
SPL (%) ↑
KPA (%) ↑
w/o Main Agent
33.64
4.25
19.60
24.80
11.96
44.95
w/o Task Planning Agent
18.31
4.92
5.20
9.20
3.02
28.18
w/o Observation Agent
39.57
5.63
8.40
13.20
4.62
30.81
w/o Control Execution Agent
12.46
8.71
0
1.20
0
12.63
w/o Memory Agent
23.82
3.34
15.60
22.00
9.83
48.28
w/o Reflection Mechanism
25.44
3.01
17.20
23.20
8.60
45.45
Table 3: Ablation Experiment Analysis of MA-CoNav Core Components
Method
NL (Steps) ↓
NE (Meters) ↓
SR (%) ↑
OSR (%) ↑
SPL (%) ↑
KPA (%) ↑
w/o Hierarchical Decomposition
30.35
3.65
18.40
23.60
11.04
42.42
w/o Dynamic Verification
28.19
3.91
15.60
18.80
8.11
39.86
MA-CoNav (Full)
33.56
2.93
25.60
37.60
15.62
69.89
Table 4: Ablation Experiment of Internal Components of Task Planning Agent
Method
NL (Steps) ↓
NE (Meters) ↓
SR (%) ↑
OSR (%) ↑
SPL (%) ↑
KPA (%) ↑
w/o Geometric Map Construction
29.5
5.81
9.60
14.40
6.72
32.53
w/o Topological Map Construction
35.21
3.80
16.40
21.20
10.66
45.05
MA-CoNav (Full)
33.56
2.93
25.60
37.60
15.62
69.89
Table 5: Ablation Experiment Analysis of Internal Components of Control Execution Agent
Method
NL (Steps) ↓
NE (Meters) ↓
SR (%) ↑
OSR (%) ↑
SPL (%) ↑
KPA (%) ↑
w/o Experience Structured Refinement
25.16
3.98
18.80
24.40
11.84
50.90
w/o Experience Retrieval and Application
23.82
4.34
19.20
22.80
11.71
48.28
MA-CoNav (Full)
33.56
2.93
25.60
37.60
15.62
69.89
Table 6: Ablation Experiment Analysis of Internal Components of Memory Agent
Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding, current VLN systems remain constrained by limited spatial perception, 2D-3D representation mismatch, and monocular scale ambiguity. In this paper, we propose AgentVLN, a novel and efficient embodied navigation framework that can be deployed on edge computing platforms. We formulate VLN as a Partially Observable Semi-Markov Decision Process (POSMDP) and introduce a VLM-as-Brain paradigm that decouples high-level semantic reasoning from perception and planning via a plug-and-play skill library. To resolve multi-level representation inconsistency, we design a cross-space representation mapping that projects perception-layer 3D topological waypoints into the image plane, yielding pixel-aligned visual prompts for the VLM. Building on this bridge, we integrate a context-aware self-correction and active exploration strategy to recover from occlusions and suppress error accumulation over long trajectories. To further address the spatial ambiguity of instructions in unstructured environments, we propose a Query-Driven Perceptual Chain-of-Thought (QD-PCoT) scheme, enabling the agent with the metacognitive ability to actively seek geometric depth information. Finally, we construct AgentVLN-Instruct, a large-scale instruction-tuning dataset with dynamic stage routing conditioned on target visibility. Extensive experiments show that AgentVLN consistently outperforms prior state-of-the-art methods (SOTA) on long-horizon VLN benchmarks, offering a practical paradigm for lightweight deployment of next-generation embodied navigation models. Code: https://github.com/Allenxinn/AgentVLN.
Zihao Xin, Wentong Li, Yixuan Jiang +6
Nanjing University of Aeronautics and Astronautics · Shandong University · Zhejiang University
Vision-and-Language Navigation (VLN) has largely focused on a single agent following a single instruction, yet many real-world applications require teams of robots to tackle tasks beyond the capabilities of any individual agent. We present Systematic Multi-Agent Vision-and-Language Navigation, providing, to our knowledge, the first systematic formalization of multi-agent VLN as a constrained coordination problem: each mission consists of subtasks carrying dependency and resource constraints (presence locks and holding chains). A verified four-stage crafting pipeline instantiates the task as MAVLN, comprising 11,724 episodes across 145 scenes with teams of up to four agents under three instruction regimes, accompanied by tailored constraint-aware metrics. We further present TRISS, a coordination-ready navigation system coupling an LLM-based subtask scheduler, a shared topological memory that turns each agent's exploration into team knowledge, and a conflict-aware execution mechanism that realizes simultaneous intentions as collision-free routes. Extensive experiments establish TRISS as a comprehensive baseline and reveal substantial room for improvement across scheduling, planning, and execution, highlighting the challenges of coordinating under MAVLN task constraints. Project page: https://xyz9911.github.io/mavln.
Yunzhe Xu, Zhe Liu
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China
Existing vision-language navigation methods often couple a VLM with waypoint decoders to produce multi-step action plans, but they typically lack an explicit closed-loop mechanism for tracking semantic progress, diagnosing execution failures, and recovering from error accumulation in long-horizon navigation. To address this gap, we propose ReflectVLN, an agentic VLN framework that organizes decision-making through bidirectionally interactive intention and execution agents. The intention agent performs subtask decomposition and reflection, generating executable subtask descriptions as corrective plans. Conditioned on these descriptions, the execution agent grounds them into short-horizon actions under current observations while monitoring sub-goal progress and detecting off-track behavior. Crucially, ReflectVLN enables closed-loop bidirectional communication: the execution agent emits progress and deviation signals to trigger reflection and subtask updates on demand, and the intention agent returns structured guidance that reconditions subsequent actions for recovery. To encourage temporally coherent decisions with interpretable intermediate rationales, we introduce Action Chain-of-Thought (Action-CoT), a path-conditioned dual-query training scheme for action generation. Experiments on standard VLN benchmarks show that ReflectVLN improves success rates and path efficiency under a constrained data budget, with favorable training cost and fewer high-level intention calls at inference time, while providing interpretable intermediate decisions for analysis and collaboration. Code is available at: https://github.com/AIprogrammer/ReflectVLN