Beyond Trial-and-Error: A Geospatial-Guided Active Reasoning Framework for Robust Aerial Vision-and-Language Navigation
Authors: Jiawei Ge, Wenkang Gong, Jiuxin Cao, Bo Liu, Lei Cui, Haoran Wang, Xuelin Zhu, Biwei Cao, Chang Liu, Chen Feng, Ioannis Patras
Organizations: Southeast University · Institute of AI for Industries, Chinese Academy of Sciences · The Hong Kong Polytechnic University · Hohai University · Queen’s University Belfast · Queen Mary University of London
Aerial Vision-and-Language Navigation (VLN) requires UAVs to locate language-specified goals in large-scale urban environments, where objects often appear small and visually ambiguous from high-altitude viewpoints. Existing methods largely follow a reactive paradigm common in indoor VLN, repeatedly updating navigation states from local observations while underutilizing the geospatial structure that remains stable during navigation. As a result, visually similar distractors can cause a reactive goal search to repeatedly reinforce locally plausible goal hypotheses based on passively accumulated evidence, leading to unreliable localization. To address this, we propose GeoReasoner, a robust framework that shifts the paradigm of Aerial VLN from reactive trial-and-error to geospatial-guided active reasoning. Specifically, GeoReasoner first performs pre-search geospatial reasoning to derive region-level priors and constrain the goal hypothesis space. Building on these, it further conducts hypothesis-driven exploration to actively acquire discriminative evidence and refine competing goal hypotheses. Finally, consistency-aware goal verification adversarially assesses complementary evidence sources before stopping, hence reducing premature or erroneous goal confirmations. Experiments on the real-world CityNav benchmark demonstrate that GeoReasoner sets a new SOTA among zero-shot Aerial VLN methods while competing favorably with supervised approaches.
Figures & tables
Figure 1: Overview of our framework. Unlike conventional reactive Aerial VLN methods that search for the goal through trial-and-error from passively acquired observations, GeoReasoner exploits geospatial knowledge as a prior before search to constrain the goal hypothesis space, actively acquires discriminative evidence to resolve competing goal hypotheses, and verifies multi-source consistency before stopping.
Figure 2: Detailed workflow of our framework. GeoReasoner progressively constrains, refines, and verifies goal hypotheses through three stages: (1) Pre-search Geospatial Reasoning disentangles geographic constraints and contextual cues to generate region-level goal hypotheses. (2) Hypothesis-Driven Active Exploration instantiates object-level hypotheses through initial waypoint exploration and actively seeks discriminative evidence to refine competing hypotheses when necessary. (3) Consistency-Aware Goal Verification employs adversarial reasoning to assess multi-source evidence and guide navigation decisions.
Method
Learning Setting
Test-Unseen
Val-Unseen
Val-Seen
NE ↓
SR ↑
OSR ↑
SPL ↑
NE ↓
SR ↑
OSR ↑
SPL ↑
NE ↓
SR ↑
OSR ↑
SPL ↑
Seq2Seq+GSM
Supervised
98.10
3.81
13.92
2.79
78.60
5.13
10.90
4.65
58.50
8.43
17.31
7.28
CMA+GSM
94.6
4.68
12.01
4.05
75.9
4.38
9.29
3.90
68.0
6.25
13.28
5.40
AerialVLN+GSM
85.1
6.72
18.21
5.16
72.7
6.35
15.24
5.06
56.6
10.16
22.20
7.89
MGP
93.80
6.38
26.04
6.08
75.10
5.84
22.19
5.56
59.70
8.69
35.51
8.28
FlightGPT
76.20
21.20
35.38
19.24
68.10
14.69
29.33
13.24
66.10
17.57
30.26
15.78
Table 1: Comparison with state-of-the-art methods on the original CityNav benchmark. NE is measured in meters, while SR, OSR, and SPL are reported as percentages. Best and second-best results are highlighted in bold and underline , respectively.
Method
Learning Setting
Easy
Medium
Hard
NE ↓
SR ↑
OSR ↑
SPL ↑
NE ↓
SR ↑
OSR ↑
SPL ↑
NE ↓
SR ↑
OSR ↑
SPL ↑
Seq2Seq
Supervised
238.80
3.07
14.70
2.64
246.50
0.43
3.87
0.38
253.10
0.48
4.38
0.44
CMA
260.70
0.49
16.69
0.44
241.20
1.10
7.67
1.09
253.80
0.96
1.64
0.95
MGP
98.90
6.15
39.89
5.48
90.90
6.29
21.47
6.21
90.00
6.80
12.10
6.78
HTNav
68.90
19.99
45.18
14.94
68.20
20.40
39.44
18.69
68.10
21.91
34.14
21.11
GeoNav
66.1
26.1
40.1
15.2
53.8
22.9
39.6
17.1
68.9
16.7
22.9
12.5
Table 2: Navigation performance across different difficulty levels on the original CityNav Test-Unseen split. Best and second-best results are highlighted in bold and underline , respectively.
Method
Learning Setting
Test-Unseen-Hard
Val-Unseen-Hard
Val-Seen-Hard
NE ↓
SR ↑
OSR ↑
SPL ↑
NE ↓
SR ↑
OSR ↑
SPL ↑
NE ↓
SR ↑
OSR ↑
SPL ↑
HETT
Supervised
45.14
24.00
42.51
21.97
58.84
18.87
32.01
17.04
41.40
27.95
43.74
25.89
FlightGPT
73.01
23.09
35.51
22.05
69.92
14.99
23.22
14.20
71.97
14.62
25.50
13.90
GeoNav (Qwen3.8-Flash)
59.90
12.16
25.38
10.59
77.87
9.71
21.09
8.54
71.87
8.54
19.77
7.00
Ours (Qwen3.8-Flash)
Zero-shot
41.43
35.45
52.13
30.59
54.32
34.51
55.78
29.79
47.79
33.10
54.74
28.21
Table 3: Navigation results on the Hard subsets of CityNav. Best and second-best results are highlighted in bold and underline , respectively.
Variant
NE ↓
SR ↑
OSR ↑
SPL ↑
Full
38.97
37.77
59.63
27.85
w/o Hypothesis
54.21
29.49
48.31
19.51
w/o Exploration Memory
47.35
33.65
53.49
22.57
w/o Consistency Verification
46.13
32.91
55.70
24.36
w/o Active Evidence Seeking
52.68
30.62
49.33
20.37
w/o Adversarial Debate
42.18
35.79
59.33
26.52
Table 4: Ablation results of GeoReasoner on Test-Unseen.
Figure 3: Qualitative comparison on CityNav. Recorded trajectories of GeoReasoner and three other methods in (a) fine-grained vehicle localization and (b) landmark-guided goal localization.
Existing aerial Vision-Language Navigation (VLN) methods predominantly adopt a detection-and-planning pipeline, which converts open-vocabulary detections into discrete textual scene graphs. These approaches are plagued by inadequate spatial reasoning capabilities and inherent linguistic ambiguities. To address these bottlenecks, we propose a Visual-Spatial Reasoning (ViSA) enhanced framework for aerial VLN. Specifically, a triple-phase collaborative architecture is designed to leverage structured visual prompting, enabling Vision-Language Models (VLMs) to perform direct reasoning on image planes without the need for additional training or complex intermediate representations. Comprehensive evaluations on the CityNav benchmark demonstrate that the ViSA-enhanced VLN achieves a 70.3% improvement in success rate compared to the fully trained state-of-the-art (SOTA) method, elucidating its great potential as a backbone for aerial VLN systems.
Haoyu Tong, Xiangyu Dong, Xiaoguang Ma +3
Tianmushan Laboratory, Beihang University, Hangzhou 311115, China · Hangzhou International Innovation Institute, Beihang University, Hangzhou 311115, China · Foshan Graduate School of Innovation, Northeastern University, Foshan, China +3
Aerial Vision-and-Language Navigation (Aerial VLN) enables unmanned aerial vehicles (UAVs) to follow natural language instructions and navigate complex urban environments. While recent advances have achieved progress through large-scale memory graphs and lookahead path planning, they remain limited by shallow instruction understanding and high computational cost. In particular, existing methods rely primarily on landmark descriptions, overlooking directional cues "a key source of spatial context in human navigation". In this work, we propose LookasideVLN, a new paradigm that exploits directional cues in natural language to achieve both more accurate spatial reasoning and greater computational efficiency. LookasideVLN comprises three core components: (1) an Egocentric Lookaside Graph (ELG) that dynamically encodes instruction-relevant landmarks and their directional relationships, (2) a Spatial Landmark Knowledge Base (SLKB) that provides lightweight memory retrieval from prior navigation experiences, and (3) a Lookaside MLLM Navigation Agent that aligns multimodal information from user instructions, visual observations, and landmark-direction information from ELG for path planning. Extensive experiments show that LookasideVLN significantly outperforms the state-of-the-art CityNavAgent, even with a single-level lookahead, demonstrating that leveraging directional cues is a powerful yet efficient strategy for Aerial VLN.
Yuwei Ning, Ganlong Zhao, Yipeng Qin +4
Sun Yat-sen University · Peng Cheng Laboratory · The Chinese University of Hong Kong +4
Aerial vision-language navigation (AVLN) requires a UAV to reach a language-described target from partial egocentric observations while reasoning over large outdoor scenes. Existing approaches typically fuse view-centered RGB observations and globally anchored history maps as generic visual embeddings, leaving cross-modal spatial alignment to be learned from sparse navigation supervision. We present SP-Guide, a transformer- based goal-prediction framework that addresses this weakness of alignment through a Spatial Prior Cross-Modal Encoder, an Instruction Enhanced Decoder, and a Goal Convergence Filter for terminal target refinement. Experiments implemented on the CityNav benchmark show that SP-Guide improves success rate over the representative baselines, with the largest gains on unseen environments. These results indicate that physically grounded spatial priors provide an effective inductive bias for robust AVLN.
Haoxiang Tang, Dong Zhou, Shen Tan +2
School of Astronautics, Harbin Institute of Technology, Harbin, 150001, China · The 28th Research Institute, China Electronics Technology Group Corporation, Nanjing, 210001, China