cs.CVNov 18, 2026

Allocentric Memory, Egocentric Acting: A Dual-Frame VLA for Urban Aerial Navigation

Authors: Haotian Xu, Yue Hu, Zhengqiu Zhu, Tuo Feng, Wenguan Wang, Quanjun Yin

Organizations: National Key Laboratory of Digital Intelligent Modeling and Simulation · College of Systems Engineering, National University of Defense Technology · Zhejiang University

Abstract

Language-goal aerial navigation requires a UAV to reach a destination specified in natural language using observations collected during flight. A key challenge is linking changing egocentric perception with spatial evidence anchored to stable locations for long-range navigation. We propose CityNav-VLA, a dual-frame vision-language-action model for urban navigation integrating dynamic egocentric context with persistent allocentric spatial memory. The UAV incrementally accumulates visual observations on a fixed north-up map initialized with geographic and landmark priors, preserving evidence across viewpoint changes. A dynamic query conditioned on the instruction, current observations, UAV state, and motion history retrieves relevant memory evidence to predict a map-frame target. A deterministic controller converts this target into body-frame commands using the UAV's current pose, connecting global reasoning with egocentric execution. To reduce target fluctuations over long horizons, early goal commitment (EGC) fixes the execution target to the coordinate-wise median of the first KK predictions without extra trainable parameters. On Test Unseen, CityNav-VLA reduces NE by 21.2% and improves SR and SPL by 15.8% and 30.9%, respectively. It also reduces NE by 6.2% and improves SR and SPL by 5.6% and 23.2%, respectively, relative to the former SOTA after dataset refinement. Cumulative ablations show that navigation-map features yield the largest gains, while metric coordinates further improve endpoint accuracy. With a 4B-scale backbone, inference averages 0.68 s per decision with 8.6 GB peak memory on a single A100, presenting remarkable model efficiency.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation

    Apr 19, 2026Yuwei Ning, Ganlong Zhao, Yipeng Qin +4Vision-Language NavigationAerial VLN

  2. SP-Guide: Enhancing Aerial Vision-Language Navigation with Spatial Priors

    Oct 23, 2026Haoxiang Tang, Dong Zhou, Shen Tan +2Vision-Language NavigationAerial VLN

  3. Beyond Trial-and-Error: A Geospatial-Guided Active Reasoning Framework for Robust Aerial Vision-and-Language Navigation

    Oct 30, 2026Jiawei Ge, Wenkang Gong, Jiuxin Cao +8Vision-Language NavigationAerial VLN