Vision-Language Navigation

Also known as VLN

Follow this topic Ask about this topic

Momentum

41 papers in the last four weeks, up 193% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 194

All topics

DaViNCi: A Dataset Towards Outdoor Vision-and-Language Navigation with Continuous Actions and Dynamic Elements
Aug 12, 2026Zihao Xie, Pingrui Lai, Yitong Wu +1Vision-Language Navigation
Shanghai Jiao Tong University · Shanghai, China
Hierarchical Fast-Slow ReAct Agent for Zero-Shot Object-Goal Navigation
Aug 10, 2026Zhaochen Lan, Zhi Yang, Yuxiang Fu +1Cognitive Architectures for AI Agents Vision-Language Navigation
School of Mechanical Engineering and Automation, Beihang University, Beijing, China · School of Automation, Beijing Institute of Technology, Beijing, China
From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation
Aug 10, 2026Zeyuan Ma, Jiaxin Chen, Di HuangUAV Navigation Vision-Language Navigation
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China · School of Computer Science and Engineering, Beihang University, Beijing, China
RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigation
Aug 10, 2026Boxiong Wang, Hui Kang, Geng Sun +3UAV Navigation Vision-Language Navigation
1Jilin University · 4Zhongguancun Academy · 2Tsinghua University +1
SAIN: Structure-Aware Interactive Navigation with Active Dialogue Grounding for Mobile Robot
Aug 10, 2026Yuhao Cao, Xiao Liu, Yang Xie +2Embodied Navigation Robot Navigation
School of Mechanical Engineering and Automation, Harbin Institute of Technology, Shenzhen, P.R. China · Department of Mechanical Engineering, City University of Hong Kong, Hong Kong SAR, China
Goal-oriented Navigation Instruction Generation with Tour Video Priors
Aug 9, 2026Fangdi Li, Juncheng Liao, Changxu Cheng +4Vision-Language Navigation
Uni-Ubi AI, Hangzhou, China · Zhejiang University, Hangzhou, China · Tongji University, Shanghai, China
WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN
Aug 7, 2026Yuehao Huang, Yunzi Wu, Xiaotao Zhang +7World Model Learning Vision-Language Navigation
Institute of Artificial Intelligence, China Telecom · 2Zhejiang University · 3Tongji University +1
Deliberate Before You Fly: Vision-Guided Spatial Deliberation for UAV See-and-Reach Navigation
Aug 5, 2026Fanfu Xue, En Yu, Bohang Liu +4UAV Navigation Vision-Language Navigation
School of Information Science and Engineering, Shandong University · Faculty of Engineering and Information Technology, University of Technology Sydney · School of Artificial Intelligence, Shandong University +1
From Routes to Steps: Separating Semantic Progress from Local Execution in Vision-and-Language Navigation
Aug 4, 2026Xiangyun Huang, Xiangchen Wang, Runfeng Lin +5Vision-Language Navigation VLMs for Robotics
1Beihang University · 2Southern University of Science and Technology · 3Central South University +2
CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learning
Aug 3, 2026Junru Song, Wenhao Zhang, Yang Yang +7UAV Navigation Stackelberg Games
1Shanghai Jiao Tong University · 2Intelligent Game and Decision Laboratory · 3Renmin University of China +1
AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization
Aug 2, 2026Peng Xu, Chengcheng Wang, Shaohua WanCollision Avoidance Direct Preference Optimization
University of Electronic Science and Technology of China, Chengdu, China · 2Shenzhen Institute for Advanced Study, UESTC, Shenzhen, China
FreqNav: Stage-Wise Frequency Routing for Object-Oriented Aerial Vision-Language Navigation
Aug 2, 2026Yin Tang, Jiawei Ma, Jiahao Li +4Efficient VLM Inference UAV Navigation
Big Data Institute, Central South University · Department of Computer Science, City University of Hong Kong · School of Computer Science and Engineering, Central South University +1
SC $^{2}$ -WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments
Aug 1, 2026Xuan Yao, Yuze Zhu, Junyu Gao +2Test-Time Adaptation World Model Learning
State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA) · School of Artificial Intelligence, University of Chinese Academy of Sciences (UCAS) · HiThink Research, China +1
HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation
Jul 31, 2026An Liu, Bingxi Liu, Hongyu Ding +6Memory-Augmented VLMs Vision-Language Navigation
Institute of Automation, Chinese Academy of Sciences, Beijing, China · Southern University of Science and Technology, Shenzhen, China · Pengcheng Laboratory, Shenzhen, China +3
TEA-AgriVLN: Traversability Estimation Alarm for Agricultural Vision-and-Language Navigation
Jul 30, 2026Xiaobei Zhao, Xingqi Lyu, Xin Chen +1Embodied Navigation Vision-Language Navigation
China Agricultural University · China Agricultural University-Sichuan Advanced Agricultural & Industrial Institute
BioVLN: A Simulation Platform for Visual Language Navigation in Biomedical Laboratories
Jul 29, 2026Zhe Liu, Quan Lu, Zhaohui Du +7Robotics Simulation Robot Navigation
Key Laboratory of Smart Manufacturing in Energy Chemical Process, MoE, East China University of Science and Technology, Shanghai, China · Department of Computer Science and Engineering, East China University of Science and Technology, Shanghai, China · Department of Laboratory Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China +1
Embodied Agents Take Control: Minimal-Interface Zero-Shot Agents Rival Industrial-Scale Policies in Vision-and-Language Navigation
Jul 28, 2026Jian Zhou, Xunyi Zhao, Gengze Zhou +4Embodied Navigation Language Model-Based Control
1Australian Institute for Machine Learning, Adelaide University · 2Responsible AI Research Centre · 3CSIRO Data61 +1
MemVLN: Episodic and Procedural Memory for Vision-and-Language Navigation
Jul 26, 2026Yuqi Liu, Shengju Qian, Tianyuan Qu +5Memory-Augmented VLMs Efficient VLM Inference
1The Chinese University of Hong Kong · 2LIGHTSPEED · 3The University of Hong Kong +1
Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation
Jul 25, 2026Yihao Wu, Chenyi Xu, Liqi Yan +6Representation Learning Information Bottleneck
1Hangzhou Dianzi University · University of Zurich · University of Exeter
Offline Vision-Language Navigation with Geometric Goal Localization for Outdoor Environments
Jul 24, 2026Ali Salmasi, Xianjia Yu, Tomi WesterlundSmall Language Models Robotics
Turku Intelligent Embedded and Robotic Systems (TIERS) Lab, University of Turku, Turku, Finland.
Robostral Navigate
Jul 22, 2026Abdelaziz Bounhar, Abhijeet Somani, Aditi Kabra +273Robot Policy Learning Robot Navigation
NavVerse: Benchmarking Indoor-to-Outdoor Embodied Navigation in Continuous Robot Simulation
Jul 22, 2026Junzhe Wu, Yue Hu, Zeyu Han +4Embodied Navigation Robotics Simulation
University of Michigan, Ann Arbor · Tsinghua University
No Training, Better Flights: Test-Time Scaled VLMs for UAV Navigation
Jul 21, 2026Feinan Cheng, Dongliang Xu, Wenli Nong +4Vision-Language Models UAV Navigation
Shandong University Weihai, China · China University of Petroleum (East China) Qingdao, China · MBZUAI Abu Dhabi, United Arab Emirates
Anticipate Before Acting: Future-State-Conditioned Vision-Language Navigation
Jul 20, 2026Lingfeng Zhang, Zhanguang Zhang, Liheng Ma +2Visual Navigation Vision-Language Navigation
Noah’s Ark Lab, 2012 Labs, Huawei · Department of Foundation model, 2012 Labs, Huawei
PGN: Design and Implementation of a Vision-Language Navigation System Based on Pangu Multimodal Foundation Model
Jul 20, 2026Li Xian, Mingxi Li, Yizheng Wang +3VLM Adaptation Multimodal Large Language Models
School of Information and Communication Engineering University of Electronic Science and Technology of China
VLN-AVP: Zero-Shot Vision-Language Navigation with Hybrid Long-Short-Term Memory for Autonomous Valet Parking
Jul 20, 2026Yijian Li, Xiangru Mu, Changze Li +7Memory-Augmented VLMs Autonomous Parking
Shanghai Jiao Tong University, Shanghai, China · Yinwang Intelligent Technology Co., Ltd.
Token-Wise Latent Streaming from Slow Reasoners to Fast Planners for Dynamic Vision Language Navigation
Jul 18, 2026Tianshuai Hu, Yangyi Zhong, Zeying Gong +7Vision-Language Navigation Social Navigation
The Hong Kong University of Science and Technology. · The Hong Kong University of Science and Technology (Guangzhou). · National University of Singapore. +1
SkillNav: Score-Level Skill Intervention for Zero-Shot Object Goal Navigation
Jul 17, 2026Ruijie Sang, Yiqun Duan, Pinhan Fu +3Vision-Language Navigation Object-Goal Navigation
D-Robotics · HAI Center, University of Technology Sydney · School of Computer Science, Wuhan University
SoftNav: Injecting 3D Scene Tokens into VLMs for Embodied Navigation
Jul 16, 2026Yi Wu, Junjie An, Xiao Liu +6Vision-Language Models Embodied Navigation
Zhejiang University · Shandong University
VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation
Jul 16, 2026Xiaoran Xu, Yupeng Wu, Tianyu Xue +4Memory-Augmented VLMs Robot Navigation
MAIS, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China · Tsinghua University, Beijing, China +1

Aug 12, 2026, cs.ROJ/K move · Enter open · S save

DaViNCi: A Dataset Towards Outdoor Vision-and-Language Navigation with Continuous Actions and Dynamic Elements

Zihao Xie, Pingrui Lai, Yitong Wu, Hua Yang

Shanghai Jiao Tong University · Shanghai, China

Vision-Language Navigation

Open paper AskPDF arXiv

Vision-and-Language Navigation (VLN) has progressively expanded from indoor to outdoor environments. However, existing outdoor VLN datasets still rely on fixed discrete topological graphs for construction. It fails to align with the rapidly changing real-world outdoor environments and impedes the sim-to-real transfer of VLN agents. To address this limitation, we propose DaViNCi (\textbf{D}yn\textbf{a}mic \textbf{Vi}sion-and-Language \textbf{N}avigation in \textbf{C}ont\textbf{i}nuous Environment), the first outdoor VLN dataset that simultaneously introduces both continuous and dynamic factors. The agent not only moves in the outdoor environment using continuous actions but is also required to handle unpredictable dynamic elements. The dataset encompasses six distinct maps with a total of 6,933 trajectories. Through comprehensive comparative experiments, we find that the success rate on DaViNCi decreased by more than 10% in discrete environments compared to previous datasets. And there is an even greater decline in continuous settings, demonstrating the challenge of DaViNCi. Furthermore, we clarify the impact of action granularity and dynamic elements. These results demonstrate the practical value of DaViNCi in advancing outdoor VLN toward more realistic environments. The website is https://xzh0312.github.io/DaViNCi/.

Momentum

Related topics

Latest papers 194