Vision-Language Navigation

Also known as VLN

Follow this topic Ask about this topic

Momentum

41 papers in the last four weeks, up 193% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 194

All topics

SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation
May 17, 2026Jingzhi Huang, Junkai Huang, Wenxuan Song +4Visual Spatial Reasoning Vision-Language Navigation
Hong Kong Polytechnic University · Institute of Automation, Chinese Academy of Sciences · Hong Kong University of Science and Technology (Guangzhou)
WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation
May 15, 2026Baining Zhao, Jiacheng Xu, Weicheng Feng +13World Model Learning Vision-Language Navigation
Tsinghua University · Shandong University · Manifold AI +2
Exploring Bottlenecks in VLM-LLM Navigation: How 3D Scene Understanding Capability Impacts Zero-Shot VLN
May 14, 2026Ziyi Xia, Chaoran Xiong, Litao Wei +2Vision-Language Navigation 3D Scene Understanding
Shanghai Key Laboratory of Navigation and Location Based Services, Shanghai Jiao Tong University (SJTU), Shanghai 200240, China · State Key Laboratory of Submarine Geoscience, SJTU
What Limits Vision-and-Language Navigation ?
May 13, 2026Yunheng Wang, Yuetong Fang, Taowen Wang +9Sim-to-Real Transfer Vision-Language Navigation
1HKUST(GZ) · 2JD Explore Academy · 1HKUST(GZ
HCSG: Human-Centric Semantic-Geometric Reasoning for Vision-Language Navigation
May 13, 2026Haoxuan Xu, Tianfu Li, Wenbo Chen +7Social Robot Navigation Vision-Language Navigation
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China · Tsinghua University, Shenzhen 518055, China · University of Science and Technology Beijing, Beijing 100083, China +2
SleepWalk: A Three-Tier Benchmark for Stress-Testing Instruction-Guided Vision-Language Navigation
May 11, 2026Niyati Rawal, Sushant Ravva, Shah Alam Abir +5VLM Evaluation Spatial Reasoning Benchmarks
† Indian AI Research Organization (IAIRO), India · ⋆ĸragya Lab, BITS Pilani Goa, India · ¶ University of Dhaka, Bangladesh +3
LCGNav: Local Candidate-Aware Geometric Enhancement for General Topological Planning in Vision-Language Navigation
May 9, 2026Jiankun Peng, Jianyuan Guo, Yiguang Yang +3Vision-Language Navigation
The Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China · The School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China · The Department of Computer Science, City University of Hong Kong, Hong Kong, SAR, China
NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Maps
May 7, 2026Dijia Zhan, Jinyi Li, Chenxi Zheng +4Vision-Language Navigation Motion Planning
South China University of Technology
ProCompNav: Proactive Instance Navigation with Comparative Judgment for Ambiguous User Queries
May 7, 2026Junhyuk Kwon, Seungjoon Lee, Hyejin Park +2Clarification Question Generation Vision-Language Navigation
GSAI, POSTECH · CSE, POSTECH · Oracle
A Semantic Autonomy Framework for VLM-Integrated Indoor Mobile Robots: Hybrid Deterministic Reasoning and Cross-Robot Adaptive Memory
May 4, 2026Bogdan Felician Abaza, Andrei-Alexandru Staicu, Cristian Vasile DoicinMobile Robotics Vision-Language Navigation
Faculty of Industrial Engineering and Robotics (FIIR), National University of Science and Technology POLITEHNICA Bucharest
Action Agent: Agentic Video Generation Meets Flow-Constrained Diffusion
May 2, 2026Jeffrin Sam, Nguyen Khang, Yara Mahmoud +2Trajectory Generation Diffusion-Based Planning
Intelligent Space Robotics Laboratory, Skoltech, Bolshoy Boulevard, 30, Moscow 121205, Russia
MiniVLA-Nav v1: A Multi-Scene Simulation Dataset for Language-Conditioned Robot Navigation
May 1, 2026Ali Al-Bustami, Jaerock KwonRobotic Data Collection Robotics Simulation
Department of Electrical and Computer Engineering, University of Michigan-Dearborn, Dearborn, USA.
SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation
Apr 30, 2026Pengna Li, Kangyi Wu, Shaoqing Xu +7VLM Adaptation Vision-Language Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · The State Key Laboratory of Internet of Things for Smart City, Centre for Artificial Intelligence and Robotics, University of Macau · Xiaomi EV +2
Three-Step Nav: A Hierarchical Global-Local Planner for Zero-Shot Vision-and-Language Navigation
Apr 29, 2026Wanrong Zheng, Yunhao Ge, Laurent IttiVision-Language Navigation
University of Southern California · 2NVIDIA Research
Walk With Me: Long-Horizon Social Navigation for Human-Centric Outdoor Assistance
Apr 29, 2026Lingfeng Zhang, Xiaoshuai Hao, Xizhou Bu +11Robot Navigation Safe Robot Navigation
Tsinghua University · Pengcheng Laboratory · Xiaomi EV +5
Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents
Apr 28, 2026Jianming Chen, Yawen Wang, Junjie Wang +4Agent Failure Analysis AI Agent Evaluation
Institute of Software, Chinese Academy of Sciences, Beijing, China · Science & Technology on Integrated Information System Laboratory, Beijing, China · State Key Laboratory of Complex System Modeling and Simulation Technology, Beijing, China +2
FreqCache: Accelerating Embodied VLN Models with Adaptive Frequency-Guided Token Caching
Apr 27, 2026Zihao Zheng, Xingyue Zhou, Zhihao Mao +7Efficient VLM Inference Vision-Language Navigation
School of Computer Science, Peking University · School of Artificial Intelligence and Automation, Huazhong University of Science and Technology · School of Computer Science, China University of Geosciences (Wuhan) +3
DM $^3$ -Nav: Decentralized Multi-Agent Multimodal Multi-Object Semantic Navigation
Apr 23, 2026Amin Kashiri, Atharva Jamsandekar, Yasin YazıcıoğluVision-Language Navigation Multi-Robot Coordination
Northeastern University, Boston, USA · Department of Electrical and Computer Engineering at Northeastern University, Boston, MA
A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration
Apr 23, 2026Kuan Xu, Ruimeng Liu, Yizhuo Yang +5Robot Navigation Vision-Language Navigation
Center for Advanced Robotics Technology Innovation (CARTIN), School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798 · Spatial AI & Robotics Lab, Department of Computer Science and Engineering, University at Buffalo, Buffalo, NY 14260
LiveVLN: Breaking the Stop-and-Go Loop in Vision-Language Navigation
Apr 21, 2026Xiangchen Wang, Weiye Zhu, Teng Wang +5Vision-Language Navigation Action Chunking
Southern University of Science and Technology · Harbin Institute of Technology, Shenzhen · Spatialtemporal AI
The Essence of Balance for Self-Improving Agents in Vision-and-Language Navigation
Apr 21, 2026Zhen Liu, Yuhan Liu, Jinjun Wang +3Vision-Language Navigation Self-Improving Agents
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence and the Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an 710049, China · School of Information Science and Technology, North China University of Technology, Beijing 100144, China · Zhongguancun Academy, Beijing 100190, China
Instruction-as-State: Environment-Guided and State-Conditioned Semantic Understanding for Embodied Navigation
Apr 20, 2026Zhen Liu, Yuhan Liu, Jinjun Wang +3Embodied Navigation Vision-Language Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, China · The Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xian Ning West Road No. 28, Xi’an, 710049, Shaanxi, China · School of Information Science and Technology, North China University of Technology, 100144, Beijing, China +1
Dual-Anchoring: Addressing State Drift in Vision-Language Navigation
Apr 19, 2026Kangyi Wu, Pengna Li, Kailin Lyu +5VLM Adaptation Vision-Language Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · Institute of Automation, Chinese Academy of Sciences, School of Artificial Intelligence, University of Chinese Academy of Sciences · Johns Hopkins University +2
LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation
Apr 19, 2026Yuwei Ning, Ganlong Zhao, Yipeng Qin +4Vision-Language Navigation Aerial VLN
Sun Yat-sen University · Peng Cheng Laboratory · The Chinese University of Hong Kong +4
Rule-VLN: Bridging Perception and Compliance via Semantic Reasoning and Geometric Rectification
Apr 18, 2026Jiawen Wen, Penglei Sun, Wenjie Zhang +4Safe Robot Navigation Vision-Language Navigation
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Beijing Normal University, Beijing, China · 3Jul Guangzhou University, Guangzhou, China
FineCog-Nav: Integrating Fine-grained Cognitive Modules for Zero-shot Multimodal UAV Navigation
Apr 17, 2026Dian Shao, Zhengzheng Xu, Peiyang Wang +4Zero-Shot Learning UAV Navigation
Northwestern Polytechnical University · Nanjing University
Language-Conditioned World Modeling for Visual Navigation
Mar 23, 2026Yifei Dong, Fengyi Wu, Yilong Dai +8World Model Learning Vision-Language Navigation
University of Washington · National University of Singapore · Clemson University +2
SpatialFly: Implicit 3D Prior-Guided Visual Reparameterization for Continuous UAV Vision-and-Language Navigation
Mar 22, 2026Wen Jiang, Kangyao Huang, Li Wang +9Visual Representation Learning 3D Spatial Reasoning
School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China · Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China · Chongqing Innovation Center, Beijing Institute of Technology, Chongqing 401120, China +5
ImagiNav: Scalable Embodied Navigation via Generative Visual Prediction and Inverse Dynamics
Mar 14, 2026Jie Chen, Yuxin Cai, Yizhuo Wang +5Robot Navigation Vision-Language Navigation
Department of Mechanical Engineering, National University of Singapore, Singapore · Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore · Nanyang Technological University (NTU), Singapore
SPAN-Nav: Generalized Spatial Awareness for Versatile Embodied Navigation
Mar 10, 2026Jiahang Liu, Tianyu Xu, Jiawei Chen +9Embodied Navigation Vision-Language Navigation
Peking University · Galbot · BAAI

May 17, 2026, cs.ROJ/K move · Enter open · S save

SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation

Jingzhi Huang, Junkai Huang, Wenxuan Song, Haoyang Yang+3

Hong Kong Polytechnic University · Institute of Automation, Chinese Academy of Sciences · Hong Kong University of Science and Technology (Guangzhou)

Visual Spatial Reasoning Vision-Language Navigation Vision-Language Grounding VLM Reasoning

Open paper AskPDF arXiv

Vision-Language Navigation (VLN) approaches have currently followed two primary paradigms: the end-to-end Vision-Language Model (VLM) policy fine-tuned on navigation trajectories to directly predict actions, and the zero-shot modular pipeline integrating pre-trained Multimodal Large Language Model (MLLM) for training-free generalization to unseen environments. However, end-to-end methods struggle with long-horizon navigation and lack dynamic reasoning, whereas zero-shot methods are constrained by limited spatial grounding for reliable planning and also require substantial reasoning time. To bridge this gap, we introduce SEDualVLN, a spatially-enhanced dual-system VLN framework. System 1 is a VLM model enhanced with both global and local spatial awareness, used for action generation. System 2 integrates a general MLLM with a mapping module, wherein the MLLM plans waypoints by leveraging top-down views of the real-time 3D map alongside streams of rendered path images. Both systems leverage different forms of spatial enhancement to cultivate the agent's sense of direction in VLN tasks. Ultimately, they cooperate to complete the navigation task through a fast-slow coordinated approach. SEDualVLN achieves state-of-the-art performance on VLN-CE benchmarks, and further ablation studies demonstrate the effectiveness of each system and module.

Momentum

Related topics

Latest papers 194