Vision-Language Navigation

Also known as VLN

Overview

Vision-Language Navigation (VLN) asks embodied agents—such as mobile robots and drones—to follow language instructions by interpreting what they see and choosing actions over time. Approaches range from end-to-end vision-language policies to hierarchical systems that combine large models with maps, scene graphs, spatial memory, geometric planners, and world models; imitation learning and reinforcement learning are common training strategies. Methods are tested on benchmarks such as R2R, RxR, REVERIE, VLN-CE, and HM3D, with growing attention to object goals, outdoor and aerial settings, and real-robot deployment. A central challenge is turning correct language and scene understanding into safe, efficient behavior over long routes, where localization drift, changing scenes, limited compute, and the gap between simulation and reality can cause failures.

Latest papers

CardsList

334 papers28 papers in the last four weeks, down 48% on the four weeks before. 0.2% of all new papers.

  1. ZeroVLN: Learning to Navigate without Supervised Fine-Tuning of the VLM Brain

    Nov 19, 2026Zixuan Huang, Yang Zhou, Guli Zhang +8Vision-Language NavigationRL for VLMs

  2. Cognitive-Horizon Action Chunking: Memory-Guided Adaptive Reasoning for Embodied Navigation

    Nov 19, 2026Weile Gong, Zijian Lu, Jiahao Zheng +6Robot NavigationVision-Language Navigation

  3. RemoteVLPG: How to Obtain a Specific VLM for Language-Guided Path Generation on Remote Sensing Images?

    Nov 19, 2026Junzhe Dang, Mengmeng Zhang, Yuxiang Zhang +1Remote Sensing VLMsVision-Language Navigation

  4. Bridging vision-language reasoning and learned control for legged navigation in the wild

    Nov 18, 2026Takahiro Miki, Robin Schmid, Manthan Patel +6Robot NavigationOff-Road Robot Navigation

  5. A Hierarchical Onboard Vision-Language-Navigation Framework for Aerial Robots in Complex Environments

    Nov 18, 2026Yuze Wu, Mo Zhu, Xingxing Li +8Aerial VLNUAV Navigation

  6. Improve How You Improve: Recursive Policy Self-Improvement for Zero-Shot Open-Vocabulary Multi-Object Navigation

    Nov 18, 2026Yang Li, Ziju Han, Aming WU +4Robot NavigationRobot Policy Adaptation

  7. Learning and Verifying Progress: Closed-Loop Agentic Planning with Progress-Enhanced Execution for Long-Horizon Vision-Language Navigation

    Nov 16, 2026Kangjie Zhou, Sukai Wang, Yuhan Xiao +7Vision-Language Navigation

  8. Vision-Language Grounded Semantic Navigation for Autonomous Mobile Robots

    Nov 16, 2026Ravindran Vasoor Saravanan, Chittin Varunav Ravi, Madhumita Singh +1Vision-Language NavigationIndoor Robot Navigation

  9. Remember, Replay, Adapt: Learning from Past Experience in Online Vision-and-Language Navigation

    Nov 15, 2026Chenhao Ding, Jizhou Han, Lixin Xiu +3Vision-Language NavigationRobot Policy Adaptation

  10. VLN-Flash: Parallel Action Decoding with Adaptive Execution for Vision-and-Language Navigation

    Nov 14, 2026Ruizhe Xie, Honghua Chen, Binglin Wang +4Vision-Language Navigation

  11. Racing the Clock: Teaching VLNs Budget-Conditioned Object Search

    Nov 12, 2026Maitree Meher, Siming He, S. Shankar Sastry +3Vision-Language NavigationPartially Observable Markov Decision Processes

  12. ProtoVis-Nav: Prototypical Visual Imagination for Visual-Spatial Aligned UAV Navigation

    Nov 12, 2026Guangyuan Sui, Yunzhong Hou, Chi Harold LiuVision-Language NavigationAerial VLN

  13. What Can a VLA Learn from the Agent That Calls It? Task-Level Experience Distillation for Embodied Navigation

    Nov 12, 2026Jinze Tao, Yuxiao Han, Kangkang Dong +4Vision-Language NavigationVision-Language-Action Models

  14. Reaching Is Not Finding: Map-Anchored Visual Prompting for the Last Mile of Aerial Vision-Language Navigation

    Nov 8, 2026Ningbo Li, Kebin Liu, Jingcan Chen +4Aerial VLNVision-Language Navigation

  15. CPNav: Calibrated Vision-Language Navigation for Object-Goal Search in Unseen Environments

    Nov 7, 2026Qizhao Chen, Yuanhong Zeng, Shoh Nishino +1Vision-Language NavigationObject-Goal Navigation

  16. WayTrace: A Map-to-Language-to-Trace Hierarchy for Embodied Urban Navigation

    Nov 3, 2026Manthan Patel, Jonas Frey, Pascal Roth +2Embodied NavigationRobot Navigation

  17. Caging Vision-Language Navigation for Legged Robots via Barrier-Certified Safety Architecture

    Nov 3, 2026Abhijeet M. Kulkarni, Saimouli Katragadda, Yuze Du +2Robot NavigationVision-Language Navigation

  18. HTCE: Homeomorphism-inspired Topological Cross-Scene Experience Canonicalization and Reuse for Object Navigation

    Nov 3, 2026Xiaoran Xu, Yupeng Wu, Tianyu Xue +4Object-Goal NavigationVision-Language Navigation

  19. Beyond Trial-and-Error: A Geospatial-Guided Active Reasoning Framework for Robust Aerial Vision-and-Language Navigation

    Oct 30, 2026Jiawei Ge, Wenkang Gong, Jiuxin Cao +8Vision-Language NavigationAerial VLN

  20. Ask to Evolve: A Unified Harness for Lifelong Embodied Navigation with Hybrid Action Space and Persistent Memory

    Oct 29, 2026Kai Sheng, Liuyi Wang, Jinlong Li +3Embodied NavigationLifelong Learning Agents

  21. What Should a Navigator Remember? Spatiotemporal Memory for Zero-Shot Vision-Language Navigation

    Oct 28, 2026Yuhang Peng, Zhikai Wang, Ziyi Wang +5Vision-Language NavigationMemory-Augmented VLMs

  22. ASPEN: Adaptive Semantic Reasoning via Command Persistence Prediction for Efficient Navigation VLAs

    Oct 26, 2026Vieri N. Akustia, Bin HuEfficient VLA InferenceVision-Language Navigation

  23. MemVLN: Streaming Episodic Memory for Vision-Language Navigation

    Oct 26, 2026Yan Wang, Jiangyong Huang, Siyuan Huang +1Vision-Language NavigationMemory-Augmented VLMs

  24. One Scan is Enough: Demonstration-Free Adaptation for Language-Guided Navigation

    Oct 24, 2026Zhuoyuan Yu, Yuxing Long, Du Wang +3Vision-Language NavigationRobot Policy Adaptation

  25. MOON: Learning When to Forget and How to Move On in Vision-and-Language Navigation

    Oct 24, 2026Jingmeng Zhou, Seson Sun, Binyao Xu +6Vision-Language Navigation

  26. SP-Guide: Enhancing Aerial Vision-Language Navigation with Spatial Priors

    Oct 23, 2026Haoxiang Tang, Dong Zhou, Shen Tan +2Vision-Language NavigationAerial VLN

  27. See What I Need, Dream What I Want: A Navigation Foundation Model on a Self-Constructed Representation Space

    Oct 22, 2026Jiawei Chen, Yinxi Wang, Zihan Yang +12Visual Robot NavigationVision-Language Navigation

  28. EBV-CAN: Vision--Language Grounding for Contact-Aided Endoscope Navigation

    Oct 22, 2026Chi Kit Ng, Shuchang Liu, Jinsong Lin +4Robotic EndoscopyEndoscopy