cs.RONov 3, 2026

WayTrace: A Map-to-Language-to-Trace Hierarchy for Embodied Urban Navigation

Authors: Manthan Patel, Jonas Frey, Pascal Roth, Marco Hutter, Cesar Cadena

Organizations: Robotic Systems Lab (RSL), ETH Zurich, Switzerland · UC Berkeley, Berkeley, USA · NVIDIA, Zurich, Switzerland

Abstract

Web services provide walking directions for nearly every city, but following them reliably over long routes remains challenging for autonomous robots. Point-goal navigation policies rely heavily on accurate GNSS, while most vision-language navigation models struggle to execute even short instructions outdoors. We present WayTrace, a hierarchical system that connects web-map directions to robot motion through language. An off-the-shelf orchestrator vision-language model reads the turn-by-turn directions, a satellite map and recent camera images, and issues one atomic language command at a time, such as "cross the road to the left". An onboard trace predictor, trained on over one million automatically labelled samples from street-level images, draws the path for this command in the image, and a reinforcement learning policy tracks it. In long-range simulated missions, WayTrace remains robust to GNSS noise and rarely leaves crosswalks or sidewalks, while point-goal baselines degrade sharply with about ten times more violations. Deployed on a wheeled-legged robot, WayTrace completes real-world missions of up to 1.37 km at about 1.1 m/s through a busy city centre, rural trails and a university campus, handling crosswalks, staircases and construction sites. Project page: https://way-trace.github.io

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. DA-Nav: Direction-Aware City-Scale Vision-Language Navigation

    Jul 13, 2026Ye Yuan, Kehan Chen, Xinqiang Yu +7Embodied NavigationVision-Language Navigation

  2. CrossTracer: Cross-Embodiment Navigation via VLA Model Reasoning and Trace Residuals Adapting

    Aug 7, 2026Yao Wang, Siyuan Wang, Zhirui Sun +4Trajectory GenerationRobot Navigation

  3. UniTrackPLA: Unified Panorama-Language-Action Model for Instruction-Guided Navigation and Dynamic Person Tracking

    Oct 1, 2026Pengfei Qi, Haoran Lin, Sizhuang Chen +7Visual Object TrackingRobot Navigation