cs.ROSep 17, 2026

Feeling Terrain Before Crossing: World Models for Off-Road Navigation

Authors: E-In SonDong-Wook KimJi-Hoon HwangKangsun LeeJisung BaeJung-Taak KimSeung-Woo Seo

Organizations: Department of Electrical & Computer Engineering, Seoul National University, Republic of Korea

Abstract

Navigation world models plan by foresight, predicting the future that each candidate action sequence produces and selecting the best, rather than mapping observations to actions directly. Unlike urban settings where a predicted scene is a sufficient proxy, off-road navigation hinges on the robot--terrain interaction, so the prediction must cover not only what the camera will see but what the robot will feel. However, existing scene-focused models do not predict how much the robot will slip, tilt or shake along a planned trajectory. Proprioception captures these dynamics directly and, when used as input, improves the prediction of the physical future. We present Feel-WM, the first off-road navigation world model that conditions on proprioception and predicts what the robot will feel alongside what the camera will see. The physical future takes the form of a future proprioceptive state and a failure risk, both learned from the robot's own experience without human labels. The planner rolls out the physical future alongside the scene and weighs the predicted failure risk against goal similarity in a separable score. Experiments on real off-road data and in simulation demonstrate that Feel-WM outperforms visual-only navigation world models in open-loop planning and closed-loop rough-terrain navigation across wheeled and legged platforms. Deployed on a Husky on mountain trails, Feel-WM plans onboard, predicts rough ground ahead and steers around it, completing courses that an end-to-end policy fails.

Explore similar work

CardsList
  1. Path Planning in Physically Viable World Models

    Jul 1, 2026Su Ann Low, Cheng-Hsi Hsiao, Xingjian Li +3Robot PlanningWorld Models