cs.ROJul 20, 2026

Predictive Training with Latent Imagination for Visual Quadruped Navigation

Authors: Yancheng ZhuWanli MaChen HanIrvin Haozhe ZhanBingfeng QinYixin Xu

Organizations: Anker Spatial Perception Lab

Abstract

Reinforcement-learning navigation policies for legged robots select actions reactively from current observations and short-term memory, with limited capacity to anticipate how moving obstacles will evolve in the near future. In dynamic environments, this reactivity causes the robot to respond too late because collision risk depends on short-horizon scene structure rather than on current obstacle positions alone. Lightweight predictive supervision applied to the policy's recurrent state during training can encode anticipatory obstacle dynamics without modifying the inference-time controller. We augment a reactive LSTM-SRU navigation backbone with an auxiliary JEPA-style predictor and SIGReg regularization: during training, the predictor supervises the deterministic hidden state to anticipate its own next state; at inference, it is fully discarded, incurring zero additional computational cost. On simulated and real-world navigation benchmarks with dynamic obstacles, our method substantially improves navigation success while reducing collision rates through the predictive training signal alone, without additional inference-time parameters. Real-robot deployment on a Unitree Go2 demonstrates zero-shot sim-to-real transfer: the controller navigates cluttered indoor and dynamic outdoor environments without fine-tuning, with evasive behavior consistent with the collision reduction observed in simulation.

Explore similar work

CardsList
  1. Learning to Navigate Efficiently with Only 0.58M Trainable Parameters

    Jul 13, 2026Edward Beng Wai Tan, Siew-Kei Lam