cs.ROSep 18, 2026

FootQuery: Future-Touchdown-Guided Retrieval from Depth History for Perceptive Humanoid Locomotion

Authors: Tao Dong, Jia Yu, Yuxuan Fan, Linna Zhao, Jiaqi Gong, Andong Yang, Chao Gao, Guyue Zhou

Organizations: Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China. · University of Science and Technology Beijing, Beijing, China. · Nanyang Technological University, Singapore. · Department of Electrical Engineering. Tsinghua University, Beijing, China.

Abstract

Humanoid locomotion over complex terrain requires anticipating footholds that may no longer be visible at touchdown. Limited camera coverage and self-occlusion make it necessary to retrieve relevant terrain information from earlier observations. We present FootQuery, a perceptive locomotion framework that queries depth history using each foot's predicted next touchdown. The policy predicts touchdown locations and uncertainty from proprioception and uses these distributions, together with per-foot features, to query sparsely sampled historical depth frames. During training, realized contacts are projected into historical images to supervise retrieval at the regions where those contacts were visible. The retrieved per-foot features are fused with global visual memory to generate control actions. A progressive force-assistance curriculum supports early exploration, while event-consistent tread-midline shaping encourages coordinated stair contacts. Deployment requires only proprioception and onboard depth images. In simulation, the complete framework outperforms its component ablations on the most challenging tested stairs, gaps, and platforms. Real-world experiments on a Unitree G1 demonstrate continuous traversal with a single policy across outdoor stairs and indoor routes combining stair ascent and descent, platforms, and gaps. These results support organizing visual history around anticipated contacts for perceptive humanoid locomotion.

Figures & tables

Explore similar work

CardsList
  1. Echo in the Steps: Learning Perceptive Humanoid Parkour with Gated Memory

    Sep 24, 2026Ming-Ju Lee, Zizhuo Wang, Shaoting Zhu +3Agile LocomotionTraversal

  2. Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking

    Jun 6, 2026Alessandro Montenegro, Shihao Li, Puze Liu +2Robotic Manipulation PoliciesGenerative Control Policies

  3. TactileStep: Sole Tactile Learning for Regulating Foot-Terrain Interaction in Humanoid Locomotion

    Sep 24, 2026Zizhuo Wang, Ming-ju Lee, Shaoting Zhu +3TactileTerrain