Blind Dexterity: Whole-Body Humanoid Manipulation via Pure Proprioception
Organizations: Intelligent Autonomous Systems Lab, TU Darmstadt · German Research Center for AI (DFKI) · Tongji University, Shanghai Research Institute for Autonomous Intelligent Systems · Robotics Institute Germany
Abstract
We present blind, whole-body manipulation skills on a Unitree G1 humanoid using only onboard proprioception, without cameras, markers, force-torque, or tactile sensors. Despite this minimal sensing, the trained policies exhibit surprising capability across qualitatively different tasks: push-resilient bipedal walking without IMU feedback, active soccer ball trapping with a foot, seeking and lifting a suitcase by its handle, and mounting a randomly positioned skateboard. We argue that these capabilities arise from a key underappreciated signal: the way the joint encoder readouts evolve under purposeful compliant contact, effectively forming a whole-body tactile channel. By generating contact-rich motions, the trained policies actively probe the environment; as a result, task-relevant object state (e.g., pose) becomes increasingly decodable from short proprioceptive histories. We expose this information using compact task-specific state estimators trained alongside, but fully separately from, the policies; their prediction errors decrease rapidly after informative contact. Our results indicate that joint encoder-based proprioception, combined with compliant actuation (now widely available on commercial robots and low-cost motors) is already a strong, practical substrate for whole-body dexterous manipulation and interactive perception, and therefore a natural foundation on which richer sensing can be layered.
Figures & tables
| Policy | Success (%) | Loc Error over Episode ( ) | ||
|---|---|---|---|---|
| Mean Std | Best | Mean Std | Best | |
| Privileged | - | - | ||
| Distilled | - | - | ||
| Blind -SE | ||||
| Blind +SE | ||||
| Policy | Success (%) | Pose Error over Episode | ||
|---|---|---|---|---|
| Mean Std | Best | Mean Std | Best | |
| Privileged | - | - | ||
| Distilled | - | - | ||
| Blind -SE | ||||
| Blind +SE | ||||
| Config | Success (%) | Tipping (%) | SE Error (full) | ||
|---|---|---|---|---|---|
| Mean Std | Best | Mean Std | Best | Mean Std | |
| Privileged | - | ||||
| Distilled | - | ||||
| Blind -VS-SE | |||||
| Blind -VS+SE | |||||
| Blind +VS-SE | |||||
Whole-Body Robotic Manipulation
Whole-Body Robotic Manipulation coordinates a robot’s arms, hands, body, and mobility to manipulate objects while maintaining balance and contact.
See all 88 papers