Currently, robots can learn whole-body loco-manipulation through scale: the strongest policies have billions of parameters and still need task-specific fine-tuning. Humans have limited processing capacity, yet learn and act efficiently through a body schema that organizes what they see and how they move. We introduce Body Schema Policy (BSP), an imitation learning policy that builds such a schema into the vision-action interface. Its latent body schema places joint and link tokens on the robot's kinematic tree, where learned screw motions carry features between links. Through body-queried vision, each body part retrieves its own visual evidence, which conditions the denoising of its actions. With this inductive bias, BSP returns an action chunk faster than any policy we compare. Compact, body-specific visual readouts also emerge without spatial supervision: manipulation commands depend strongly on task objects, while locomotion commands respond more broadly to the scene. On nine simulated Unitree G1 whole-body tasks, BSP matches the Ψ0 humanoid foundation model with 75× fewer parameters and nearly doubles Diffusion Policy's success. The same holds on a real G1 and a Fetch mobile manipulator.
Figures & tables
Figure 2: Body Schema Policy architecture. The state st , denoising step k , and current action hypothesis xt(k) initialize joint ( J ), link ( L ), and global ( g ) tokens. Each of the N neural screw blocks transports parent-link features to child links (Eq. 3 ), then updates the corresponding joint tokens. Periodic blocks add body self-attention over links and the global token and body-queried cross-attention, which retrieves image features with body tokens as queries Q and visual tokens as keys and values K , V ; the last such block is drawn. The final schema supplies one condition cn per action coordinate to a shared temporal decoder fϕ , which predicts action noise.
Figure 3: Evaluation tasks. Top left: the two real-world G1 tasks, each in three phases. Purple arrows mark the motion. Bottom left: the three ManiSkill-HAB tasks on the Fetch mobile manipulator, in third-person views. Right: the nine SIMPLE tasks in egocentric views.
Table 1: Nine representative whole-body humanoid tasks on SIMPLE : successes on each of the three evaluation levels (L0/L1/L2), 10 fixed episodes per task per level. Params: the whole model as deployed. Time: ms per action chunk on an RTX 6000 Ada. Policy type: IL, VLA, WAM. Bold = best, underline = second best; tied totals share a mark.
Figure 4: Forward kinematics beyond the training range: one test configuration of the G1 (top) and of Fetch (bottom). Each link is drawn displaced by its pose error and colored by that error on a log scale. Fetch is drawn in its base frame, with each model’s base translation error removed; the color keeps the full error.
Figure 5: Denoising from noise on Handover tasks. (a) Each row is one denoiser’s clean-action estimate after the given number of DDPM iterations, out of 100, drawn in the head-camera view; last column: the demonstration. (b) The joint-command error of the next action at every iteration: the mean absolute difference from the demonstration over the 31 joint commands of the hands, arms, and waist; dots mark the iterations shown in (a). Rodri.: Rodrigues Network.
Table 2: ManiSkill-HAB SetTable subtasks with the Fetch mobile manipulator. Success rate (%), mean ± standard deviation over three training seeds; 1,008 episodes per seed. Params: the whole model as deployed. Policy type: IL, VLA.
Table 3: Real-world G1 tasks: successes in 10 trials per task. Params: the whole model as deployed. Time: ms per action chunk on an RTX 5090. Policy type: IL, VLA.
Latent body schema
Body-queried vision
DINOv2
LPBT
XMBP
HAND
Total
✓
✓
✓
23
28
24
75
✓
✗
✓
18
24
18
60
✓
✗
✗
10
8
13
31
✗
✗
✓
5
0
19
24
✗
✗
✗
6
0
14
20
Table 4: Ablation studies. We study the effects of the latent body schema, body-queried vision, and the DINOv2 encoder on 3 tasks in SIMPLE; successes out of 30 per task, one seed each. ✗ replaces them, in column order, with DP’s U-Net, one pooled vector, and a ResNet-18 trained from scratch.
Figure 6: What three parts read over one LPBT episode (a) and one XMBP episode (b). Sensitivity of BSP ’s right-thumb, waist-yaw and base-velocity commands to the patch tokens the denoiser reads, at 15 frames of each episode; each heat map is scaled to its own maximum.