Driving the Style: Velocity-Conditioned Whole-Body Control from Motion Demonstrations
Organizations: Agile Robots SE, Munich, Germany. · LS Wiiri Innovation Center, Wuxi, China.
Abstract
Achieving human-like behavior on humanoid robots has advanced rapidly by leveraging motion-capture demonstrations rather than hand-crafted cost functions. Adversarial imitation supplies a style signal that lets a policy fulfill a task while adhering to a desired style, but is difficult to transfer to hardware. Whole-body tracking through reinforcement learning instead deploys reliably and imitates demonstrations faithfully, but the resulting policies are conditioned on the future reference, so they require a reference trajectory at runtime and can fail when the motion differs from the training data. We train a humanoid policy directly with whole-body tracking rewards while restricting its actor to compact locomotion commands and robot observations. Reference motion supervises the reward and privileged critic, without supplying reference joint trajectories to the actor or requiring teacher distillation. The demonstrated style is thereby encoded in the policy through the tracking reward, so the robot reproduces the whole-body style under commanded velocities. Trained on a single random-walk motion and commanded with velocity profiles from held-out motions, our policy reaches at least 98% success in simulation and completes every trial on the Unitree G1. On held-out slow walking, whole-body tracking drops to 2% success and command-conditioned distillation to 56%, and both fail on the real robot. On the trained motions, the joint position error of our policy stays within 8% of whole-body tracking, and it has a higher style coverage than adversarial motion priors (AMP), which fell on the real robot without a safety crane.
Figures & tables
| Term | Error | Weight | |
|---|---|---|---|
| Tracking (exponential) | |||
| Anchor position | global anchor pos. error | ||
| Anchor orientation | global anchor ori. error | ||
| Body position | per-body rel. pos. error | ||
| Body orientation | per-body rel. ori. error | ||
| Body linear velocity | global body lin. vel. error | ||
| Method | Ref. joints | Command | History | Supervision | Real robot |
|---|---|---|---|---|---|
| Teacher [ 18 ] | next step | no | no | tracking reward | free |
| Distill | no | yes | 10 steps | Teacher actions | free |
| AMP [ 12 ] | no | yes | no | AMP reward | crane |
| Ours | no | yes | no | tracking reward | free |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Random walk | AMP | 100% | 6.64 | 0.63 | 0.14 | 0.39 |
| Teacher | 100% | 2.77 | 0.32 | 0.11 | 0.46 | |
| Distill | 100% | 2.95 | 0.34 | 0.11 | 0.46 | |
| Ours | 100% | 3.07 | 0.34 | 0.10 | 0.47 | |
| Backward | AMP | 100% | 5.06 | 0.46 | 0.13 | 0.29 |
| Teacher | 100% | 2.64 | 0.23 | 0.10 | 0.38 |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Backward | AMP | 100% | 5.48 | 0.45 | 0.12 | 0.29 |
| Teacher | 98% | 3.27 | 0.35 | 0.14 | 0.36 | |
| Distill | 99% | 4.21 | 0.43 | 0.18 | 0.32 | |
| Ours | 100% | 4.05 | 0.41 | 0.14 | 0.34 | |
| Side | AMP | 100% | 4.88 | 0.30 | 0.18 | 0.33 |
| Teacher | 100% | 3.01 | 0.24 | 0.17 | 0.41 |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Jog | AMP 1 1 1 AMP ran on a safety crane. Without support, it fell in both of two attempts, so we used the crane to measure its tracking and style without damaging the robot. The crane only stops a fall and does not hold the robot while walking. | 3/3 | 7.53 0.12 | 1.23 0.03 | 0.26 0.01 | 0.20 0.01 |
| Teacher | 3/3 | 3.78 0.03 | 0.63 0.00 | 0.16 0.00 | 0.30 0.00 | |
| Distill | 3/3 | 4.53 0.13 | 0.68 0.01 | 0.17 0.00 | 0.29 0.01 | |
| Ours | 3/3 | 4.00 0.01 | 0.66 0.00 | 0.16 0.00 | 0.27 0.00 | |
| Slow | AMP 1 1 footnotemark: 1 | 3/3 | 5.59 0.22 | 0.21 0.01 | 0.21 0.02 | 0.31 0.02 |
| Teacher | 3/3 | 2.77 0.01 | 0.13 0.00 | 0.10 0.00 | 0.39 0.00 |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Backward | AMP 1 1 footnotemark: 1 | 3/3 | 5.46 0.02 | 0.42 0.00 | 0.13 0.00 | 0.29 0.00 |
| Teacher | 3/3 | 3.51 0.03 | 0.35 0.01 | 0.12 0.00 | 0.42 0.00 | |
| Distill | 3/3 | 4.10 0.02 | 0.41 0.01 | 0.13 0.00 | 0.41 0.01 | |
| Ours | 3/3 | 4.09 0.02 | 0.40 0.01 | 0.12 0.00 | 0.40 0.01 | |
| Side | AMP 1 1 footnotemark: 1 | 3/3 | 4.82 0.03 | 0.27 0.01 | 0.20 0.01 | 0.34 0.01 |
| Teacher | 3/3 | 2.88 0.02 | 0.22 0.00 | 0.15 0.00 | 0.46 0.00 |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Plain | B0 | 100% | 3.07 | 0.34 | 0.10 | 0.47 |
| B1 | 100% | 3.09 | 0.35 | 0.10 | 0.47 | |
| B2 | 100% | 3.06 | 0.34 | 0.10 | 0.47 | |
| B3 | 100% | 3.17 | 0.35 | 0.10 | 0.47 | |
| Mirrored | B0 | 54% | 6.14 | 0.80 | 0.20 | 0.40 |
| B1 | 100% | 3.14 | 0.35 | 0.10 | 0.47 |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Plain | B0 | 3/3 | 3.68 0.04 | 0.41 0.00 | 0.13 0.00 | 0.42 0.00 |
| B1 | 3/3 | 3.54 0.03 | 0.41 0.01 | 0.11 0.00 | 0.49 0.01 | |
| B2 | 3/3 | 3.44 0.01 | 0.39 0.00 | 0.11 0.00 | 0.47 0.00 | |
| B3 | 3/3 | 3.56 0.01 | 0.39 0.00 | 0.11 0.00 | 0.45 0.01 | |
| Mirrored | B0 | 0/3 | – | – | – | – |
| B1 | 3/3 | 3.56 0.01 | 0.41 0.00 | 0.11 0.00 | 0.48 0.01 |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Random walk | P P | 100% | 3.07 | 0.34 | 0.10 | 0.47 |
| S S | 100% | 3.46 | 0.37 | 0.12 | 0.44 | |
| Backward | P P | 100% | 4.05 | 0.41 | 0.14 | 0.34 |
| S S | 99% | 4.71 | 0.49 | 0.16 | 0.32 | |
| Side | P P | 100% | 3.34 | 0.27 | 0.17 | 0.39 |
| S S | 100% | 3.99 | 0.33 | 0.19 | 0.38 |
| Motion | Method | Succ. | MJPE | MJVE | MMD | COV |
|---|---|---|---|---|---|---|
| Random walk | P P | 3/3 | 3.68 0.04 | 0.41 0.00 | 0.13 0.00 | 0.42 0.00 |
| S S | 3/3 | 3.90 0.01 | 0.46 0.00 | 0.13 0.00 | 0.45 0.01 | |
| Backward | P P | 3/3 | 4.09 0.02 | 0.40 0.01 | 0.12 0.00 | 0.40 0.01 |
| S S | 3/3 | 4.74 0.04 | 0.45 0.01 | 0.14 0.01 | 0.36 0.00 | |
| Side | P P | 3/3 | 3.29 0.02 | 0.23 0.00 | 0.15 0.00 | 0.43 0.01 |
| S S | 3/3 | 3.88 0.02 | 0.30 0.01 | 0.16 0.00 | 0.41 0.01 |