MimicAll: Structured Embodiment Conditioning for Cross-Humanoid Whole-Body Motion Tracking
Organizations: Huazhong University of Science and Technology · Peking University · Tsinghua University · Roboparty Lab
Abstract
Humanoid motion trackers reproduce diverse behaviors, but sharing a policy across bodies requires accounting for differences in structure, morphology and dynamics. We present MimicAll, a reinforcement-learning framework for shared whole-body motion tracking across heterogeneous humanoids. A structured embodiment descriptor is encoded into global and joint-aligned conditions, which are combined with observation history and body-matched motion references to predict joint-target offsets. Physics-consistent embodiment randomization, body-calibrated retargeting and heterogeneous simulation support training across 4,096 variants from 16 humanoid families. We introduce a benchmark of 464 bodies across five distribution strata to evaluate motion generalization, within-family embodiment shifts and unseen-family transfer. Controlled ablations show that embodiment information improves motion completion with simple concatenation, while self-attention yields the lowest global position errors. With equal training transitions, shared training achieves 99.4% 30-second success on randomized G1 bodies in 100STYLE, versus 42.9% for a single-body specialist. With Flat-MLP encoding and concatenation, continued training on a motion subset excluding obstacle categories achieves 98.3% and 93.5% 30-second success on 100STYLE for sampled training bodies and out-of-distribution variants within seen families, respectively. On an eight-motion LAFAN1 subset excluding ground and get-up sequences across 464 bodies, mismatched body conditions reduce self-attention's 30-second success from 61.7% to 47.0%, demonstrating a closed-loop benefit from embodiment information.
Figures & tables
| Stratum | Body status | |
| SS | Seen family, sampled training body | 128 |
| SI | Seen family, new within-support body | 128 |
| SO | Seen family, outside-support body | 128 |
| UI | Unseen family, within-parent support | 40 |
| UO | Unseen family, outside-parent support | 40 |
| Physics / policy: 200 / 50 Hz | ||
| LAFAN1-11: SR | 100STYLE-8: SR | Cost | |||||||||
| Configuration | SS | SI | SO | UI | UO | SS | SI | SO | UI | UO | GPU-h |
| Mimic All : descriptor and encoder ablations | |||||||||||
| Mask-only | 64.8 | 55.3 | 55.0 | 0.7 | 4.8 | 93.8 | 90.0 | 86.6 | 13.2 | 10.4 | 82.2 |
| Identity | 65.3 | 56.0 | 54.9 | 5.9 | 8.2 | 95.1 | 88.7 | 87.7 | 21.4 | 28.2 | 80.8 |
| Dynamics | 67.5 | 54.6 | 55.5 | 4.1 | 5.5 | 95.9 | 91.0 | 89.0 | 6.8 | 11.4 | 109.7 |
| Structure + morphology | 64.8 | 55.0 | 53.6 | 1.1 | 1.6 | 96.5 | 90.7 | 89.7 | 8.6 | 6.1 | 111.3 |
| LAFAN1-11 | 100STYLE-8 | |||||||
| Configuration | Eff. s | G-MPJPE | L-MPJPE | RPE | Eff. s | G-MPJPE | L-MPJPE | RPE |
| mm | mm | |||||||
| Mimic All : descriptor and encoder ablations | ||||||||
| Mask-only | 21.5 | 958.2 | 71.4 | 955.9 | 27.7 | 1069.7 | 56.3 | 1064.5 |
| Identity | 21.4 | 967.3 | 71.0 | 965.4 | 28.0 | 1103.2 | 56.5 | 1098.6 |
| Dynamics | 21.6 | 815.9 | 69.5 | 812.8 | 28.3 | 767.4 | 53.1 | 761.6 |
Appendix figures & tables20 assets
Supplementary material from the paper’s appendix.
Appendix
| Setting | Value |
|---|---|
| Training environments | |
| Policy updates / rollout steps | 10,500 / 32 |
| PPO epochs / minibatches | 3 / 8 |
| PPO clipping / gradient-norm cap | 0.2 / 1.0 |
| Discount / GAE coefficient | 0.99 / 0.95 |
| Initial actor learning rate |
| Encoder | Hidden widths | Parameters |
|---|---|---|
| Graph | Attention width 128 | 466,048 |
| Flat-MLP (256) | 256/256 | 2,638,464 |
| Flat-MLP (42) | 42/42 | 469,360 |
| Horizon | Correct | Zero | Wrong |
|---|---|---|---|
| 10 s | 74.4% 8289/11136 | 50.5% 5626/11136 | 62.3% 6941/11136 |
| 20 s | 63.6% 7079/11136 | 37.1% 4137/11136 | 50.6% 5636/11136 |
| 30 s | 61.7% 6867/11136 | 33.7% 3755/11136 | 47.0% 5238/11136 |
| LAFAN1-11 | 100STYLE-8 | |||||
| Method | 10 s | 20 s | 30 s | 10 s | 20 s | 30 s |
| G1 (4096) | (9,9) | (7,8) | (7,8) | (8,8) | (8,8) | (7,7) |
| G1 ( ) | (9,9) | (9,9) | (8,8) | (8,8) | (8,8) | (7,7) |
| ProtoMotions | (6,6) | (4,5) | (4,5) | (7,7) | (7,7) | (6,6) |
| Shared Mimic All policy (ours) | ||||||
| Mimic All (Concat) | (7,7) | (5,5) | (5,5) | (8,8) | (8,8) | (7,7) |
| LAFAN1-11 | 100STYLE | ||||||
|---|---|---|---|---|---|---|---|
| Training | Total updates | SS | SI | SO | SS | SI | SO |
| Original policy | 10,500 | 67.6 | 56.2 | 56.2 | 98.1 | 94.2 | 92.3 |
| Ordinary continuation | 12,500 | 71.7 | 64.3 | 62.3 | 98.3 | 96.9 | 93.5 |
| Phase curriculum | 12,500 | 71.7 | 64.4 | 62.7 | 98.9 | 97.5 | 93.6 |
| SS | SI | SO | |||||
|---|---|---|---|---|---|---|---|
| Motion set | Training policy | SR (%) | Eff. s | SR (%) | Eff. s | SR (%) | Eff. s |
| LAFAN1-11 | Single-body G1 | 14.8 | 10.67 | 13.6 | 11.22 | 33.0 | 14.68 |
| Shared 16-family (Concat) | 72.7 | 24.21 | 63.6 | 22.68 | 68.2 | 23.57 | |
| LAFAN1-8 | Single-body G1 | 20.3 | 12.68 | 18.8 | 13.60 | 45.3 | 17.94 |
| Shared 16-family (Concat) | 100.0 | 30.00 | 87.5 | 28.08 | 93.8 | 29.00 | |
| 100STYLE | Single-body G1 | 28.6 | 15.60 | 35.7 | 16.28 | 64.3 | 22.25 |
| Motion set | Training | SR (%) | Eff. s | G-MPJPE | L-MPJPE | RPE |
|---|---|---|---|---|---|---|
| LAFAN1-8 | G1 specialist (4096) | 87.5 (7/8) | 28.43 | 975.8 | 67.2 | 975.2 |
| G1 specialist ( ) | 100.0 (8/8) | 30.00 | 688.5 | 40.7 | 685.3 | |
| Shared N16 Concat | 62.5 (5/8) | 23.00 | 1201.4 | 69.1 | 1198.5 | |
| Shared 5000 + G1 5500 | 87.5 (7/8) | 28.59 | 545.4 | 46.3 | 544.8 | |
| 100STYLE | G1 specialist (4096) | 100.0 (7/7) | 30.00 | 1393.7 | 58.0 | 1392.7 |
| G1 specialist ( ) | 100.0 (7/7) | 30.00 | 775.0 | 36.3 | 769.9 |
| Test bodies | Training policy | SR (%) | Eff. s | G-MPJPE | L-MPJPE | RPE |
|---|---|---|---|---|---|---|
| Nominal G1 | Single-body G1 (4096) | 100.0 | 30.00 | 1393.7 | 58.0 | 1392.7 |
| Single-body G1 ( ) | 100.0 | 30.00 | 775.0 | 36.3 | 769.9 | |
| Shared 16-family (Concat) | 100.0 | 30.00 | 1200.3 | 57.5 | 1192.7 | |
| Randomized G1: SS | Single-body G1 ( ) | 28.6 | 15.60 | 1060.9 | 72.6 | 1053.6 |
| Shared 16-family (Concat) | 100.0 | 30.00 | 1043.7 | 47.1 | 1037.5 | |
| Randomized G1: SI | Single-body G1 ( ) | 35.7 | 16.28 | 1460.2 | 78.2 | 1457.9 |
Humanoid Motion Tracking
Humanoid motion tracking trains robots to reproduce human-like whole-body movements while remaining physically stable and feasible.
See all 73 papers