Playing Soccer Like Humans Do: Learning Versatile and Agile Humanoid Soccer via Latent Motion Priors
Organizations: University of Science and Technology of China · State Key Laboratory of General Artificial Intelligence, BIGAI · Shanghai Jiao Tong University · Peking University
Abstract
Humanoid soccer requires a robot to seamlessly combine agile locomotion, ball manipulation, and impact-rich contact dynamics across a continuous, dynamic behavioral spectrum. Yet existing approaches either cover only a limited set of skills, or forego motion priors entirely and produce unnatural behaviors, leaving the combination of a unified skill set and human-like motion quality unaddressed. We present soccerbot, a hierarchical reinforcement learning framework that resolves both limitations through a structured latent motion prior distilled from large-scale human soccer motion capture data. By constraining policy learning within this dynamically plausible motion manifold, a single skill-conditioned policy naturally learns to perform moving, dribbling, trapping, and kicking in a unified formulation, while inherently producing human-like motion and fluid transitions during commanded skill switching. Augmented by robustness-oriented simulation design, soccerbot transfers zero-shot to the Unitree G1 humanoid robot, demonstrating agile, natural, and robust execution of the full soccer skill repertoire under real-world conditions.
Figures & tables
| Method | Kicking | Dribbling | Trapping | Moving | Motion alignment | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SR | VE | DE | SR | VE | DE | ResT | SR | StopT | DistErr | SR | VE | DE | Train ref. | Post-train ref. | |
| PPO | 93.96 | 8.68 | 4.35 | 0.00 | 99.81 | 163.83 | 5.00 | 94.64 | 0.87 | 0.31 | 99.96 | 6.07 | 1.77 | 0.328 | 0.575 |
| AMP [ 13 ] | 87.48 | 10.32 | 7.26 | 46.36 | 37.05 | 47.88 | 4.09 | 23.08 | 5.49 | 3.07 | 99.96 | 9.43 | 4.21 | 0.170 | 0.308 |
| ASE [ 12 ] | 0.00 | 99.52 | 169.79 | 0.00 | 99.67 | 163.64 | 5.00 | 49.24 | 3.46 | 1.58 | 58.60 | 28.59 | 26.62 | 0.292 | 0.409 |
| LATENT [ 28 ] | 91.00 | 8.50 | 6.80 | 85.24 | 12.69 | 7.21 | 1.92 | 85.92 | 1.53 | 0.64 | 100.00 | 9.67 | 2.71 | 0.231 | 0.603 |
| Ours | 97.04 | 7.26 | 4.76 | 89.88 | 8.79 | 4.24 | 1.36 | 83.08 | 1.43 | 0.49 | 100.00 | 4.95 | 5.38 | 0.226 | 0.554 |
| Method | Kicking | Dribbling | Trapping | Moving | |||||
|---|---|---|---|---|---|---|---|---|---|
| VelErr (%) | DirErr ( ∘ ) | VelErr (%) | DirErr ( ∘ ) | ResT (s) | StopT (s) | DistErr (m) | VelErr (%) | DirErr ( ∘ ) | |
| Ours (sim) | 8.12 | 4.09 | 8.55 | 3.77 | 1.21 | 0.78 | 0.31 | 19.14 | 5.85 |
| Ours (real) | 47.38 | 10.41 | 30.17 | 16.49 | 2.37 | 1.84 | 1.07 | 21.53 | 13.74 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Group | Term | Dim. | Corruption |
|---|---|---|---|
| Policy/Critic | Command | 3 | None |
| Policy/Critic | Ball position | 3 | m |
| Policy/Critic | Ball velocity | 3 | m/s |
| Policy/Critic | Skill one-hot | 4 | None |
| Policy/Critic | Base angular velocity | 3 | rad/s |
| Critic only | Base linear velocity | 3 | None |
| Reward term | Expression | Weight |
| dribble_ball_vel | 8.0 | |
| dribble_ball_root_pos | 2.0 | |
| dribble_root_vel | 2.0 | |
| dribble_stand_still | -6.0 | |
| kick_soccer_vel | 10.0 | |
| kick_no_lateral_vel | 2.0 |
| Term | Unit | Range |
|---|---|---|
| Robot static friction | – | |
| Robot dynamic friction | – | |
| Robot restitution | – | |
| Soccer static friction | – | |
| Soccer dynamic friction | – | |
| Soccer restitution | – |
Robot Skill Learning
Robot skill learning studies how robots acquire, adapt, and combine reusable behaviors from demonstrations, interaction, and other data.
See all 339 papers