RoboStriker: Latent-Space Strategic Games for Autonomous Humanoid Boxing
Organizations: Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Shanghai Innovation Institute · Huazhong University of Science and Technology ·
Abstract
Achieving human-level competitive intelligence and physical agility in humanoid robots remains a profound challenge, particularly in contact-rich and highly dynamic tasks such as boxing. While Multi-Agent Reinforcement Learning offers a principled framework for strategic interaction, its direct application to unstructured raw motor spaces inevitably leads to joint-level physical collapse, preventing the emergence of any viable combat tactics. To resolve this fundamental conflict between strategic exploration and physical feasibility, we formulate the humanoid combat task as a novel two-player latent-space zero-sum Markov game. Under standard regularity and approximate best-response assumptions, we show that the latent formulation induces an equivalent game over the decoder-reachable action manifold, providing an approximate-Nash interpretation of the resulting self-play dynamics. To instantiate this theoretical formulation, we propose RoboStriker, a hierarchical framework that decouples high-level reasoning from low-level execution. It first distills the tracking expertise of predefined boxing motions into a topologically bounded latent manifold. This structured latent foundation subsequently drives multi-agent co-evolution via Latent-Space Neural Fictitious Self-Play. Extensive experimental results demonstrate that gaming within this structured latent space substantially outperforms direct exploration. By constraining strategic exploration through a pretrained motion decoder, RoboStriker substantially reduces the catastrophic balance failures observed in raw action-space methods and achieves superior tactical performance in both competitive win rates and striking efficiency. Finally, we successfully deploy and validate our learned combat policies on real-world humanoid robots. Our code and video and supplementary materials are available at RoboStriker.
Figures & tables
| Methods | Win Rate (%) vs. Opponent | ER | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| (1) | (2) | (3) | (4) | (5) | (6) | (7) | (8) | (9) | |||
| (1) RoboStriker | – | 68.52 | 76.24 | 82.41 | 84.47 | 95.38 | 98.50 | 100.0 | 92.50 | 0.685 0.03 | 0.824 0.02 |
| (2) Fictitious SP | – | – | 62.35 | 71.84 | 75.16 | 92.11 | 96.18 | 99.42 | 88.14 | 0.420 0.03 | 0.650 0.04 |
| (3) Naive SP | – | – | – | 68.45 | 70.38 | 88.61 | 94.52 | 98.53 | 85.25 | 0.350 0.04 | 0.580 0.05 |
| (4) RoboStriker w/o AMP | – | – | – | – | 62.12 | 82.14 | 88.37 | 95.18 | 78.40 | 0.490 0.03 | 0.720 0.05 |
| (5) PPO-Only | – | – | – | – | – | 45.24 | 77.86 | 82.11 | 68.55 | 0.231 0.03 | 0.495 0.02 |
| Latent Dim. | MPKPE (mm) | Win Rate vs. 32 | |
|---|---|---|---|
| 8 | |||
| 16 | |||
| 32 (Ours) | – | ||
| 64 |
Humanoid Robotics
Humanoid robotics develops human-shaped robots that move, manipulate objects, and interact with people in human environments.
See all 151 papers