cs.ROOct 31, 2026

Learning Agile Humanoid Dodgeball with Onboard Monocular Vision

Authors: Feng Tian, Yulin An, Chenhao Li, Matthias Heyrman, Marco Hutter

Organizations: ETH Zurich, Switzerland. · RWTH Aachen University, Germany. · Robotic Systems Lab, ETH Zurich, Switzerland.

Abstract

Humanoid robots operating in shared, dynamic environments must respond to rapidly approaching objects while maintaining balance. We study dodgeball as a controlled test of this capability, coupling visual threat assessment with whole-body evasion, recovery, and target reacquisition. We develop a system that integrates onboard monocular perception, temporal ball-state and threat-flag estimation, and learned whole-body control. A ball detector supplies bounding-box histories, and a temporal estimator predicts relative ball position and a binary threat flag. Separate dodge/recovery and search/track policies share this interface and are composed to support repeated encounters. A three-stage curriculum first trains control with privileged ball states, then starts estimator supervision from stable policy rollouts, and finally replaces the actor's privileged inputs with estimator outputs. Analytic projection and perception randomization provide detector-like training observations without image rendering. Across approach-angle bins in controlled simulation, dodge success ranges from 97.8--100.0% for 5.0 m launches at 6 m/s to 33.2--40.8% for 2.5 m launches at 10 m/s, with 1000 throws per speed--distance condition. On a physical Unitree G1, controlled single-throw success exceeds 85% over more than 15 trials. A hardware sequence demonstrates full-azimuth target reacquisition followed by another dodge. These results demonstrate an integrated onboard-monocular-vision system under highly dynamic motions.

Figures & tables

Explore similar work

CardsList
  1. PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball

    Jul 30, 2026Lizhi Yang, Junheng Li, Aaron D. AmesRL for RoboticsControl Barrier Functions

  2. Humanoid Dodgeball: Learning Fast Dynamic Obstacle Avoidance Motions for Humanoids

    Oct 29, 2026Aoqian Zhang, Chunzheng Wang, Haoran Chen +4Dynamic Obstacle AvoidanceHumanoid Robot Control

  3. Vision-Based Dribbling for Humanoid Soccer via Privileged Representation Learning

    Jul 14, 2026Flavio Maiorana, Valerio Spagnoli, Eugenio Bugli +5RL for RoboticsReinforcement Learning