From Temperature-Limited to Battery-Limited Legged Locomotion
Organizations: Woven by Toyota, Inc., Tokyo, Japan.
Abstract
On legged robots, sustained locomotion often ends in thermal shutdown rather than battery depletion: the heat of walking concentrates in a few joint motors, which overheat long before the battery is empty. We train thermally aware locomotion policies by reinforcement learning without ever observing temperature, and demonstrate this on a Unitree Go2 quadruped. We first identify a coupled 13-node lumped RC thermal network, fitted on two runs of a single robot and calibrated against the measured electrical power, that predicts all twelve motor temperatures with a mean RMSE below 1 C across different robot instances, gaits, payloads, and speeds. Under a sustained gait, the temperatures the motors will settle at follow directly from the gait-averaged squared torques and joint speeds. Our core contribution is a reward that drives down the hottest predicted asymptotes: thermal time constants exceed the credit-assignment horizon of reinforcement learning by orders of magnitude, but predicted asymptotes respond to torque and joint speed within a single gait cycle, so the policy learns to lower and spread heat with no temperature input. On the robot, the policy turns sustained locomotion from temperature-limited to battery-limited: with a 5 kg payload at 1 m/s, a learned baseline reaches thermal shutdown after 19 minutes (1.1 km), whereas our policy runs the battery down after 174 minutes (10.0 km) with its hottest motor 14 C below the shutdown threshold in a 26 C room; on an unloaded factory circuit with stairs and ramps, the baseline overheats after 25 laps (6.2 km), while our policy completes 47 (11.2 km) on one battery with 22 C of margin.
Figures & tables
| Model | Train | Val | Test | ||||
| all | hot | all | hot | all | hot | ||
| 22-parameter model (ours) | 22 | 0.78 | 0.74 | 0.88 | 0.85 | 0.97 | 0.85 |
| 1: no electrical identification | 22 | 0.77 | 0.71 | 0.90 | 0.88 | 1.04 | 0.98 |
| 2: no joint-velocity heating | 21 | 0.79 | 0.76 | 1.00 | 1.07 | 1.25 | 1.56 |
| 3: no bypass share to body | 21 | 0.95 | 1.15 | 1.35 | 1.66 | 1.83 | 2.57 |
| 4: no quiescent power terms | 20 | 1.14 | 1.09 | 1.68 | 2.02 | 1.87 | 1.82 |
| Parameter | Symbol | Value | Unit |
| Electrically identified | |||
| Total quiescent power | 43.9 | W | |
| Joule heating coefficient | 0.494 | W/(N m) 2 | |
| Resistance temp. coefficient | K -1 | ||
| Thermally identified: heat sources | |||
| Calf bypass share to body | 0.29 | – | |
Robot Locomotion
Robot locomotion studies how robots move efficiently and reliably across varied terrains, environments, and movement modes.
See all 246 papers