CADENCE: Learning Acyclic Gaits for Model-Based Quadruped Locomotion
Organizations: Worcester Polytechnic Institute
Abstract
Model-based quadruped controllers usually step on a cyclic gait, which lifts the legs in a fixed order on a fixed period, wherever the safe footholds are. We present CADENCE, a learned step planner with a small action space. Every 40 ms, it picks one of at most 65 discrete choices: no step, or one leg's step to a safe foothold. It also predicts a swing time. We train CADENCE by reinforcement learning on top of a convex model predictive controller (MPC). Nothing prescribes a gait: there is no gait schedule, and the reward has no gait term, only a cost per step. The one structural constraint is that at most two legs may swing at once. The policy we analyzed developed an acyclic gait, with no fixed period or stepping order, yet it still paired diagonal legs. An inverse footstep model (IFM), fitted on a controller's logged steps, turns each foothold into a command. With only the IFM refitted, on fewer than 20,000 steps, CADENCE ran frozen on OCS2's nonlinear MPC. In simulated trials on a range of terrains (26% to 49% voids) and speeds (0.1 m/s and 0.2 m/s), it succeeded in 85.1% (mean of five seeds), against 67.8% for OCS2-Trot, 65.5% for OCS2-Single, and 39.6% in a static walk ablation of CADENCE. At 49% voids, it succeeded in 72.9%, against 43.0% for OCS2-Trot.
Figures & tables
| Method | All cells | Lowest–highest seed | 49% voids |
| CADENCE | 85.1 | 78.3–89.2 | 72.9 |
| OCS2-Trot | 67.8 | — | 43.0 |
| OCS2-Single | 65.5 | — | 40.0 |
| CADENCE-without-mixer-or-history | 71.3 | 68.7–73.3 | 61.5 |
| CADENCE-Diagonal | 82.9 | 75.7–86.3 | 69.6 |
| CADENCE-Single | 39.6 | 37.2–42.8 | 35.6 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| 0.10 m/s | 0.20 m/s | |||||
| Method | 26% | 38% | 49% | 26% | 38% | 49% |
| CADENCE | 93 | 90 | 76 | 92 | 90 | 70 |
| OCS2-Trot | 91 | 72 | 46 | 88 | 70 | 40 |
| OCS2-Single | 94 | 78 | 45 | 80 | 61 | 35 |
| CADENCE-without-mixer-or-history | 81 | 79 | 69 | 73 | 71 | 54 |
| CADENCE-Diagonal | 93 | 90 | 72 | 89 | 87 | 67 |
Quadruped Locomotion
Quadruped locomotion studies how four-legged robots move efficiently, safely, and reliably across varied terrain and tasks.
See all 126 papers