SafeMind: A Risk-Aware Differentiable Control Framework for Adaptive and Safe Quadruped Locomotion
Organizations: The University of Hong Kong, Pokfulam, Hong Kong, China · Alibaba, Beijing, China · University of Chinese Academy of Sciences, No.1 Yanqihu East Rd, Huairou District, Beijing, China
Abstract
Learning-based quadruped controllers achieve impressive agility but typically lack formal safety guarantees under model uncertainty, perception noise, and unstructured contact conditions. We introduce SafeMind, a differentiable stochastic safety-control framework that unifies probabilistic Control Barrier Functions with semantic context understanding and meta-adaptive risk calibration. SafeMind explicitly models epistemic and aleatoric uncertainty through a variance-aware barrier constraint embedded in a differentiable quadratic program, thereby preserving gradient flow for end-to-end training. A semantics-to-constraint encoder modulates safety margins using perceptual or language cues, while a meta-adaptive learner continuously adjusts risk sensitivity across environments. We provide theoretical conditions for probabilistic forward invariance, feasibility, and stability under stochastic dynamics. SafeMind is deployed on Unitree A1 and ANYmal C at 200~Hz and validated across 12 terrain types, dynamic obstacles, morphology perturbations, and semantically defined tasks. Experiments show that SafeMind reduces safety violations by 3--10x and energy consumption by 10--15% relative to state-of-the-art CBF, MPC, and hybrid RL baselines, while maintaining real-time control performance.
Figures & tables
| Method | SVR (%) | RMSE (cm) | Robustness Index | ||
|---|---|---|---|---|---|
| Nominal MPC | 7.84 0.90 | 3.4 0.3 | 1.00 0.04 | 2.41 0.13 | 0.52 0.03 |
| RL–CBF | 5.21 0.70 | 3.8 0.4 | 1.09 0.05 | 2.03 0.11 | 0.56 0.03 |
| Safety–MPC | 2.91 0.40 | 3.1 0.3 | 1.18 0.05 | 1.54 0.09 | 0.63 0.03 |
| Robust–MPC | 2.44 0.30 | 3.0 0.3 | 1.21 0.05 | 1.47 0.08 | 0.67 0.03 |
| BarrierNet | 1.96 0.30 | 3.4 0.3 | 1.13 0.04 | 1.33 0.08 | 0.71 0.02 |
| SafeMind (ours) | 0.58 0.10 | 2.8 0.2 | 0.97 0.03 | 0.88 0.06 | 0.89 0.02 |
| Transition | Method | (%) | (s) |
|---|---|---|---|
| T1 T5 | Safety–MPC | 3.8 | 1.72 0.12 |
| BarrierNet | 4.6 | 1.41 0.10 | |
| SafeMind | 0.9 | 0.63 0.05 | |
| T2 T4 | Safety–MPC | 2.1 | 1.34 0.10 |
| BarrierNet | 2.7 | 1.12 0.09 | |
| SafeMind | 0.6 | 0.48 0.04 |
| Method | 0% | 15% | 25% | 35% |
|---|---|---|---|---|
| Nominal MPC | 3.2 | 7.4 | 10.1 | 15.6 |
| BarrierNet | 1.1 | 3.8 | 6.3 | 9.7 |
| Robust–MPC | 0.9 | 2.8 | 4.2 | 6.9 |
| Safety–MPC | 1.2 | 3.1 | 5.0 | 7.3 |
| SafeMind | 0.3 | 0.9 | 1.7 | 3.1 |
| Method | SVR (%) | RMSE [cm] | Impulse | [s] |
|---|---|---|---|---|
| Nominal MPC | 14.2 | 4.4 0.3 | 1.82 0.07 | 3.21 0.18 |
| BarrierNet | 6.1 | 4.8 0.4 | 1.63 0.06 | 2.34 0.14 |
| Safety–MPC | 4.3 | 4.2 0.3 | 1.51 0.05 | 1.89 0.11 |
| Robust–MPC | 3.8 | 4.6 0.3 | 1.49 0.05 | 1.73 0.10 |
| SafeMind (ours) | 1.12 | 3.6 0.2 | 1.28 0.04 | 1.02 0.07 |
| Method | SVR (%) | RMSE [cm] | Energy | Jerk |
|---|---|---|---|---|
| Nominal MPC | 16.7 | 5.2 0.4 | 1.00 0.04 | 1.00 0.04 |
| RL–CBF | 11.4 | 5.6 0.4 | 1.12 0.05 | 1.19 0.05 |
| BarrierNet | 7.9 | 5.8 0.4 | 1.10 0.05 | 1.14 0.05 |
| Robust–MPC | 6.3 | 5.4 0.4 | 1.18 0.05 | 1.21 0.05 |
| SafeMind (ours) | 1.94 | 4.3 0.3 | 0.93 0.03 | 0.87 0.03 |
| Method | SVR (%) | Success (%) | RMSE [cm] | [s] |
|---|---|---|---|---|
| Nominal MPC | 22.5 | 61.3 | 5.1 0.4 | 4.10 0.22 |
| BarrierNet | 9.7 | 82.0 | 4.8 0.3 | 2.66 0.15 |
| Safety–MPC | 7.4 | 88.1 | 4.6 0.3 | 2.21 0.13 |
| Robust–MPC | 5.6 | 90.8 | 4.9 0.3 | 2.08 0.12 |
| SafeMind (ours) | 1.85 | 97.2 | 3.7 0.2 | 1.12 0.07 |
| Method | SVR (%) | Lateral RMSE [cm] | Energy | Jerk |
|---|---|---|---|---|
| Nominal MPC | 19.8 | 4.2 0.3 | 1.00 0.04 | 1.00 0.04 |
| BarrierNet | 8.9 | 3.8 0.3 | 1.13 0.05 | 1.21 0.05 |
| Safety–MPC | 6.3 | 3.5 0.2 | 1.17 0.05 | 1.27 0.05 |
| Robust–MPC | 4.1 | 3.6 0.3 | 1.22 0.05 | 1.25 0.05 |
| SafeMind (ours) | 1.02 | 2.4 0.2 | 0.91 0.03 | 0.83 0.03 |
| Method | SVR (%) | RMSE [cm] | [s] | |
|---|---|---|---|---|
| Nominal MPC | 14.8 | 4.1 0.3 | 1.00 0.04 | 3.88 0.21 |
| BarrierNet | 5.3 | 4.4 0.3 | 1.11 0.05 | 2.41 0.14 |
| Safety–MPC | 3.7 | 4.0 0.3 | 1.18 0.05 | 1.97 0.12 |
| Robust–MPC | 2.9 | 4.2 0.3 | 1.21 0.05 | 1.62 0.10 |
| SafeMind | 0.77 | 3.3 0.2 | 0.95 0.03 | 0.89 0.06 |
| Method | SVR (%) | RMSE [cm] | Success (%) | |
|---|---|---|---|---|
| Nominal MPC | 16.2 | 6.4 | 1.00 | 58.1 |
| BarrierNet | 8.3 | 6.1 | 1.11 | 72.4 |
| Safety–MPC | 5.6 | 5.4 | 1.14 | 78.6 |
| Distributional RL | 4.1 | 6.8 | 1.21 | 74.2 |
| Ensemble–CBF | 3.7 | 5.9 | 1.17 | 81.0 |
| SafeMind | 1.12 | 4.3 | 0.98 | 92.7 |
| Method | SVR (%) | RMSE (cm) | Energy |
|---|---|---|---|
| Nominal MPC | 11.2 | 4.1 | 1.00 |
| BarrierNet | 5.3 | 4.0 | 1.08 |
| Safety–MPC | 3.9 | 3.7 | 1.12 |
| Robust–MPC | 3.0 | 4.2 | 1.15 |
| SafeMind | 0.88 | 3.1 | 0.96 |
| Method | SVR (%) | Pitch Var (deg 2 ) | Energy |
|---|---|---|---|
| BarrierNet | 4.8 | 2.31 | 1.13 |
| Safety–MPC | 3.7 | 2.08 | 1.15 |
| Robust–MPC | 2.5 | 1.84 | 1.19 |
| SafeMind | 0.64 | 1.12 | 1.04 |
| Method | Clear. Viol. (%) | RMSE (cm) | Energy |
|---|---|---|---|
| Safety–MPC | 3.4 | 3.2 | 1.16 |
| BarrierNet | 2.8 | 3.4 | 1.12 |
| Ensemble–CBF | 2.1 | 3.1 | 1.15 |
| SafeMind | 0.47 | 2.6 | 1.07 |
| Method | Wall Contact (%) | Yaw Var (deg 2 ) | Energy |
|---|---|---|---|
| Nominal MPC | 14.7 | 5.1 | 1.00 |
| RL–CBF | 8.3 | 4.4 | 1.04 |
| BarrierNet | 3.2 | 3.9 | 1.09 |
| SafeMind | 0.36 | 2.8 | 1.03 |
| Method | Events | Tracking RMSE | Energy |
|---|---|---|---|
| Nominal MPC | 17 | 3.8 | 1.00 |
| RL–CBF | 9 | 4.2 | 1.11 |
| BarrierNet | 6 | 3.4 | 1.09 |
| SafeMind | 0 | 3.1 | 1.05 |
| Method | SVR (%) | Pitch Var | Energy |
|---|---|---|---|
| BarrierNet | 4.1 | 2.7 | 1.12 |
| Safety–MPC | 2.3 | 2.2 | 1.14 |
| SafeMind | 0.77 | 1.6 | 1.06 |
| Method | Trip Incidents | Clear. Viol. | Energy |
|---|---|---|---|
| Safety–MPC | 4 | 2.5% | 1.16 |
| BarrierNet | 3 | 2.1% | 1.14 |
| SafeMind | 0 | 0.6% | 1.10 |
| Method | Hazard Entered | RMSE | Energy |
|---|---|---|---|
| RL–CBF | 13 | 4.3 | 1.11 |
| BarrierNet | 4 | 3.8 | 1.13 |
| Safety–MPC | 2 | 3.5 | 1.12 |
| SafeMind | 0 | 3.2 | 1.07 |
| Method family | Key properties / limitations |
|---|---|
| BarrierNet | Differentiable CBF–QP layer with fixed barrier parameters; cannot adapt risk to time-varying stochasticity |
| Safety– / Robust– / Stochastic MPC | Strong guarantees in deterministic or worst-case settings; high online cost and limited suitability for 200–250 Hz on-board control; not end-to-end differentiable |
| Ensemble–CBF | Uses model ensembles to capture epistemic uncertainty; still enforces deterministic CBF constraints without probabilistic invariance |
| RL–CBF | RL policy filtered by CBF QP; improves safety during learning but breaks differentiability and lacks explicit stochastic barrier modeling |
| Distributional RL | Learns risk-sensitive value distributions; no mechanism for state-wise safety invariance or hard constraints |
| Nominal MPC | High tracking performance but no safety guarantees; used as performance upper bound and safety lower bound |
| Protocol element | Description |
|---|---|
| Randomization | Terrains, friction, mass/inertia, sensor noise, external pushes, semantic layouts |
| Control frequencies | 250, 200, 100, 50 Hz |
| Episode horizons | 12–15 s (short), up to 600 s (long-horizon) |
| Metrics | SVR, tracking RMSE, , jerk, impact impulse, , semantic compliance |
| Baselines | Differentiable CBF layer, MPC variants, ensemble- and RL-based controllers |
| Statistical reporting | Mean std., Wilson 95% CIs, paired bootstrap significance tests |
| Configuration | SVR (%) | RMSE (cm) | Energy |
|---|---|---|---|
| Full SafeMind | 0.58 | 2.9 0.2 | 0.96 0.03 |
| w/o Stochastic Term | 3.74 | 3.3 0.2 | 1.04 0.04 |
| w/o Risk Tightening | 5.92 | 3.2 0.2 | 1.03 0.04 |
| w/o Meta-Adaptation | 1.48 | 3.1 0.2 | 1.07 0.04 |
| w/o Semantic Encoder | 2.61 | 3.5 0.3 | 1.01 0.03 |
| Fixed | 1.83 | 3.1 0.2 | 1.02 0.03 |
| Parameter Scaling | SVR (%) | RMSE (cm) | Energy |
|---|---|---|---|
| Mass | 0.72 | 3.1 0.2 | 0.99 0.03 |
| Mass | 0.69 | 3.0 0.2 | 0.98 0.03 |
| Friction | 1.31 | 3.4 0.2 | 1.02 0.03 |
| Latency ms | 1.12 | 3.7 0.3 | 1.05 0.04 |
| Control Frequency 100 Hz | 1.84 | 3.3 0.2 | 1.11 0.04 |
| Control Frequency 50 Hz | 3.02 | 3.8 0.3 | 1.20 0.05 |
| Terrain Transition | Mean | Std | Peak |
|---|---|---|---|
| Flat Slippery | 2.48 0.14 | 0.91 | 4.83 0.27 |
| Soft Rubble | 3.07 0.18 | 1.12 | 5.14 0.31 |
| Rubble Gap | 2.81 0.16 | 0.97 | 4.55 0.28 |
| Gap Flat | 1.21 0.09 | 0.41 | 2.19 0.15 |
| Constraint | T2 | T4 | T5 | T8 |
|---|---|---|---|---|
| Foot Clearance | 22.3 | 18.1 | 13.8 | 31.4 |
| Body Tilt | 11.8 | 33.2 | 24.9 | 29.5 |
| Joint Limits | 4.3 | 5.9 | 4.8 | 6.4 |
| Semantic Boundaries | 0.0 | 2.7 | 4.6 | 7.1 |
| Stress Scenario | SVR (%) | Failure Rate | Recovery Time (s) |
|---|---|---|---|
| 50 N Push | 1.14 | 0.0 (0/200) | 1.25 0.09 |
| Friction Collapse | 2.38 | 0.0 (0/200) | 1.91 0.13 |
| 300 ms Perception Drop | 1.07 | 0.0 (0/200) | 1.48 0.10 |
| 10 cm Drop-off | 1.44 | 0.0 (0/200) | 1.72 0.12 |
| Controller | 150 s | 300 s | 450 s | 600 s |
|---|---|---|---|---|
| Nominal MPC | 4.2% | 7.3% | 9.7% | 12.4% |
| Safety–MPC | 1.9% | 3.1% | 4.8% | 5.6% |
| BarrierNet | 1.6% | 2.8% | 3.7% | 4.2% |
| SafeMind | 0.41% | 0.58% | 0.65% | 0.71% |
| SVR (%) | Energy | RMSE (cm) | |
|---|---|---|---|
| 0.5 | 1.82 | 0.91 0.03 | 2.4 0.2 |
| 1.5 | 0.93 | 0.95 0.03 | 2.7 0.2 |
| 3.0 | 0.58 | 0.96 0.03 | 2.9 0.2 |
| 5.0 | 0.41 | 1.04 0.04 | 3.3 0.2 |