ReLoco: Unified Humanoid Locomotion and Fall Recovery via Behavior-Conditioned Motion Priors
Authors: Lequn Fu, Yufeng Hu, Yijun Zhong, Jie Zhang, Xiao Li, Lingxiang Ji, Zhiyuan Xu, Jian Tang, Shiqi Li
Organizations: Huazhong University of Science and Technology, Wuhan 430074, China · Beijing Innovation Center of Humanoid Robots, Beijing 100086, China
Humanoid robots must recover from falls and resume commanded motion to sustain locomotion. Learning these behaviors in one policy requires supervision that accommodates both upright movement and ground-contact recovery. We present ReLoco, a framework that uses behavior-conditioned adversarial motion priors to learn locomotion, get-up from arbitrary fallen postures, and command resumption within one proprioceptive policy. During training, robot posture selects the expert pool and conditions a shared discriminator with two behavior-specific outputs. Task rewards and shared regularization support command tracking and recovery, while temporary assistance facilitates exploration. A simulation-based refinement stage supplies robot-executed motion references for this supervision. Ablations examine conditional supervision, output separation, and reference quality under matched settings. At a common training iteration, the full policy achieves 96.80% independent get-up success and 96.96% push-recovery success, including command resumption. Its torso planar velocity root-mean-square error is 0.1266m/s, 14.7% lower than the conditional single-output variant, with similar joint-angle discrepancy measured by dynamic time warping. Deployment on the 64.5-kg Tiangong3.0 humanoid demonstrates walking, running, get-up, and locomotion resumption after falls using one proprioceptive actor, without controller switching or on-robot policy fine-tuning.
Figures & tables
Fig. 1: Overview of ReLoco. Retargeted human motions are refined in simulation to form locomotion and get-up reference sets. Posture conditions expert sampling and the output of a shared discriminator. Together with task rewards and common regularization, this supervision trains one actor for locomotion and recovery.
(a) Policy observations
Observation term
Actor
Critic
Linear velocity
–
✓
Angular velocity
✓
✓
Projected gravity
✓
✓
Velocity command
✓
✓
Joint positions
✓
✓
TABLE I: Policy observations and training configuration.
Reward Term
Equation
Weight
Upright Task Rewards
Planar Velocity
ρ(vxycmd−Yvxya;st)
1.2
Yaw Velocity
ρ(ωzcmd−ωza;st)
1.2
Hard Velocity Tracking
rtrack,hard
0.5
Torso Orientation
exp[−10(∣ϕa∣+∣θa∣)]
0.8
Prolonged Double Support
χls1[Tds>0.5s]
−100.0
TABLE II: Task-reward terms and shared penalties.
Reward Term
Equation
Weight
Tracking Rewards ( rtrack )
Global Torso Pos.
exp(−∥ptorso−p^torso∥2/σp2)
0.5
Global Torso Ori.
exp(−∥Rtorso⊖R^torso∥2/σR2)
0.5
Relative Body Pos.
exp(−∥pbody−p^body∥2/σb,pos2)
1.0
Relative Body Ori.
exp(−∥Rbody⊖R^body∥2/σb,ori2)
1.0
Body Linear Vel.
exp(−∥vbody−v^body∥2/σv2)
1.0
TABLE III: Reward terms for reference-motion refinement.
Fig. 2: Effect of reference-motion refinement on AMP training. (a) Mean task reward. (b) Get-up success rate. Raw uses the original retargeted motions; Refined uses simulation-refined references. Shading denotes within-run variation over 20,000 training iterations.
Metric
Raw
Refined
Ground penetration (%) ↓
28.99±27.60
0.75±2.09
Self-collision (%) ↓
12.91±14.77
0.35±1.27
Joint-limit violation (%) ↓
12.90±17.24
0.06±0.38
Body-position jerk (m/s 3 ) ↓
406.88±310.44
262.49±118.73
TABLE IV: Reference-motion quality (43 matched motions, mean ± standard deviation).
Fig. 3: Initial recovery assistance. (a) Assistance-force progression. (b) Recorded get-up success. Final rates follow assistance withdrawal; results are from individual training runs.
Method
Torso planar RMSE (m/s) ↓
Joint DTW (rad) ↓
Foot-sliding proxy (m/s) ↓
Get-up SR (%) ↑
Push-recovery SR (%) ↑
I90 (iterations) ↓
Task-only RL
0.0717±0.0006
0.2944±0.0005
0.0635±0.0025
0.00±0.00
8.24±0.92
>20,000
Unconditional AMP
0.8599±0.0554
0.1651±0.0002
0.0956±0.0025
94.64±0.92
92.32±1.25
4,063
Single-head conditional AMP
0.1485±0.0015
0.1303±0.0003
0.0878±0.0019
90.16±2.48
93.36±1.19
6,357
Ours
0.1266±0.0009
0.1307±0.0002
0.0856±0.0019
96.80±1.47
96.96±0.73
3,600
TABLE V: Ablation results at training iteration 20,000 . Metrics are mean ± sample standard deviation over five paired evaluation batches, with 250 trials per batch in each recovery test. Push-recovery SR requires upright recovery and command tracking under the RMSE criterion in Eq. ( 17 ). I90 is the logged training milestone.
Fig. 4: Real-world locomotion on (a) stone-tiled pavement, (b) brick pavement, (c) grass, (d) a downhill grassy slope, (e) an uphill grassy slope, and (f) a treadmill. Standing, walking, and running are generated by the same policy without explicit gait-mode switching; the treadmill belt-speed setting reaches 9.3 km/h.
Method
Success (%) ↑
Time (s) ↓
Mech. work (kJ) ↓
Peak ∣τ∣ (Nm) ↓
Mean ∣q¨∣ (rad/s 2 ) ↓
Reference-motion start pose
HoST [ 34 ]
99.3
1.64±0.45
11.2±2.4
399±4
139±21
Single-ref. tracker [ 43 ]
100
3.84±0.00
1.7±0.0
400±0
17±1
Ours
100
2.32±0.45
2.3±0.6
270±69
36±5
Randomized settled fallen states
HoST
99.9
1.57±0.75
10.7±5.2
400±2
131±21
TABLE VI: Recovery-only comparison under matched initial conditions and success criteria. Success rates use all 1000 episodes per condition; other entries are mean ± standard deviation over successful episodes.
Fig. 5: Autonomous recovery following external kicks from (a) rear, (b) front, and (c) side directions. Yellow dashed boxes highlight representative postural adjustments during the fall-to-recovery transition.
(a) All recorded disturbance attempts
Condition
All attempts
No fall
Fall and recovery
Hardware protection
Standing
47
5
34
8
Walking
10
9
1
0
Running
11
7
3
1
TABLE VII: Hardware disturbance outcomes and recovery timing. (a) All recorded attempts, including protection events; locomotion recoveries resumed the commanded task. No additional task failures were observed. (b) Timing over the first ten successful recoveries per posture (30 trials total), reported as mean ± standard deviation.
Fig. 6: Real-world balance recovery after manual disturbances without a complete ground-level fall. (a) and (b) Responses on approximately level grassy terrain. (c) Response to a push on an inclined grassy surface, showing postural adjustment and restoration of an upright stance. The slope sequence is a qualitative demonstration outside the 20 level-ground locomotion trials.
We propose a unified reinforcement learning framework that enables a single policy to perform walking, running, and fall recovery on the Unitree G1 humanoid robot, validated on physical hardware without any explicit mode-switching command at deployment. The framework extends Adversarial Motion Priors (AMP) by replacing the conventional global reference distribution with a state-dependent gate that routes each training transition to one of two discriminators: a dedicated recovery discriminator and a velocity-conditioned locomotion discriminator that jointly covers walking and running. The gate is defined by a single fixed threshold on projected gravity: the recovery discriminator is activated when body tilt exceeds approximately 37∘ from vertical (∣gz+1∣>0.6); otherwise the locomotion discriminator is used, with the normalized commanded velocity serving as a condition that selects the appropriate reference trajectory between walk and run clips. Only three LAFAN1 reference clips are required to regularize the complete behavior set. At deployment, a single frozen ONNX policy executes at 50,Hz with no runtime mode logic; hardware experiments demonstrate successful recovery from both prone and supine falls and smooth walk-to-run transitions under the same controller.
Yidan Lu, Yichao Zhong, Liu Zhao +2
The University of Hong Kong, Hong Kong SAR, China.
A fallen humanoid beneath an overhead obstacle faces a coupled recovery problem. It must create clearance while organizing support for a stable rise, since attempting to stand before making room can further increase obstruction. We introduce a reinforcement learning method with contact-supported geometric escape guidance, which rewards incremental reduction of robot-obstacle overlap without prescribing an escape path. To achieve this, a learned motion prior, together with posture-dependent support and joint-stall costs, is proposed to shape a single policy that learns when to clear the obstacle, how to establish support, and when to complete the rise, all using proprioception alone. In simulation, it recovers in 88.5% of trials beneath plates that can only be lifted, compared with 18.9% without geometric guidance, and in 98.6% of trials beneath free plates with randomized size, mass and placement. On a Unitree G1, the deployed policy recovered in 95 of 150 attempts across seven real-world obstacle scenes, including furniture and multi-object arrangements absent from training. Project page: https://lu-yidan.github.io/ROOF/
Yidan Lu, Jiayuan Yu, Zongrui Cai +5
The University of Hong Kong · Chinese Academy of Sciences
Humanoid fall recovery requires selecting a motion that suits both the surrounding scene and the task. The same fallen pose can admit several ways to stand, with different routes, support transitions, and final headings. Yet reliable recovery alone does not provide control over which of these alternatives the robot executes. Steering this choice requires anticipating the physical consequences of a requested movement. We present RISE, an approach to perceptive humanoid recovery that lets task objectives steer how the robot returns to standing at inference time. It builds on two insights: diverse recoveries can be composed from shared movements, and anticipating how these movements unfold allows recovery to be steered toward a task objective. We learn a recovery vocabulary that connects intended movements to motor actions through sensory feedback. A visual diffusion planner learns from executions of this vocabulary to predict motion intent as future body states. Task costs guide this prediction toward a desired heading, rise speed, or path. The planner then generates motion latents conditioned on the steered intent, allowing the requested movement to shape its execution. Simulation experiments demonstrate diverse recoveries, terrain adaptation, and test-time steering without retraining, complemented by real-world demonstrations on a Unitree G1. Project page: https://osheraz.github.io/RISE/