cs.RONov 2, 2026

Sequential Recovery Updates for Learned Controllers under Successful-Trajectory Preservation

Authors: Zongtan Li, Tianming Liu, Ye Zhao

Organizations: University of Georgia, Athens, GA, USA · Georgia Institute of Technology, Atlanta, GA, USA

Abstract

A competent learned controller already recovers from many disturbances. Improving it means learning a correction, and learning when not to apply it. Freezing a skill's parameters does not settle the second half. In a controller that routes among frozen skills, a new entry rule can redirect the states an old skill succeeded on. We therefore constrain entry instead of parameters. Each update searches for a feedback skill at a measured failure. It fits an entry rule that reads observations and rejects every state on an accumulated successful trajectory. The skill is admitted only if the composed controller reproduces the new recovery on its own and replays every protected trajectory exactly. A finite-trajectory condition states when this preserves the previous controller. One mechanism runs on four streams: two motions on each of two humanoid systems. Two updates per stream add 62 recoveries over 192 withheld perturbations, and lose none of the base controller's successes. We then price that guarantee. Removing the constraint recovers 33 more conditions but stops eight protected ones from completing at all, and excluding only what admission proves necessary recovers none of that cost.

Figures & tables

Explore similar work

Oct 3, 2026

Continual Humanoid Motion Learning

Humanoid whole-body controllers can now track a diverse set of dynamic motions, but they are typically trained offline and then frozen, so teaching such a controller a new skill tends to erode the skills it already mastered. We study continual learning for humanoid whole-body motion, where a single controller must acquire skills from a sequential task stream without revisiting past data. We introduce Similarity-guided LoRA-PNN, a progressive neural network (PNN) policy that prevents catastrophic forgetting by construction while reusing knowledge across skills through lightweight low-rank adaptation. A two-level motion-similarity measure, built from dynamic time warping aggregated by optimal transport, decides which prior skill to build on and how much new capacity to allocate, yielding strong forward transfer and large efficiency gains. Across six sequentially learned skill categories, our similarity-guided LoRA policy attains the best forward transfer (0.125 vs. 0.079) and the highest average accuracy among all methods, while saving up to 94.5% of trainable parameters and 40.8% of training time. The resulting controller reaches 96.13% sim-to-sim transfer and is deployed on a physical Unitree G1. Our code is available at https://anonymous.4open.science/r/continual-humanoid-learning-35D3.
Sep 18, 2026

RAYA: Learning Where and When to Intervene for Robot Recovery

A robot can predict failure and still be unable to prevent it. By the time a safety mechanism reacts, the nominal plan may already have spent the control authority that recovery requires, and fixed task priorities may block whatever response remains. Our key insight is that both aspects are decided inside the controller. Recoverability must inform actions while they are chosen rather than veto them afterward, and task objectives must be adapted as recoverability shrinks. Building on this, we present RAYA, a hybrid learned-analytic framework that places a learned finite-horizon recoverability margin inside an optimal controller with hard constraints and pairs it with a bounded learned scheduler that shifts task weights to facilitate recovery. Across 7,200 simulation episodes per controller spanning quadrotor and autonomous-vehicle benchmarks, RAYA not only improves survival rates, but also transfers the learned components zero-shot to unseen trajectories, disturbances, plant shifts, and friction layouts. We developed an embedded realization of RAYA and deployed it on-board a 35g Crazyflie quadrotor. Across 40 combined hardware flights under wind with either aerodynamic mismatch or an unmodeled 40% motor-command loss, each of three baselines fails in all trials, while RAYA completes 10/10 six-cycle missions. Project Website: https://raya-control.github.io/.
Mar 8, 2026

Stability-Aligned Residual Adaptation for Rapid Recovery from Dynamics Shifts

Robotic systems deployed beyond controlled environments encounter abrupt and unobserved dynamics shifts that induce substantial transient performance loss, even when the nominal closed loop remains locally stabilizing. We formulate rapid inference-time recovery for physical AI as a constrained residual learning problem, in which an online correction added to a frozen reinforcement learning policy is regulated to minimize recovery time while remaining inside the robustness margin of the nominal controller. We specifically focus upon the regulation of residual's corrective authority relative to an already competent frozen policy. The learned residual produces bounded action-space corrections online, and a Stability Alignment Gate regulates this corrective authority through magnitude constraints, directional coherence, performance-conditioned regulation, and adaptive gain modulation. The method requires no environment resets, policy retraining, explicit system identification, or privileged shift information. Across mid-episode changes in actuation, mass, and contact conditions, it reduces recovery time relative to frozen SAC by up to 87% on Go1, 48% on Cassie, 30% on H1, and 20% on Scout in simulation, while preserving near-nominal steady-state performance. The framework is also characterized on two physical robots, a Trossen ViperX manipulator and an AgileX Scout Mini, cutting recovery time by 19.5% on hardware without modifying onboard controller or accessing shift information.