cs.ROAug 24, 2026

Privileged Critic Training Enables Sensor-Free Thruster Fault Adaptation in End-to-End RL

Authors: Ricard Marsal I Castan, Miguel A. Olivares-Méndez

Organizations: University of Luxembourg

Abstract

Fault-tolerant navigation for thruster-actuated robots requires online adaptation to failures that are neither binary nor fully observable: thrusters may degrade continuously, fail dead, or jam stuck-open. Classical fault detection pipelines require dedicated sensors unavailable at deployment; oracle controllers that observe the true failure state are equally impractical. We show that privileged critic training is sufficient for sensor-free fault adaptation: giving the PPO value function access to the true degradation state dgt during training, while the actor receives only standard task observations, shapes a policy that compensates for failures at deployment without any dedicated fault sensing. We propose RAFT (Recurrent Asymmetric Fault Tolerant), a policy with recurrent memory trained with a privileged asymmetric critic. Evaluated on a floating-platform robot (8 thrusters, 1 reaction wheel) under up to four simultaneous thruster failures, RAFT achieves 70.2% success at four concurrent failures, closing 84% of the gap from a failure-naive baseline (4.8%) to an oracle policy that sees the full degradation state at deployment (82.4%). All code, checkpoints, and data are open-source.

Figures & tables

Explore similar work

CardsList
  1. FAR: Failure-Aware Retry for Test-Time Recovery and Continual Policy Improvement

    Jul 1, 2026Haoran Hao, Shahram Najam Syed, Jeffrey Ichnowski +1Robot Policy LearningRobot Policy Adaptation

  2. Resilient Motion Planning for Free-Flying Space Robots under Actuator Failures

    Sep 17, 2026Nicolas de Maddalena, Joris Verhagen, Jana TumovaSpace RoboticsRobotics

  3. Enhancing Hardware Fault Tolerance in Machines with Reinforcement Learning Policy Gradient Algorithms

    Jul 21, 2024Sheila Schoepp, Mehran Taghian, Shotaro Miwa +3RL ControlReinforcement Learning