REFLEX: A Learned On-Board Reflex for Robust Autonomous Collision Recovery of Soft Quadrotors
Authors: Jakob Hermeler, Luca Girardi, Gabriel Maquignaz, Stefan Leutenegger, Stefano Mintchev
Organizations: Mobile Robotics Lab, Department of Mechanical and Process Engineering, ETH Zurich, Zurich, Switzerland. · Environmental Robotics Lab, Faculty of Agricultural, Nutritional and Engineering Sciences, University of Bonn, Bonn, Germany.
Collision-resilient airframes allow quadrotors to survive impacts, but do not ensure autonomous post-collision recovery. Innovation gating in stock onboard estimators often rejects valid external velocity measurements after high-speed impacts, compromising recovery. We present REFLEX, a collision-recovery flight mode that runs entirely on the flight controller, requiring neither contact sensors nor a companion computer. Its proprioceptive recurrent policy stabilizes the vehicle without position, velocity, heading, or altitude estimates. The translational estimate is reinitialized while REFLEX is active, and a trust gate checks estimator consistency before returning control to the stock autopilot. The policy is trained in simulation using proximal policy optimization, with episodes initialized from post-impact states measured in 47 real collisions. In hardware experiments, REFLEX recovered 19 of 22 wall impacts at 5.03 ± 0.09 m/s, compared with 1 of 14 for the matched stock autopilot. These included 15 consecutive recoveries in a single flight. A separate exploratory flight demonstrated two additional recoveries at 6.02 and 6.05 m/s within the same flight, exceeding the previously reported velocity for autonomous wall-collision recovery by 64%.
Figures & tables
Fig. 2: REFLEX (blue) within the stock PX4 flight stack (black). The policy commands collective thrust and body rates (CTBR) at 100 Hz, bypassing position and attitude control. Translational reinitialization begins 0.30 s after engagement, followed by consistency-gated handback.
Fig. 3: Platform and protocol. (a) Side schematic of the 5 m/s experiment, showing the prep hold, trigger plane, wall, and commanded retreat point. (b) Top view of the 0.371 kg vehicle (front pointing downward): (1) rear-mounted motion-capture markers, (2) flight controller, (3) flexible ring, (4) WiFi bridge, and (5) motor hub.
Experiment
n
% Rec. (abs)
Speed (m/s)
Pitch † ( ∘ )
Decel. ‡ (m/s 2 )
REFLEX 5 m/s
22
86% (19)
5.03±0.09
9.9±2.4
305±32
REFLEX 3 m/s
11
82% (9)
3.22±0.05
11.7±0.5
151±18
Baseline 5 m/s
14
7% (1)
5.10±0.10
12.9±1.8
326±42
Baseline 3 m/s
15
67% (10)
3.21±0.13
11.7±1.4
149±15
TABLE I: Collision outcomes and measured impact conditions.
Fig. 4: Estimated and motion-capture-derived wall-axis velocity for (a) stock PX4 failure at 5.07 m/s, (b) REFLEX recovery at 5.13 m/s, and (c) exploratory recovery at 6.05 m/s. Diamonds mark estimator-reinitialization requests. Mode annotations indicate REFLEX engagement and handback to OFFBOARD.
Fig. 5: Fifteen consecutive recoveries at 4.89–5.13 m/s in one flight. Motion-capture trajectories in (a) side and (b) top view show approach (dotted), REFLEX control (orange), OFFBOARD retreat (blue), and settled positions (green) near the 3 m retreat command.
Autonomous fall recovery is a critical capability for quadrotors operating in real-world environments, where collisions or failures may leave the vehicle resting on the ground in an arbitrary attitude. This problem is challenging because recovery must be achieved under limited onboard sensing, in constrained free space, with ground contact, and in the presence of unknown disturbances. In this letter, we present an RL-based framework for autonomous fall recovery of a quadrotor from arbitrary ground attitudes to stable hover using only lightweight onboard sensors. To address severe partial observability and intermittent sensor invalidity, we train a recurrent policy within an asymmetric actor--critic architecture, leveraging an Incremental Nonlinear Dynamic Inversion (INDI) controller to track the policy output. Combined with high-fidelity simulations of motor response and optical flow, the overall training framework significantly reduces the sim-to-real gap. Simulation ablation studies validate the importance of the main design choices, while real-world experiments demonstrate zero-shot transfer and robust recovery under different initial attitudes, wind disturbances, and additional payloads. These results demonstrate that agile quadrotor fall recovery can be achieved without explicit state estimation using only limited and unreliable onboard sensing.
Anke Zhao, Yuhang Zhong, Kenghou Hoi +5
Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China · Differential Robotics, Hangzhou 311121, China
Unmanned aerial vehicles (UAVs) operating in cluttered environments require efficient and accurate impact modeling to maintain stability post collisions, however classical impulse contact models decouple the normal and tangential components. This letter presents a dual quaternion impulse reset map directly on the SE(3) manifold. By operating on the unified spatial twist (unified linear and angular velocities), the proposed formulation retains the cross-coupling between normal and tangential impulse components in a single closed-form expression, and recovers the classical decoupled Newton impulse model as a special case. A recovery controller is designed that couples linear and angular momentum to enforce kinetic energy dissipation across impacts. Hardware-in-the-loop benchmarks demonstrate a 24% reduction in execution latency compared to an optimized matrix-based implementation, and a 20% reduction relative to a position-plus-quaternion (PQ) formulation. MuJoCo simulations across Monte Carlo sweeps over impact angles and friction coefficients show a 50.8%-75.1% reduction in position root-mean-square error (RMSE) and a 68.7%-85% decrease in peak kinetic energy compared to published linear-admittance baselines.
Valentin Gaucher, Wenlong Zhang
School of Manufacturing Systems and Networks, Ira A. Fulton Schools of Engineering, Arizona State University, Mesa, AZ, 85212, USA.
Autonomous quadrotor flight in cluttered environment is an key capability for tasks like inspection and search. Navigation policies trained in simulation and transferred to hardware can fly at high speed in open space, but they can still collide as obstacle clearance shrinks. We attribute most of these collisions to a single mechanism, namely motion in directions the onboard camera does not observe. Heading that is not aligned with the direction of travel and lateral excursion during obstacle avoidance both carry the vehicle toward obstacles outside its field of view. We introduce ClearNav, a navigation policy trained with two reward terms that constrain motion to the observed direction, a forward-looking heading target and a penalty on lateral velocity. A third term penalizes speed near obstacles so that an obstacle entering the field of view remains avoidable. In simulation, across 18 held-out scenarios with 2304 paired flights per policy unseen in training, ClearNav improves success by 6.8 points, cuts the collision rate by 65% relative to the state of the arts, and flies at maximum 5m/s. For the proximity term alone under matched commanded speeds, the collision reduction still holds at 70%. The effect is significant on static scenes and consistent in direction on moving obstacles, though not significant there at the suite level, showing that safer flight in clutter is possible even on the limited sensors and compute of small drones. We also validate our navigation policy in a real-world cluttered environment, showing that it enables the quadrotor to navigate through the cluttered environment successfully and safely.
Aditya Azad, Arthur Huang, Guanrui Li
Worcester Polytechnic Institute, MA, USA · Northeastern University, MA, USA