Training-Independent Validation of a Learning-Based Controller for Stunt Maneuvers
Organizations: General Autonomy, USA · City College of New York, New York University, and General Autonomy, USA · Department of Mechanical and Aerospace Engineering, Rutgers University, Piscataway, NJ, USA
Abstract
Learned controllers for vehicle maneuvers are usually validated under the conditions and objective used to train them, where they appear highly reliable, yet the parameters that change on real roads are often not those the model was trained on. We argue that validation must be independent of training: it should vary physical parameters that training kept fixed and use acceptance criteria absent from the training objective. A learning-based control policy, G-Maneuver, with 90.11% success is tested for stunt-level maneuvers. A looser terminal-heading score ranked the worst setting as the best. Because real stunt tests are safety-critical, a simulation-to-reality-to-simulation (Sim2Real2Sim) loop uses the simulation to select safe zones for real-vehicle trials with 16.9% acceptance. Automotive safety analysis frameworks are used to identify parameters for validation using coverage tests. We demonstrated that the kinematic stunt-driving indicators, namely heading change, sideslip, and speed-normalized yaw rate, match between simulation and the real world, while force and roll indicators do not, which identifies the indicators that can support safe deployment. A video of the experiments is available at https://youtu.be/dN1Oes8pNIo.
Figures & tables
| Failure Mode | Physical Cause | Evaluation Metric | Unsafe Control Action | Coverage Parameter |
|---|---|---|---|---|
| FM-1 | Incomplete or excessive heading reversal | Heading change during maneuver | Premature or late phase transition | Heading threshold, reverse-speed threshold, initial state |
| FM-2 | Tire force saturation | Peak lateral acceleration | Steering demand exceeds friction limit | Weather and road friction |
| FM-3 | Yaw instability | Peak yaw rate | Rotation grows beyond controllable region | Reverse-speed threshold, steering input |
| FM-4 | Excessive roll | Peak roll angle | Load transfer reduces stability margin | Reverse-speed threshold, road friction |
| Real-1 | Real-2 | Sim. accepted | Ratio (Real/Sim) | |
|---|---|---|---|---|
| Heading change | , | |||
| Peak (m/s 2 ) | 1.55 | 4.88 | 17.03 | , |
| Peak yaw rate (°/s) | 40.0 | 127.8 | 150.0 | , |
| Peak roll (°) | 2.63 | 1.94 | 0.246 | , |
Autonomous Driving Safety Evaluation
Autonomous driving safety evaluation studies how to measure, test, and improve the safety of self-driving systems in routine and hazardous conditions.
See all 171 papers