Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehicles
Organizations: College of Transportation, Tongji University, Shanghai 201804, China · Department of Computer Science, University of North Carolina at Chapel Hill, United States
Abstract
Autonomous vehicles in interactive traffic environments are often limited by the scarcity of safety-critical tail events in static datasets, which biases learned policies toward average-case behaviors and reduces robustness. Existing evaluation methods attempt to address this through adversarial stress testing, but are predominantly open-loop and post-hoc, making it difficult to incorporate discovered failures back into the training process. We introduce Evaluation as Evolution (), a closed-loop framework that transforms adversarial generation from a static validation step into an adaptive evolutionary curriculum. Specifically, formulates adversarial scenario synthesis as transport-regularized sparse control over a learned reverse-time SDE prior. To make this high-dimensional generation tractable, we utilize topology-driven support selection to identify critical interacting agents, and introduce Topological Anchoring to stabilize the process. This approach enables the targeted discovery of failure cases while strictly constraining deviations from realistic data distributions. Empirically, improves collision failure discovery by 9.01% on the nuScenes dataset and up to 21.43% on the nuPlan dataset over the strongest baselines, while maintaining low invalidity and high realism. It further yields substantial robustness gains when the resulting boundary cases are recycled for closed-loop policy fine-tuning.
Figures & tables
| Method | REAL | CFR (%) | AOR (%) | RelVel ( ) |
| nuScenes Dataset | ||||
| CTG | 0.8011 | 1.18 | 0.20 | 4.07 |
| STRIVE | 0.6115 | 51.28 | 3.31 | 7.01 |
| Safe-Sim-opt | 0.7394 | 37.14 | 0.26 | 17.57 |
| DiffScene | 0.7325 | 31.43 | 0.38 | 26.07 |
| CCDiff | 0.6965 | 39.90 | 4.11 | 33.05 |
| Method | TTC-C | CFR (%) | RIR (%) | AOR (%) | RelVel ( ) |
| Random-K | 0.0949 | 28.57 | 19.99 | 0.15 | 18.25 |
| Topo-only | 0.0925 | 31.43 | 45.47 | 0.32 | 15.37 |
| Topo+Feas. | 0.1800 | 53.57 | 26.66 | 0.20 | 2.58 |
| Drift Control | Metrics | |||||
| TTC-C | CFR (%) | RelVel ( ) | REAL | AOR (%) | ||
| Anchoring disabled | ||||||
| – | 0.0722 | 3.57 | 3.67 | 0.7648 | 0.19 | |
| – | 0.2103 | 87.86 | 17.01 | 0.7286 | 1.44 | |
| 0.1532 | 51.43 | 2.11 | 0.7464 | 0.10 | ||
| Anchoring enabled | ||||||
| Ego Policy | TTC-C | CFR (%) | Front-col (%) | Side-col (%) | Rear-col (%) | RelVel ( ) |
| LG | 0.1532 | 51.43 | 11.43 | 42.86 | 28.57 | 2.11 |
| IDM | 0.2127 | 51.43 | 25.71 | 24.71 | 25.71 | 2.23 |
| BITS | 0.1564 | 25.71 | 17.14 | 20.00 | 17.14 | 19.70 |
Autonomous Driving Safety Evaluation
Autonomous driving safety evaluation studies how to measure, test, and improve the safety of self-driving systems in routine and hazardous conditions.
See all 153 papers