cs.RONov 16, 2026

ExtremeDrive: A Real-World Dataset and Benchmark for Critical Driving

Authors: Xinhan Li, Yuhong Jiang, Shiyue Zhao, Junzhi Zhang, Chengkun He, Ruihai Ma, Shijie Zhao, Wenxuan Cheng, 

Organizations: School of Vehicle and Mobility, Tsinghua University, Beijing, China · State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China · Xibu Zhiche (Chongqing) Technology Co., Ltd., Chongqing, China

Abstract

Existing autonomous driving datasets and benchmarks provide extensive resources for routine driving, yet real-world data covering safety-critical scenarios and extreme environmental conditions remain limited. To address this gap, we present ExtremeDrive, a real-world dataset and benchmark covering emergency maneuvers, complex traffic interactions, and adverse conditions such as slippery or snow-covered roads, alongside routine driving. The dataset comprises 589 driving scenes curated from a larger pool of real-world driving recordings, with calibrated and aligned multisensor data and reviewed annotations of road structure and traffic participants. We further establish a benchmark to evaluate planned trajectories through simulated vehicle execution, measuring safety-related metrics and driving performance. Experiments at equal training set sizes show that incorporating critical driving data reduces trajectory prediction errors and improves mean critical-success rates in critical scenarios. ExtremeDrive provides a unified resource for learning and evaluating autonomous driving in safety-critical scenarios and extreme environmental conditions.

Figures & tables

Explore similar work

CardsList
  1. HiDrive: A Closed-Loop Benchmark for High-Level Autonomous Driving

    May 11, 2026Zhongyu Xia, Guanyu Zhu, Guo Tang +2Autonomous Driving BenchmarksEnd-to-End Autonomous Driving

  2. TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving

    Feb 26, 2026Tugrul Gorgulu, Atakan Dag, M. Esat Kalfaoglu +4Autonomous Driving DatasetsAutonomous Driving Benchmarks

  3. Boreas Road Trip: A Multi-Sensor Autonomous Driving Dataset on Challenging Roads

    Feb 18, 2026Daniil Lisus, Katya M. Papais, Cedric Le Gentil +4Autonomous Driving DatasetsAutonomous Driving Benchmarks