Autonomous Driving Datasets

Overview

Autonomous driving datasets capture road scenes, road users, vehicle motion, and driving decisions so systems can learn and be tested in varied conditions. They include naturalistic recordings from cameras, LiDAR, radar, vehicles, and drones; simulated or generated scenes; and annotations ranging from object labels and trajectories to maps, risks, and language-based reasoning. Benchmarks use these data to compare perception, forecasting, localization, and planning, including in long-tail scenarios, adverse weather, and cooperative settings. A central challenge is building data that is diverse, well-labeled, and realistic enough to reveal failures beyond familiar routes and short, open-loop tests, while keeping collection and annotation practical.

Latest papers

151 papers7 papers in the last four weeks, down 53% on the four weeks before. 0.1% of all new papers.

Nov 3, 2024

ROAD-Waymo: A Large-Scale Action Awareness Dataset for Autonomous Driving

Autonomous Vehicle (AV) perception systems require more than simply seeing, via e.g., object detection or scene segmentation. They need a holistic understanding of what is happening within the scene for safe interaction with other road users. Few datasets exist for the purpose of developing and training algorithms to comprehend the actions of other road users. This paper presents ROAD-Waymo, an extensive dataset for the development and benchmarking of techniques for agent, action, location and event detection in road scenes, provided as a layer upon the (US) Waymo Open dataset. Considerably larger and more challenging than any existing dataset (and encompassing multiple cities), it comes with 198k annotated video frames, 54k agent tubes, 3.9M bounding boxes and a total of 12.4M labels. The integrity of the dataset has been confirmed and enhanced via a novel annotation pipeline designed for automatically identifying violations of requirements specifically designed for this dataset. As ROAD-Waymo is compatible with the original (UK) ROAD dataset, it provides the opportunity to tackle domain adaptation between real-world road scenarios in different countries within a novel benchmark: ROAD++.