Autonomous Driving Datasets

Overview

Autonomous driving datasets capture road scenes, road users, vehicle motion, and driving decisions so systems can learn and be tested in varied conditions. They include naturalistic recordings from cameras, LiDAR, radar, vehicles, and drones; simulated or generated scenes; and annotations ranging from object labels and trajectories to maps, risks, and language-based reasoning. Benchmarks use these data to compare perception, forecasting, localization, and planning, including in long-tail scenarios, adverse weather, and cooperative settings. A central challenge is building data that is diverse, well-labeled, and realistic enough to reveal failures beyond familiar routes and short, open-loop tests, while keeping collection and annotation practical.

Latest papers

CardsList

151 papers7 papers in the last four weeks, down 53% on the four weeks before. 0.1% of all new papers.

  1. WHU-Road3D: A dataset and benchmark towards fine-grained road surface mapping

    Nov 19, 2026Xiaoxin Mi, Zhen Cao, Chong Liu +5Multimodal DatasetAutonomous Driving Datasets

  2. VTT: Reading Vehicle Size and Powertrain Type from Motion Trajectory Across Unseen Car Models

    Nov 17, 2026Yuhang Wang, Yuechen Guo, Jingxin Yang +7ClassificationAutonomous Driving Datasets

  3. ExtremeDrive: A Real-World Dataset and Benchmark for Critical Driving

    Nov 16, 2026Xinhan Li, Yuhong Jiang, Shiyue Zhao +7Autonomous Driving DatasetsAutonomous Driving Benchmarks

  4. Beyond Vehicle-Centric Data: Scaling Autonomous Driving through Roadside-to-Vehicle Generation

    Nov 15, 2026Yichen Zhang, Zihan Wang, Hao Chen +6Synthetic Data GenerationAutonomous Driving Datasets

  5. Ego2Flow: Benchmarking the Traffic-System Impact of Autonomous Driving on Maps Distilled from Real-World Roads

    Nov 13, 2026Yu Dong, Weiying Shen, Hangyu Li +8Autonomous Driving BenchmarksAutonomous Driving

  6. WorkIng: A Real-World and Synthetic Highway Work-Zone Benchmark Dataset for Autonomous Navigation

    Oct 30, 2026Xujun Xie, Dominik Rößle, Adithya Mohan +2Autonomous Driving BenchmarksAutonomous Driving Datasets

  7. Deep Learning-Based Road Lane Quality Assessment from Egocentric Dashcam Video

    Oct 20, 2026Shaif Chowdhury, Akhila Yeruvasu, Moshiur Rahman Tonmoy +2Image Quality AssessmentAutonomous Driving Datasets

  8. GeoV2V: Geometry-Grounded Video Diffusion Model for Driving Scene Generation

    Oct 18, 2026Yuchen Xi, Yuhan Guo, Chenwei Hou +4Novel View SynthesisTrajectory-Guided Video Generation

  9. Towards Safer Cities: A Design Process for Perception Datasets in Urban Driving Scenarios

    Oct 9, 2026Alexander Kroth, Cristian Martinez, Steven PetersAutonomous Driving DatasetsAutonomous Driving Perception

  10. Trajectory Prediction for Autonomous Driving in Road Construction Zones Using Human-in-the-Loop Driving Data

    Oct 8, 2026Shuo Zhang, Aman Sunesh, Semiha Ergan +1Vehicle Trajectory PredictionAutonomous Driving

  11. Building A Multi-Sensor Platform For Autonomous Driving Research: Challenges and Lessons Learned

    Oct 4, 2026Paulo Ricardo Marques de Araujo, Eslam Mounier, Qamar Bader +2Autonomous Driving DatasetsRobotic Data Collection

  12. Human Behavior-Informed Crash Scenario Generation with Real-World Crash Priors for Autonomous Vehicle Safety Evaluation

    Oct 3, 2026Mingxing Peng, Xusen Guo, Long Chen +3Autonomous Driving Scenario GenerationAutonomous Driving Safety Evaluation

  13. doPlan: A Variable-Horizon Dataset for Multi-Stage Language-Conditioned Planning in Autonomous Driving

    Sep 29, 2026Parthib Roy, Yash Tandon, Marcus Blennemann +4Autonomous Driving DatasetsLong-Horizon Planning

  14. SV2V-RSim: A Comprehensive Benchmark for Self-Selective V2V Cooperative Perception with Near-Realistic Data

    Sep 26, 2026Yulu Wu, Chao Wei, Jujun Cheng +6Cooperative PerceptionAutonomous Driving Datasets

  15. Autonomous Driving Research Requires a Community-Driven Data Paradigm

    Sep 25, 2026Jinsu Yoo, Zanming Huang, Katie Z Luo +5Autonomous Driving DatasetsAutonomous Driving

  16. RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actors

    Sep 25, 2026Zijun Zhao, Liewen Liao, Kang Shen +2Autonomous Driving Simulation3D Asset Generation

  17. AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios

    Sep 23, 2026Zhipeng Bao, Wenjie Zhao, Tianle Zhu +4Autonomous Driving DatasetsLong-Tail Autonomous Driving

  18. BranchDrive: A Branch-Structured Dataset for Action-Conditioned Driving Prediction

    Sep 23, 2026Feeza Khan Khanzada, Sudarshan Sridhar, Jaerock KwonAutonomous Driving DatasetsAutonomous Driving Benchmarks

  19. Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving

    Sep 18, 2026Jiaxing Chen, Hengduo Zou, YuKai Qin +3End-to-End Autonomous DrivingAutonomous Driving Planning

  20. WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones

    Sep 16, 2026Nishad Sahu, Changzhong Qian, Guangzhou Cai +3Autonomous Driving DatasetsEnd-to-End Autonomous Driving

  21. NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving

    Sep 15, 2026Muhammad Ahmed Ullah Khan, Mohammed Elamine, Sheikh Talha Uddin +3Autonomous Driving DatasetsAutonomous Driving Benchmarks

  22. GRAVA: Grounded Reasoning-to-Action Representation and Learning for Autonomous Driving

    Sep 14, 2026Xiao Liu, Haoyu Li, Jianghao Leng +2Autonomous Driving DatasetsAutonomous Driving