Autonomous Driving Datasets

Ask about this topic

Overview

Autonomous driving datasets capture road scenes, road users, vehicle motion, and driving decisions so systems can learn and be tested in varied conditions. They include naturalistic recordings from cameras, LiDAR, radar, vehicles, and drones; simulated or generated scenes; and annotations ranging from object labels and trajectories to maps, risks, and language-based reasoning. Benchmarks use these data to compare perception, forecasting, localization, and planning, including in long-tail scenarios, adverse weather, and cooperative settings. A central challenge is building data that is diverse, well-labeled, and realistic enough to reveal failures beyond familiar routes and short, open-loop tests, while keeping collection and annotation practical.

Latest papers

CardsList

141 papers11 papers in the last four weeks, down 39% on the four weeks before. 0.1% of all new papers.

  1. DriveOSS: Dataset and Benchmark for 3D Anomaly Segmentation and Open-set Semantic Segmentation in Autonomous Driving

    Oct 23, 2026Zhiran Yan, Savankumar Bhanderi, Sourabh Lolge +4Autonomous Driving DatasetsAutonomous Driving Benchmarks

    Technische Hochschule Ingolstadt · UCLA

  2. Deep Learning-Based Road Lane Quality Assessment from Egocentric Dashcam Video

    Oct 20, 2026Shaif Chowdhury, Akhila Yeruvasu, Moshiur Rahman Tonmoy +2Image Quality AssessmentAutonomous Driving Datasets

    Department of Electrical Engineering and Computer Science, Texas A&M University–Kingsville, Kingsville, TX 78363, USA

  3. GeoV2V: Geometry-Grounded Video Diffusion Model for Driving Scene Generation

    Oct 18, 2026Yuchen Xi, Yuhan Guo, Chenwei Hou +4Novel View SynthesisTrajectory-Guided Video Generation

    Global Institute of Future Technology, Shanghai Jiao Tong University, China · Global College, Shanghai Jiao Tong University, China · School of Mechanical Engineering, Shanghai Jiao Tong University, China +1

  4. PanoBench: A Panoptic Occupancy Prediction Benchmark for Autonomous Driving

    Oct 16, 2026Yi Feng, Zizhan Guo, Junwu E +83D Occupancy PredictionAutonomous Driving Datasets

  5. Tracking the Invisible: Self-Supervised Wheel Track Detection with Thermal-RGB Fusion

    Oct 9, 2026Yiming Yang, Jeremy P. BosAutonomous Driving PerceptionAutonomous Driving

  6. Towards Safer Cities: A Design Process for Perception Datasets in Urban Driving Scenarios

    Oct 9, 2026Alexander Kroth, Cristian Martinez, Steven PetersAutonomous Driving DatasetsAutonomous Driving Perception

    Institute of Automotive Engineering Darmstadt (FZD), TU Darmstadt, Otto-Berndt-Str. 2, 64287 Darmstadt, Germany

  7. Trajectory Prediction for Autonomous Driving in Road Construction Zones Using Human-in-the-Loop Driving Data

    Oct 8, 2026Shuo Zhang, Aman Sunesh, Semiha Ergan +1Vehicle Trajectory PredictionAutonomous Driving

    New York University New York City, NY, USA · New York University New York, USA

  8. Odyssey: A Closed-Loop Benchmark for Long-Horizon Real-World Driving with Explicit Navigation Routes

    Oct 5, 2026Jungho Kim, Hongjae Shin, Seunghoon Yu +11Autonomous Driving DatasetsAutonomous Driving Benchmarks

    Seoul National University, Republic of Korea

  9. Building A Multi-Sensor Platform For Autonomous Driving Research: Challenges and Lessons Learned

    Oct 4, 2026Paulo Ricardo Marques de Araujo, Eslam Mounier, Qamar Bader +2Autonomous Driving DatasetsRobotic Data Collection

    Queen’s University, Kingston, ON, Canada · Ain Shams University, Cairo, Egypt · Royal Military College of Canada, Kingston, ON, Canada

  10. Human Behavior-Informed Crash Scenario Generation with Real-World Crash Priors for Autonomous Vehicle Safety Evaluation

    Oct 3, 2026Mingxing Peng, Xusen Guo, Long Chen +3Autonomous Driving Scenario GenerationAutonomous Driving Safety Evaluation

    The Hong Kong University of Science and Technology (Guangzhou), China · Institute of Automation Chinese Academy of Sciences, Beijing, China · The University of Hong Kong, Hong Kong, China +1

  11. doPlan: A Variable-Horizon Dataset for Multi-Stage Language-Conditioned Planning in Autonomous Driving

    Sep 29, 2026Parthib Roy, Yash Tandon, Marcus Blennemann +4Autonomous Driving DatasetsLong-Horizon Planning

    Machine Intelligence, Interaction, and Imagination (Mi3) Laboratory, University of California, Merced, Merced, CA, USA. · Laboratory for Intelligent & Safe Automobiles (LISA), University of California, San Diego, La Jolla, CA, USA.

  12. SV2V-RSim: A Comprehensive Benchmark for Self-Selective V2V Cooperative Perception with Near-Realistic Data

    Sep 26, 2026Yulu Wu, Chao Wei, Jujun Cheng +6Cooperative PerceptionAutonomous Driving Datasets

    Tongji University, Shanghai, China · Anhui University, Hefei, China · University of Toyama, Toyama, Japan

  13. RCVLA: 4D Radar-Grounded Semantic Reasoning and Trajectory Arbitration for Autonomous Driving

    Sep 26, 2026Lianqing Zheng, Xiaokai Bai, Yixuan Luo +6VLMs for Autonomous DrivingAutonomous Driving Planning

    Tongji · ZJU · HKUST +2

  14. Autonomous Driving Research Requires a Community-Driven Data Paradigm

    Sep 25, 2026Jinsu Yoo, Zanming Huang, Katie Z Luo +5Autonomous Driving DatasetsAutonomous Driving

    Boston University · Stanford University · The Ohio State University +1

  15. RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actors

    Sep 25, 2026Zijun Zhao, Liewen Liao, Kang Shen +2Autonomous Driving Simulation3D Asset Generation

    Global Institute of Future Technology, Shanghai Jiao Tong University, Shanghai 200240, China · School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai 200240, China

  16. AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios

    Sep 23, 2026Zhipeng Bao, Wenjie Zhao, Tianle Zhu +4Autonomous Driving DatasetsLong-Tail Autonomous Driving

    School of Environmental, Civil, Agricultural and Mechanical Engineering, University of Georgia · School of Computing, University of Georgia

  17. BranchDrive: A Branch-Structured Dataset for Action-Conditioned Driving Prediction

    Sep 23, 2026Feeza Khan Khanzada, Sudarshan Sridhar, Jaerock KwonAutonomous Driving DatasetsAutonomous Driving Benchmarks

    Department of Electrical and Computer Engineering, University of Michigan-Dearborn, 4901 Evergreen Rd, Dearborn, MI 48128, United States

  18. Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving

    Sep 18, 2026Jiaxing Chen, Hengduo Zou, YuKai Qin +3End-to-End Autonomous DrivingAutonomous Driving Planning

    School of Vehicle and Mobility, Tsinghua University · The Hong Kong University of Science and Technology (Guangzhou) · Neolix, Beijing, China

  19. WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones

    Sep 16, 2026Nishad Sahu, Changzhong Qian, Guangzhou Cai +3Autonomous Driving DatasetsEnd-to-End Autonomous Driving

    Raj · Department of Electrical and Computer Engineering Carnegie Mellon University, Pittsburgh, PA, USA

  20. NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving

    Sep 15, 2026Muhammad Ahmed Ullah Khan, Mohammed Elamine, Sheikh Talha Uddin +3Autonomous Driving DatasetsAutonomous Driving Benchmarks

    DFKI · RPTU Kaiserslautern-Landau · Independent Researcher +1

  21. GRAVA: Grounded Reasoning-to-Action Representation and Learning for Autonomous Driving

    Sep 14, 2026Xiao Liu, Haoyu Li, Jianghao Leng +2Autonomous Driving DatasetsAutonomous Driving

    National Engineering Research Center of Electric Vehicles, Beijing Institute of Technology, Beijing 100081, China · Shenzhen Automotive Research Institute, Beijing Institute of Technology, Shenzhen 518118, China · Shenzhen Jiguangzhijie Technology Co., Ltd., Shenzhen 518118, China +2

  22. A Multi-Vehicle Dataset with Camera, LiDAR, and Radar Sensors and Scanned 3D Models for Custom Auto-Annotation using RTK-GNSS

    Sep 11, 2026Philipp Berthold, Bianca Forkel, Mirko MaehlischAutonomous Driving DatasetsAutonomous Driving Perception

    Institute for Autonomous Driving of the University of the Bundeswehr Munich, Neubiberg, Germany

  23. DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting

    Sep 8, 2026Yuhang Wang, Chuheng Wei, Jingxin Yang +2Autonomous Driving DatasetsAutonomous Driving Benchmarks

    University of South Florida · Purdue University · Stanford University +1

  24. Generation of Vectorized Maps Beyond Vehicle View

    Sep 7, 2026Clara Gomez, Alberto Jaenal, Antonio Artuñedo +2Autonomous Driving DatasetsHD Map Construction

    Centre for Automation and Robotics, CSIC-UPM, Spain. · Aragon Institute for Engineering Research (I3A), University of Zaragoza, Spain.

  25. CASCADE: A Spatio-Temporal-Causal Reasoning Representation and Dataset for Driving

    Sep 7, 2026Jenny Schmalfuss, Despoina Paschalidou, Simon Gerstenecker +2Spatiotemporal ReasoningAutonomous Driving Datasets

    NVIDIA · ETH Zürich · Work done during NVIDIA Internship

  26. Understanding Autonomous Driving Datasets by Describing Differences between Image Subsets in Natural Language

    Sep 3, 2026Julian Truetsch, Felix Hauser, Christoph Stiller +1Autonomous Driving DatasetsAutonomous Driving Benchmarks

    FZI Research Center for Information Technology, 76131 Karlsruhe, Germany · Karlsruhe Institute of Technology (KIT), 76131 Karlsruhe, Germany

  27. Designing Versatile Samples for Learned Trajectory Scoring

    Sep 1, 2026Yaguang Li, Jiaru Zhang, Chuheng Wei +2Autonomous Driving DatasetsAutonomous Driving Planning

    Purdue University · Bosch Artifical Intelligence Center

  28. Scene Graph-based Driving Scenario Extraction for Automotive Egocentric Datasets

    Aug 31, 2026Stefan Ramdhan, Kyanna Dagenais, Vera Pantelic +2Autonomous Driving DatasetsAutonomous Driving

    McMaster Centre for Software Certification (McSCert) · McMaster University · Hamilton, Ontario, Canada

  29. Rad-R: A Raw-ADC Radar Dataset and Capture-Invariant SSM for Hardware-Fault Diagnosis

    Aug 31, 2026Mainak Mallick, Junghwan Yim, Alankrit Gupta +1Autonomous Driving DatasetsMillimeter-Wave Radar

    Georgia Institute of Technology

  30. SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoring

    Aug 25, 2026Weijiang Xiong, Lan Feng, Alexandre Alahi +1Autonomous DrivingAutonomous Driving Planning

    École Polytechnique Fédérale de Lausanne