Autonomous Driving Scenario Generation

Overview

This field studies how to create driving scenes and agent behaviors that help train and evaluate autonomous vehicles, including rare hazards that are difficult to capture in ordinary driving data. Approaches range from traffic simulators, self-play, and adversarial search to diffusion and world models, scene reconstruction, and language- or rule-based tools that turn specifications into executable tests. Researchers assess scenarios using measures such as realism, physical feasibility, controllability, diversity, and whether they expose failures in closed-loop driving benchmarks. A central challenge is generating genuinely difficult situations without sacrificing natural behavior, while ensuring results transfer beyond the simulator and standard benchmark conditions.

Latest papers

CardsList

119 papers10 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. CaFe: Causally Faithful Conditional Traffic Scenario Generation

    Nov 17, 2026Steven Yu Tung, Shubham Vaijanath Phoolari, Christoph Lauer +2Autonomous Driving Scenario Generation

  2. Making the World React Realistically: A Closed-Loop Interactive World Model for Autonomous Driving

    Nov 17, 2026Jia Hu, Yang Chang, Panqu Wang +4World Models for Autonomous DrivingInteractive World Models

  3. CrossLiDAR: Controllable Multi-Sensor LiDAR Sequence Generation

    Nov 8, 2026Khanh Nguyen, Thomas Walker, Hichem Telli +6Autonomous Driving SimulationAutonomous Driving Scenario Generation

  4. Scenario Orchestration for Closed-loop Policy Evaluation of Autonomous Driving

    Nov 6, 2026Frieda Rong, Zhaoyue Wang, Veer Kapadia +6Scenario-Based TestingAutonomous Driving Simulation

  5. ReconDreamer#: Self-Evolving Closed-Loop Synergy of Reconstruction and Generation for Dynamic Driving Scenes

    Nov 3, 2026Songling Liu, Guosheng Zhao, Xiaofeng Wang +5Dynamic Scene Reconstruction3D Scene Generation

  6. WorkIng: A Real-World and Synthetic Highway Work-Zone Benchmark Dataset for Autonomous Navigation

    Oct 30, 2026Xujun Xie, Dominik Rößle, Adithya Mohan +2Autonomous Driving BenchmarksAutonomous Driving Datasets

  7. Model-Aware Generation of Safety-Critical Scenes for Robust End-to-End Driving via Distilled Planner Surrogates

    Oct 26, 2026Khaled M. Seyam, Julian Wiederer, Samar Fathalah +2End-to-End Autonomous DrivingAutonomous Driving Scenario Generation

  8. LAST-V2X: Language-Driven Adaptive Scenario Synthesis and Testing for Communication-Induced Failures in V2X Safety Applications

    Oct 22, 2026Keshu Wu, Hao Zhang, Rui Gan +3Scenario-Based TestingAutonomous Driving Scenario Generation

  9. FaultGene: LLM-Assisted Fault-Augmented Test Generation for Hardware-in-the-Loop Validation of Autonomous Driving Systems

    Oct 21, 2026Chaoran Yuan, Fadi KurdahiAutomated Test GenerationAutonomous Driving Safety Evaluation

  10. Drive2Gauss: FeedForward 4D Gaussian Reconstruction from Multimodal Generative Driving Videos

    Oct 19, 2026Tong Zhao, Zhiyuan Han, Lin Chen +10Multimodal Video GenerationDynamic Scene Reconstruction

  11. BodyBridge: Grounded Body Layers for Sim-to-Real Translation of Vulnerable Road Users

    Oct 17, 2026Mark Azer, Fabian B. FlohrSim-to-Real TransferVideo Diffusion Models

  12. SHRED: Self-Play for Heterogeneous Road-Users without Expert Demonstrations

    Oct 14, 2026Wei-Jer Chang, Zhouchonghao Wu, Akshay Rangesh +3Self-Play RLAutonomous Driving Simulation

  13. Uncertainty-Driven Self-Play for Robust Multi-Agent Driving Policies

    Oct 14, 2026Sajad Marvi, Julian Schmidt, Alessandro Canevaro +2Uncertainty-Aware ExplorationAutonomous Driving Planning

  14. Assessing the Quality of Concrete Scenarios Generated from Scenario Classes for Automated Driving

    Oct 13, 2026Lina Putze, Thies de Graaff, Jan Steffen Becker +1Autonomous Driving Scenario GenerationAutomated Evaluation

  15. Lamarck's Driving School: Discovering Autonomous Driving Training Strategies through Evolutionary Competition

    Oct 8, 2026Yichun Ye, He Zhang, Ye Tian +1Curriculum RLAutonomous Driving Scenario Generation

  16. Controllable and Photorealistic Pedestrian Risky Motion Generation for End-to-End Driving Safety Evaluation

    Oct 5, 2026Siyuan Liu, Miao Li, Haibao Yu +4Pedestrian Behavior ModelingEnd-to-End Autonomous Driving

  17. How corner is a corner case? Percentile control for highway scenario generation

    Oct 4, 2026Jiaxi Liu, Hang Zhou, Hangyu Li +5Autonomous Driving Safety EvaluationAdversarial Scenario Generation

  18. Human Behavior-Informed Crash Scenario Generation with Real-World Crash Priors for Autonomous Vehicle Safety Evaluation

    Oct 3, 2026Mingxing Peng, Xusen Guo, Long Chen +3Autonomous Driving Scenario GenerationAutonomous Driving Safety Evaluation

  19. TerrainForge: Physics-Grounded Road Geometry Editing for Counterfactual Autonomous Driving

    Oct 2, 2026Yang Chen, Yicheng Zhu, zhenning Li +2Autonomous Driving Scenario GenerationAutonomous Driving Simulation

  20. Evaluating Physical Consistency and Plausibility in Generative Scenario Models for Autonomous Driving

    Oct 1, 2026Manasa Mariam Mammen, Zafer Kayatas, Stefan WagnerAutonomous Driving Safety EvaluationAutonomous Driving Scenario Generation

  21. TrafficSignBench: Rule-Centric Closed-Loop Evaluation of Traffic-Sign Compliance in Autonomous Driving

    Sep 29, 2026Victoria Smirnova, Viktoriia Zinkovich, Gregorii Bukhtuev +4Autonomous Driving BenchmarksAutonomous Driving Safety Evaluation

  22. ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving

    Sep 29, 2026Ziyi Luo, Zhe Sun, Yehao Lu +5Autonomous Driving BenchmarksAutonomous Driving Safety Evaluation

  23. PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving

    Sep 8, 2026Yuan Gao, Sebastian Müller, Mattia Piccinini +5Autonomous Driving Safety EvaluationLLM Agent Orchestration