Autonomous Driving Scenario Generation

Overview

This field studies how to create driving scenes and agent behaviors that help train and evaluate autonomous vehicles, including rare hazards that are difficult to capture in ordinary driving data. Approaches range from traffic simulators, self-play, and adversarial search to diffusion and world models, scene reconstruction, and language- or rule-based tools that turn specifications into executable tests. Researchers assess scenarios using measures such as realism, physical feasibility, controllability, diversity, and whether they expose failures in closed-loop driving benchmarks. A central challenge is generating genuinely difficult situations without sacrificing natural behavior, while ensuring results transfer beyond the simulator and standard benchmark conditions.

Latest papers

CardsList

111 papers17 papers in the last four weeks, up 143% on the four weeks before. 0.1% of all new papers.

  1. VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoning

    Mar 30, 2026Li-Heng Chen, Ke Cheng, Yahui Liu +3Controllable Video GenerationAutonomous Driving Scenario Generation

  2. AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editing

    Mar 27, 2026Tianyu Liu, Weitao Xiong, Kunming Luo +43D Scene RelightingVideo Editing

  3. CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluation

    Mar 22, 2026Bowen Jing, Ruiyang Hao, Weitao Zhou +1Autonomous Driving Scenario GenerationAdversarial Scenario Generation

  4. From Optimizable to Interactable: Mixed Digital Twin-Empowered Testing of Vehicle-Infrastructure Cooperation Systems

    Mar 18, 2026Jianghong Dong, Chunying Yang, Mengchi Cai +4Intelligent Transportation SystemsDigital Twins

  5. Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation

    Mar 16, 2026Xingtai Gui, Meijie Zhang, Tianyi Yan +5Autonomous Driving PlanningWorld Model-Based Planning

  6. Risk-Controllable Multi-View Diffusion for Driving Scenario Generation

    Mar 12, 2026Hongyi Lin, Wenxiu Shi, Heye Huang +5Autonomous Driving Scenario GenerationControllable Video Generation

  7. STADA: Specification-based Testing for Autonomous Driving Agents

    Mar 11, 2026Joy Saha, Trey Woodlief, Sebastian Elbaum +1Specification-Based TestingAutomated Test Generation

  8. Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamics

    Mar 11, 2026Tianshuo Xu, Zhifei Chen, Leyi Wu +2Physical Consistency in Video GenerationControllable Video Generation

  9. Declarative Scenario-based Testing with RoadLogic

    Mar 10, 2026Ezio Bartocci, Alessio Gambi, Felix Gigler +2Autonomous Driving Scenario GenerationAutomated Test Generation

  10. Emergency Lane-Change Simulation: A Behavioral Guidance Approach for Risky Scenario Generation

    Mar 8, 2026Chen Xiong, Cheng Wang, Yuhang Liu +2Autonomous Driving Scenario GenerationAutonomous Driving Simulation

  11. SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resampling

    Mar 4, 2026Jinlong Cui, Fenghua Liang, Guo Yang +2Differential AttentionAutonomous Driving Scenario Generation

  12. Map-Agnostic And Interactive Safety-Critical Scenario Generation via Multi-Objective Tree Search

    Mar 4, 2026Wenyun Li, Zejian Deng, Chen SunAutonomous Driving Scenario GenerationAutonomous Driving Simulation

  13. AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generation

    Mar 3, 2026Zhulin Jiang, Zetao Li, Cheng Wang +2Autonomous Driving Scenario GenerationAutonomous Driving Simulation

  14. HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles

    Feb 24, 2026Yifan Wang, Francesco Pittaluga, Zaid Tasneem +3Autonomous Driving Scenario Generation3D Scene Editing

  15. ScenicRules: An Autonomous Driving Benchmark with Multi-Objective Specifications and Abstract Scenarios

    Feb 17, 2026Kevin Kai-Chun Chang, Ekin Beyazit, Alberto Sangiovanni-Vincentelli +2Autonomous Driving BenchmarksAutonomous Driving

  16. HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving

    Nov 27, 2025Qiang Li, Yingwenqi Jiang, Tuoxi Li +173D ReconstructionNovel View Synthesis

  17. LaGen: Towards Autoregressive LiDAR Scene Generation

    Nov 26, 2025Sizhuo Zhou, Xiaosong Jia, Fanrui Zhang +73D Scene GenerationAutoregressive Generation

  18. Generative AI for Autonomous Driving: A Review

    May 21, 2025Katharina Winter, Abhishek Vivekanandan, Rupert Polley +17Autonomous DrivingAutonomous Driving Planning

  19. TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles

    Aug 28, 2024Guanren Qiao, Guorui Quan, Jiawei Yu +2Autonomous Driving SimulationAutonomous Driving Scenario Generation