cs.CVSep 4, 2026

One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation

Authors: Arka Pal, Rajesh Kumar, Hannes Eriksson, Rémi Lacombe, Arvid Laveno Ling, Ankit Gupta, Maciej Wozniak

Organizations: KTH Royal Institute of Technology, Sweden · Zenseact AB, Sweden · Chalmers University of Technology, Sweden

Abstract

Diffusion probabilistic models can capture the multi-modal, interaction-rich distribution of joint future trajectories in driving scenes. We show that a single pretrained diffusion traffic model can serve two complementary roles in the autonomous driving development loop: as an ego motion planner, and as a controllable generator of safety-critical scenarios for stress-testing the planners. On the planning side, we introduce a Single-Stream Dual-Stream (SSDS) diffusion-transformer decoder that fuses scene context via joint attention rather than late cross-attention, improving closed-loop performance on nuPlan. We further propose Decoupled Annealing Posterior Sampling with Energy (DAPSE), a training-free guidance scheme that injects arbitrary energy functions at the clean-sample level, avoiding the first-order approximation errors while requiring no auxiliary networks. Beyond planning, we leverage the same diffusion model as a controllable scenario generator to create realistic long-tail driving interactions for closed-loop evaluation. Through inference-time guidance, selected agents are steered toward safety-critical behaviors, including aggressive cut-ins, lead-vehicle braking, and combined longitudinal-lateral interactions, while preserving realistic traffic behaviors. Evaluated in closed-loop nuPlan simulations with independent black-box planners, the generated scenarios expose failure modes that remain hidden under standard benchmarks. Although the SSDS-based planner achieves stronger nominal performance, it experiences larger degradation under these challenging scenarios, demonstrating that benchmark superiority does not necessarily translate to robustness. These results demonstrate that a single learned traffic prior can simultaneously improve motion planning and provide a realistic framework for systematic planner robustness evaluation.

Figures & tables

Explore similar work

CardsList
  1. Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation

    Jun 25, 2026Shubham Vaijanath Phoolari, Aleyna Kara, Christoph Lauer +1Diffusion GuidanceDiffusion Model Acceleration

  2. End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation

    Jul 21, 2026Jingzheng Li, Yufei Ge, Zhijun Chen +8Autonomous Driving Safety EvaluationAutonomous Driving Simulation

  3. Diffusion Forcing Planner: History-Annealed Planning with Time-Dependent Guidance for Autonomous Driving

    Jun 9, 2026Zehan Zhang, Neng Zhang, Yaoyi Li +2Diffusion-Based PlanningMotion Planning