EditWM: Event-Decomposed World Modeling with Incremental Correction for End-to-End Autonomous Driving
Organizations: The Hong Kong University of Science and Technology · Southern University of Science and Technology · The Chinese University of Hong Kong, Shenzhen
Abstract
World models support autonomous driving by predicting the scene evolution associated with candidate trajectories. Driving dynamics differ in predictability, motivating a distinction between regular evolution and event-induced deviations that call for selective correction. We propose EditWM, a world model that decomposes future prediction into normal evolution and event-driven incremental correction in compact visual feature space. A trajectory-conditioned normal predictor provides the base forecast and is then frozen for correction learning. A correction decoder compares this forecast with observation history and planned actions, producing a bounded feature update whose contribution is regulated by a learned gate. The corrected future features condition trajectory scoring through candidate-specific cross-attention, linking world modeling to plan selection. At inference, EditWM uses only past and current observations, ego state, and candidate trajectories. Across all 12,146 NAVSIM navtest scenes, expert-trajectory-conditioned evaluation shows a 5.35% reduction in future-feature MSE over Normal, with improvements in 83.54% of scenes. The system achieves 91.05 EPDMS on a 100-point scale using the official EPDMS evaluator. These results demonstrate improved future-feature prediction and competitive trajectory selection when corrected future representations are integrated into planning.
Figures & tables
| Method | Backbone | NC | DAC | DDC | TL | EP | TTC | LK | HC | EC | EPDMS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Hydra-MDP++ [ 24 ] | ResNet-34 | 98.4 | 98.0 | 99.4 | 99.8 | 87.5 | 97.7 | 95.3 | 98.3 | 77.4 | 85.1 ∗ |
| DiffusionDrive [ 21 ] | ResNet-34 | 98.2 | 96.2 | 99.5 | 99.8 | 87.4 | 97.4 | 97.0 | 98.3 | 87.8 | 84.8 ∗ |
| WoTE [ 9 ] | ResNet-34 | 98.5 | 96.8 | 98.8 | 99.8 | 86.1 | 97.9 | 95.5 | 98.3 | 82.9 | 84.2 |
| iPad [ 25 ] | ResNet-34 | 98.7 | 97.8 | 99.1 | 99.8 | 84.0 | 98.0 | 96.0 | 98.0 | 68.2 | 84.1 |
| DriveSuprim [ 26 ] | ResNet-34 | 97.8 | 97.9 | 99.5 | 99.9 | 90.6 | 97.1 | 96.6 | 98.3 | 77.9 | 86.0 ∗ |
| DiffusionDriveV2 [ 27 ] | ResNet-34 | 97.7 | 96.6 | 99.2 | 99.8 | 88.9 | 97.2 | 96.0 | 97.8 | 91.0 | 87.5 |
| Method | NC | DAC | DDC | TL | EP | TTC | LK | HC | EC | EPDMS |
|---|---|---|---|---|---|---|---|---|---|---|
| w/o Future Features | 97.55 | 98.67 | 99.59 | 99.70 | 87.34 | 96.80 | 94.75 | 98.21 | 96.36 | 90.84 |
| w/o EditWM (Normal-only) | 97.34 | 98.53 | 99.53 | 99.72 | 87.08 | 96.65 | 94.71 | 98.20 | 96.36 | 90.51 |
| Ours | 97.8 | 98.8 | 99.6 | 99.9 | 87.5 | 96.9 | 94.8 | 98.3 | 96.6 | 91.05 |
| Oracle | 99.79 | 99.69 | 99.79 | 99.97 | 95.56 | 99.77 | 99.16 | 98.35 | 97.99 | 97.73 |
| Metric | WoTE (Normal) | EditWM |
|---|---|---|
| Validation MSE | 0.32490 | 0.29693 |
| navtest MSE | 0.39352 | 0.37246 |
| navtest cosine | 0.95078 | 0.95355 |
World Models for Autonomous Driving
World models for autonomous driving predict how scenes and traffic evolve under candidate actions to support planning, control, and simulation.
See all 143 papers