cs.AINov 5, 2026

GuidedWAM: Training-Free Energy Guidance for World Action Models in Autonomous Driving

Authors: Xiyan Su, Finn Rasmus Schäfer, Hojun Lim, Frank Diermeyer, Johannes Betz, Markus Lienkamp

Organizations: Institute of Automotive Technology (FTM), Technical University of Munich, Germany · Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, Germany · Professorship of Autonomous Vehicle Systems (AVS), Technical University of Munich, Germany

Abstract

World action models (WAMs) for autonomous driving couple the driving policy and the visual world model in a single generative network whose objectives are fixed post-training. Conditioning on a new driving objective requires retraining. We study energy guidance as a general mechanism and present GuidedWAM, a model-agnostic framework for injecting driving objectives into frozen WAMs at sampling time. Our framework constructs each objective as differentiable energies on the sampler's intermediate clean-action estimate, which needs only forward access to the frozen model, and is stabilized by sampling-time guidance scheduling, per-energy normalization, and velocity-bounded correction. On the NAVSIM v2 hard-split, guidance improves all three frozen, publicly released WAMs by 1.8 to 3.6 EPDMS, averaged over three sampler seeds, and adds less than 10% to the sampling time per step. These results position energy guidance as a practical post-training control channel for WAMs.

Figures & tables

Explore similar work

CardsList
  1. SimWAM: A Simple World Action Model for End-to-End Autonomous Driving

    Aug 7, 2026Zongchuang Zhao, Xin Zhou, Tianyang Xu +6End-to-End Autonomous DrivingAutonomous Driving

  2. Latent-WAM++: Shaping World and Action Representations for End-to-End Autonomous Driving

    Nov 7, 2026Yichen Zhang, Yupeng Zheng, Linbo Wang +10End-to-End Autonomous DrivingWorld Models for Autonomous Driving