cs.CVSep 3, 2026

SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving

Authors: Jinyang WangShiwei LiJunjian WangZhiqiang DengJianbin GaoYihang ZhaoLiu LiuYongjia Zhao+7 more

Organizations: Institute of Automation, Chinese Academy of Sciences · 2Chongqing Changan Technology Co., Ltd. · 3Civil Aviation University of China · 4Beihang University · 5Guilin University of Electronic92 Technology

Abstract

World models (WMs) have demonstrated strong potential for end-to-end autonomous driving by learning predictive representations of future scene dynamics. However, generating future videos during inference introduces substantial computational overhead, leading many recent driving WMs to adopt a single front camera as input for efficient deployment. This design restricts spatial coverage in safety-critical maneuvers such as lane changes, merges, and turns. To address this limitation, we propose SV-WAM, a surround-view world-action model (WAM) that preserves full six-camera observations while maintaining efficient inference. SV-WAM leverages future-video prediction as dense training supervision for action learning within a shared generative model, rather than as an inference-time output. At the core of this design is an action-centered causal mask that prevents action tokens from attending to future-video tokens during joint action-video denoising. Consequently, the video branch can be discarded at deployment, enabling efficient action-only planning. Furthermore, we introduce a differentiable drivable-area compliance regularizer that penalizes vehicle-footprint corners approaching or crossing drivable boundaries, improving planning safety and boundary awareness. Extensive experiments on the closed-loop NAVSIMv2 benchmark and the open-loop nuScenes benchmark demonstrate that SV-WAM achieves state-of-the-art planning performance with low inference latency and competitive zero-shot transfer capability.

Explore similar work

CardsList
  1. DriveVA: Video Action Models are Zero-Shot Drivers

    Apr 5, 2026Mengmeng Liu, Diankun Zhang, Jiuming Liu +7Autonomous DrivingDrives