cs.CVNov 18, 2026

TrajWAM: Trajectory-Conditioned Future Learning for Vision-Language Driving

Authors: Xuerui Fang, Gulimila Kezierbieke, Chen Wangxing, Hui Li

Organizations: Xinjiang Agricultural University · ToReality (Hangzhou) Network Technology Co., Ltd. · Jiangnan University

Abstract

World Action Models (WAMs) connect future scene prediction with action planning for autonomous driving. Each driving record pairs an executed ego trajectory with its observed future, providing a factual outcome for learning this connection. We present TrajWAM, a trajectory-conditioned WAM that improves vision-language driving through auxiliary bird's-eye-view (BEV) future learning. An ego-trajectory query conditions DINOv3-aligned BEV predictions from shared planner representations. Training combines factual reconstruction under the executed trajectory with one-sided feature separation under an unlabeled perturbed trajectory. Together, these objectives train the shared planner to generate driving waypoints. Native inference directly generates waypoints and bypasses the auxiliary future-prediction branch. On all 220 Bench2Drive routes, TrajWAM achieves 91.53 Driving Score and 75.45% Success Rate, exceeding a schedule-matched planning-only fine-tuning baseline by 5.31 Driving Score points and eight successful routes.

Figures & tables

Appendix figures & tables17 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. DA-WAM: Decision-Aligned Future Latents for Driving World Models

    Aug 19, 2026Ruiguo Zhong, Xiaolong Chen, Benshan Ma +5World Models for Autonomous DrivingAutonomous Driving Planning

  2. DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving

    Oct 13, 2026Shuzheng Wang, Haoxuan Li, Shengzhen Li +5Mixture-of-TransformersAutonomous Driving Planning

  3. SimWAM: A Simple World Action Model for End-to-End Autonomous Driving

    Aug 7, 2026Zongchuang Zhao, Xin Zhou, Tianyang Xu +6End-to-End Autonomous DrivingAutonomous Driving