cs.CVNov 16, 2026

AR-WAM: efficient streaming world-action modeling for autonomous driving

Authors: Baiting Luo, Shatadal Mishra, Ahmadreza Moradipari, Nejib Ammar

Organizations: Toyota Motor North America R&D - InfoTech Labs

Abstract

Autonomous driving requires anticipating how traffic will evolve while responding quickly to new observations. Video foundation models offer the first ability, but repeated history encoding and iterative video generation make them costly to use for driving. We present AR-WAM, an efficient streaming world-action model that combines autoregressive temporal modeling with single-pass future conditioning. Because its video backbone is causal, AR-WAM updates its visual context incrementally, reusing past computation and conditioning future prediction on observed motion. We further hypothesize that future features computed from recent observations can improve generalization in dynamic traffic without iterative video generation. AR-WAM therefore obtains these features in one forward pass and uses them to condition trajectory generation, and reinforcement learning then improves the policy through direct optimization of driving rewards. With a single front camera, AR-WAM achieves 91.5 PDMS after supervised training and 94.0 after reinforcement learning on NAVSIM-v1, outperforming the compared strong end-to-end world-action models. In a dynamic setting of continuous driving, supervised AR-WAM keeps its visual history across decisions and outperforms strong world-action baselines.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving

    May 27, 2026Chen Shi, Jinrui Xu, Shaoshuai Shi +3Video Diffusion ModelsEnd-to-End Autonomous Driving

  2. SimWAM: A Simple World Action Model for End-to-End Autonomous Driving

    Aug 7, 2026Zongchuang Zhao, Xin Zhou, Tianyang Xu +6End-to-End Autonomous DrivingAutonomous Driving