cs.ROMar 7, 2026

Kinematics-Aware Latent World Models for Data-Efficient Autonomous Driving

Authors: Jiazhuo Li, Linjiang Cao, Qi Liu, Xi Xiong

Organizations: Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai, China

Abstract

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through latent imagination, existing approaches often lack explicit mechanisms to encode spatial and kinematic structure essential for driving tasks. In this work, we build upon the Recurrent State-Space Model (RSSM) and propose a kinematics-aware latent world model framework for autonomous driving. Vehicle kinematic information is incorporated into the observation encoder to ground latent transitions in physically meaningful motion dynamics, while geometry-aware supervision regularizes the RSSM latent state to capture task-relevant spatial structure beyond pixel reconstruction. The resulting structured latent dynamics improve long-horizon imagination fidelity and stabilize policy optimization. Experiments in a driving simulation benchmark demonstrate consistent gains over both model-free and pixel-based world-model baselines in terms of sample efficiency and driving performance. Ablation studies further verify that the proposed design enhances spatial representation quality within the latent space. These results suggest that integrating kinematic grounding into RSSM-based world models provides a scalable and physically grounded paradigm for autonomous driving policy learning.

Figures & tables

Explore similar work

CardsList
  1. DreamerAD: Efficient Reinforcement Learning via Latent World Model for Autonomous Driving

    Mar 25, 2026Pengxuan Yang, Yupeng Zheng, Deheng Qian +11RL for Autonomous DrivingLatent World Models

  2. Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving

    Mar 25, 2026Linbo Wang, Yupeng Zheng, Qiang Chen +13End-to-End Autonomous DrivingWorld Models for Autonomous Driving