cs.AINov 11, 2026

Towards Robust Vision-Language Reasoning: A Multi-Stage Optimization Pipeline with Masked Diffusion Model

Authors: Shunming Liu, Pei Huang, Yajing Sun, Huaxiao Liu

Organizations: College of Computer Science and Technology, Jilin University, Changchun, China · Yinwang Intelligent Technology Co., Ltd., Huawei, China · Stanford University, USA

Abstract

Discrete diffusion generation is emerging as a competitive alternative to autoregressive generation by denoising the entire token sequence through iterative refinement. Its global planning and progressive correction capabilities are particularly well suited to autonomous driving. However, transferring this generation paradigm from general-purpose settings to driving introduces substantial domain gaps in both training and inference. To unlock its potential, we propose a multi-stage optimization pipeline for standard vision-language model architectures, without auxiliary action experts or specialized mixture-of-experts Transformer, spanning post-training and inference. During supervised fine-tuning, we optimize the representation of planning inputs to suppress hallucinations in task responses. During reinforcement learning, we introduce metric-guided diversity filtering to identify stronger learning starting points and improve policy exploration. At inference time, we propose Dynamic Autonomous Driving Decoding (DAD), which adaptively adjusts decoding modes according to scene complexity. Based on this pipeline, we develop Masked Diffusion Drive (MD-Drive), improving its performance by 29.7% over the unoptimized model. Experiments on the NAVSIM closed loop benchmark and the nuScenes and DriveCoT open loop datasets show that MD-Drive outperforms autoregressive VLM baselines with the same architecture, while achieving a more favorable balance between performance and computational cost than systems with different architectures through discrete diffusion training and inference.

Figures & tables

Explore similar work

CardsList
  1. DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving

    Feb 16, 2026Chenxu Dang, Sining Ang, Yongkang Li +7VLMs for Autonomous DrivingDiffusion-Based Planning

  2. Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion

    Feb 24, 2026Jiaru Zhang, Manav Gagvani, Can Cui +3Autonomous Driving PlanningEnd-to-End Autonomous Driving

  3. OneDrive: Unified Multi-Paradigm Driving with Vision-Language-Action Models

    Apr 20, 2026Yiwei Zhang, Xuesong Chen, Jin Gao +5VLMs for Autonomous DrivingEnd-to-End Autonomous Driving