RoadState: A Domain-Prior-Enhanced Vision-Language System for Industrial-Grade Lane-Level Map Updating
Organizations: Tsinghua University, Beijing, China · Baidu Inc., Beijing, China · University of Macau, Macau, China
Abstract
Lane-level map updating requires temporally consistent, physically valid, and auditable road-scene semantics despite occlusions, ambiguous lane markings, temporary obstacles, and viewpoint changes. We present RoadState, a production-deployed vision-language system that transforms sequential road-scene observations into structured lane-level semantics for Baidu Maps' map-updating pipeline. Its core model, RoadState-VLM, formulates road-scene understanding as autoregressive state estimation, predicting the current structured road state from the previous observation and symbolic state together with the current observation. We introduce Geometric Chain-of-Thought (Geo-CoT), which uses a directed acyclic graph of semantic dependencies as a domain prior to improve semantic consistency and reasoning fidelity across interdependent road-state dimensions. Extensive experiments on a real-world dataset show that RoadState-VLM achieves 94.33% mean accuracy across six road-state dimensions, outperforming the strongest fine-tuned VLM baseline. Ablation studies further demonstrate the complementary effectiveness of Geo-CoT and temporal transition context. A cascaded routing pipeline directs routine cases to lightweight models while reserving complex cases for RoadState-VLM. Since its deployment in March 2025, RoadState has supported lane-level map updating across more than 360 cities and reduced overall production costs by 30%. Together with human-in-the-loop auditing, the system maintains robust performance under stress-test conditions. These results demonstrate how domain-prior-enhanced reasoning, structured state interfaces, selective routing, and human quality control can bridge the gap between VLM-based road-scene understanding and large-scale lane-level map updating.
Figures & tables
| Model Variant | VRAM (GB) | Latency (s) | FPS | Mean Acc. (%) |
|---|---|---|---|---|
| Qwen3-VL-4B-Thinking | 13.0 | 22.6 | 0.088 | 92.10 |
| RoadState-VLM (8B) | 21.8 | 23.5 | 0.085 | 94.33 |
| Model | Lane Count | Ego-lane Index | Struct Feasibility | Vehicle Feasibility | Obstacle Feasibility | Global Feasibility | Overall | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Acc | P | R | Acc | P | R | Acc | P | R | Acc | P | R | Acc | P | R | Acc | P | R | Acc | P | R | |
| RoadSceneBench | - | 63.37 | 65.89 | - | 75.44 | 84.67 | - | - | - | - | - | - | - | - | - | - | 83.83 | 84.69 | - | 74.21 | 78.42 |
| LLaVA-Next-8B | 76.96 | 65.66 | 49.65 | 92.66 | 68.23 | 55.99 | 91.14 | 91.01 | 90.96 | 90.51 | 64.63 | 65.84 | 99.79 | 83.25 | 66.65 | 87.22 | 86.12 | 86.88 | 89.71 | 76.48 | 69.33 |
| LLaVA-1.5-7B | 86.33 | 73.10 | 67.09 | 94.18 | 54.38 | 49.06 | 91.56 | 91.84 | 91.02 | 93.08 | 73.20 | 61.69 | 98.61 | 55.67 | 82.68 | 88.82 | 87.84 | 88.48 | 92.10 | 72.67 | 73.34 |
| Qwen2.5-VL-7B | 52.49 | 52.14 | 44.33 | 67.26 | 74.07 | 64.75 | 78.19 | 81.44 | 75.79 | 94.22 | 90.04 | 60.64 | 99.83 | 99.92 | 66.67 | 77.34 | 77.40 | 72.75 | 78.22 | 79.17 | 64.15 |
| Qwen3-VL-4B-Thinking | 90.20 | 72.85 | 66.94 | 92.50 | 65.71 | 61.83 | 91.80 | 91.42 | 91.35 | 93.50 | 81.76 | 70.92 | 99.40 | 77.31 | 99.18 | 85.20 | 84.06 | 84.73 | 92.10 | 78.85 | 79.16 |
| Variant | Components | State Dimension Accuracy (%) | Mean Acc. (%) | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Geo-CoT | Historical State | Lane Count | Ego Index | Str. Feas. | Veh. Feas. | Obs. Feas. | Global Feas. | ||
| M1 (Single-Frame Description) | Single-frame | 68.69 | 71.56 | - | - | - | 61.94 | – | |
| M2 (Single-Frame + CoT) | Single-frame | 68.10 | 75.36 | 79.33 | 91.31 | 99.24 | 77.64 | 81.83 | |
| M3 (State Prediction (Direct)) | Multi-frame | 79.32 | 82.03 | 88.48 | 96.12 | 99.75 | 86.54 | 88.71 | |
| M4 (RoadState-VLM) | Multi-frame | 91.90 | 94.60 | 94.31 | 95.15 | 99.70 | 90.34 | 94.33 | |
| Model Variant | Lane Count | Ego Index | Str. Feas. | Veh. Feas. | Obs. Feas. | Global Feas. | Mean Acc. (%) |
|---|---|---|---|---|---|---|---|
| Qwen3-VL-Instruct-8B (No CoT) | 77.50 | 81.10 | 83.20 | 94.00 | 99.00 | 84.20 | 86.50 |
| Qwen3-VL-Instruct-8B (Geo-CoT) | 92.32 | 94.35 | 84.89 | 95.57 | 99.54 | 91.01 | 92.95 |
| Qwen3-VL-Thinking-8B (No CoT) | 79.32 | 82.03 | 88.48 | 96.12 | 99.75 | 86.54 | 88.71 |
| RoadState-VLM | 91.90 | 94.60 | 94.31 | 95.15 | 99.70 | 90.34 | 94.33 |
| Variant | Lane Count | Ego Index | Str. Feas. | Veh. Feas. | Obs. Feas. | Global Feas. | Mean Acc. |
|---|---|---|---|---|---|---|---|
| w/o Logical Override | 88.12 | 90.30 | 91.05 | 92.50 | 99.12 | 89.80 | 91.82 |
| w/o Historical State Feedback (M2) | 68.10 | 75.36 | 79.33 | 91.31 | 99.24 | 77.64 | 81.83 |
| RoadState-VLM Full | 91.90 | 94.60 | 94.31 | 95.15 | 99.70 | 90.34 | 94.33 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
VLMs for Autonomous Driving
Vision-language models for autonomous driving connect camera and sensor data with language to interpret scenes, predict hazards, and plan actions.
See all 214 papers