cs.AIMar 11, 2026

A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms

Authors: Kejin Yu, Yuhan Sun, Taiqiang Wu, Ruixu Zhang, Zhiqiang Lin, Yuxin Meng, Junjie Wang, Yujiu Yang

Organizations: 1Tsinghua University · East China Normal University · 3The University of Hong Kong

Abstract

The development of high-level autonomous driving (AD) is shifting from perception-centric limitations to a more fundamental bottleneck, namely, a deficit in robust and generalizable reasoning. Although current AD systems manage structured environments, they consistently falter in long-tail scenarios and complex social interactions that require human-like judgment. Meanwhile, the advent of large language and multimodal models (LLMs and MLLMs) presents a transformative opportunity to integrate a powerful cognitive engine into AD systems, moving beyond pattern matching toward genuine comprehension. However, a systematic framework to guide this integration is critically lacking. To bridge this gap, we provide a comprehensive review of this emerging field and argue that reasoning should be elevated from a modular component to the system's cognitive core. Specifically, we first propose a novel Cognitive Hierarchy to decompose the monolithic driving task according to its cognitive and interactive complexity. Building on this, we further derive and systematize seven core reasoning challenges, such as the responsiveness-reasoning trade-off and social-game reasoning. Furthermore, we conduct a dual-perspective review of the state-of-the-art, analyzing both system-centric approaches to architecting intelligent agents and evaluation-centric practices for their validation. Our analysis reveals a clear trend toward holistic and interpretable "glass-box" agents. In conclusion, we identify a fundamental and unresolved tension between the high-latency, deliberative nature of LLM-based reasoning and the millisecond-scale, safety-critical demands of vehicle control. For future work, a primary objective is to bridge the symbolic-to-physical gap by developing verifiable neuro-symbolic architectures, robust reasoning under uncertainty, and scalable models for implicit social negotiation.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving

    Mar 2, 2026Enhui Ma, Jiahuan Zhang, Guantian Zheng +10Autonomous Driving BenchmarksVLMs for Autonomous Driving

  2. LUNA-AD: Lightweight Uncertainty-Aware Language Model with Lifelong Learning for Autonomous Driving

    Jun 7, 2026Ruoyu Yao, Pei Liu, Ruiguo Zhong +3Continual Learning for LLMsLanguage Model-Based Control

  3. nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving

    May 29, 2026Zhiyu Huang, Johnson Liu, Rui Song +13Autonomous Driving DatasetsAutonomous Driving Benchmarks