cs.AIMar 3, 2026

LLM-MLFFN: Multi-Level Autonomous Driving Behavior Feature Fusion via Large Language Model

Authors: Xiangyu Li, Tianyi Wang, Xi Cheng, Rakesh Chowdary Machineni, Zhaomiao Guo, Sikai Chen, Junfeng Jiao, Christian Claudel

Organizations: Department of Civil, Architectural, and Environmental Engineering, The University of Texas at Austin, Austin, TX 78712, USA. · Systems Engineering Program, Cornell University, Ithaca, NY 14850, USA. · Department of Electrical and Computer Engineering, University of Michigan, Ann Arbor, MI 48109, USA. · Department of Civil and Environmental Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA. · 

Abstract

Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing approaches primarily rely on numerical time-series modeling and often lack semantic abstraction, limiting interpretability and robustness in complex traffic environments. This paper presents LLM-MLFFN, a novel large language model (LLM)-enhanced multi-level feature fusion network designed to address the complexities of multi-dimensional driving data. The proposed LLM-MLFFN framework integrates priors from largescale pre-trained models and employs a multi-level approach to enhance classification accuracy. LLM-MLFFN comprises three core components: (1) a multi-level feature extraction module that extracts statistical, behavioral, and dynamic features to capture the quantitative aspects of driving behaviors; (2) a semantic description module that leverages LLMs to transform raw data into high-level semantic features; and (3) a dual-channel multi-level feature fusion network that combines numerical and semantic features using weighted attention mechanisms to improve robustness and prediction accuracy. Evaluation on the Waymo open trajectory dataset demonstrates the superior performance of the proposed LLM-MLFFN, achieving a classification accuracy of over 94%, surpassing existing machine learning models. Ablation studies further validate the critical contributions of multi-level fusion, feature extraction strategies, and LLM-derived semantic reasoning. These results suggest that integrating structured feature modeling with language-driven semantic abstraction provides a principled and interpretable pathway for robust autonomous driving behavior classification.

Figures & tables

Explore similar work

CardsList
  1. LAD-Drive: Bridging Language and Trajectory with Action-Aware Diffusion Transformers

    Mar 2, 2026Fabian Schmidt, Karol Fedurko, Markus Enzweiler +1Language-Conditioned Robot PlanningAutonomous Driving Planning

  2. CommandLM: Data driven behavior level descriptor for ego vehicles

    Jul 24, 2026Boris Tokic, Constantin Selzer, Fabian B. FlohrVLMs for Autonomous DrivingAutonomous Driving

  3. BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations

    Mar 6, 2026Thomas Monninger, Shaoyuan Xie, Qi Alfred Chen +1VLMs for Autonomous DrivingEnd-to-End Autonomous Driving