cs.ROMay 22, 2025

Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models

Authors: Augusto Luis Ballardini, Miguel Ángel Sotelo

Organizations: All authors are with the Computer Engineering Department, University of Alcalá, Alcalá de Henares, Madrid, Spain.

Abstract

Achieving full automation in self-driving vehicles remains a challenge, especially in dynamic urban environments where navigation requires real-time adaptability. Existing systems struggle to handle navigation plans when faced with unpredictable changes in road layouts, spontaneous detours, or missing map data, due to their heavy reliance on predefined cartographic information. In this work, we explore the use of Large Language Models to generate Answer Set Programming rules by translating informal navigation instructions into structured, logic-based reasoning. ASP provides non-monotonic reasoning, allowing autonomous vehicles to adapt to evolving scenarios without relying on predefined maps. We present an experimental evaluation in which LLMs generate ASP constraints that encode real-world urban driving logic into a formal knowledge representation. By automating the translation of informal navigation instructions into logical rules, our method improves adaptability and explainability in autonomous navigation. Results show that LLM-driven ASP rule generation supports semantic-based decision-making, offering an explainable framework for dynamic navigation planning that aligns closely with how humans communicate navigational intent.

Figures & tables

Explore similar work

CardsList
  1. KnowDiffuser: A Knowledge-Guided Diffusion Planner with LLM Reasoning

    Mar 11, 2026Fan Ding, Xuewen Luo, Fengze Yang +4Autonomous Driving PlanningDiffusion-Based Planning

  2. NaviDriveVLM: Decoupling High-Level Reasoning and Motion Planning for Autonomous Driving

    Mar 9, 2026Ximeng Tao, Pardis Taghavi, Dimitar Filev +2VLMs for Autonomous DrivingAutonomous Driving Planning

  3. From Language to Logic: A Theoretical Architecture for VLM-Grounded Safe Navigation

    May 5, 2026Kristy Sakano, Kalonji Harrington, Mumu XuRoboticsSafe Robot Navigation