Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models
Organizations: All authors are with the Computer Engineering Department, University of Alcalá, Alcalá de Henares, Madrid, Spain.
Abstract
Achieving full automation in self-driving vehicles remains a challenge, especially in dynamic urban environments where navigation requires real-time adaptability. Existing systems struggle to handle navigation plans when faced with unpredictable changes in road layouts, spontaneous detours, or missing map data, due to their heavy reliance on predefined cartographic information. In this work, we explore the use of Large Language Models to generate Answer Set Programming rules by translating informal navigation instructions into structured, logic-based reasoning. ASP provides non-monotonic reasoning, allowing autonomous vehicles to adapt to evolving scenarios without relying on predefined maps. We present an experimental evaluation in which LLMs generate ASP constraints that encode real-world urban driving logic into a formal knowledge representation. By automating the translation of informal navigation instructions into logical rules, our method improves adaptability and explainability in autonomous navigation. Results show that LLM-driven ASP rule generation supports semantic-based decision-making, offering an explainable framework for dynamic navigation planning that aligns closely with how humans communicate navigational intent.
Figures & tables
| ID | Task | Instruction |
| ID0 | Add constraints | Go straight at the first junction, then turn right. |
| ID1 | Add constraints | Turn left at the next junction, then go straight, then turn right. |
| ID2 | Add constraints | Turn right after the first junction |
| ID3 | Generate Rules and constraints | Go straight at the next intersection. |
| LLM Model | Syntax | Semantic | Lines |
|---|---|---|---|
| ChatGPT4-o | ✓ | ✓ | 7 |
| Grok 3 | ✓ | ✓ | 8 |
| Gemini-2.0-Flash | ✓ | ✓ | 6 |
| Meta Llama4 | ✓ | ✓ | 8 |
| Qwen2.5-Max | ✗ | ✗ | - |
| Groq Compound Beta Mini | ✓ | ✗ | - |
| LLM Model | Syntax | Semantic | Lines |
|---|---|---|---|
| ChatGPT4-o | ✓ | ✓ | 12 |
| Grok 3 | ✓ | ✓ | 8 |
| Gemini-2.0-Flash | ✓ | ✓ | 11 |
| Meta Llama4 | ✓ | ✓ | 8 |
| Qwen2.5-Max | ✓ | ✓ | 10 |
| Groq Compound Beta Mini | ✗ | ✗ | - |
| LLM Model | Syntax | Semantic | Lines |
|---|---|---|---|
| ChatGPT4-o | ✓ | ✓ | 6 |
| Grok 3 | ✓ | ✓ | 8 |
| Gemini-2.0-Flash | ✗ | ✗ | - |
| Meta Llama4 | ✓ | ✓ | 8 |
| Qwen2.5-Max | ✓ | ✓ | 9 |
| Groq Compound Beta Mini | ✗ | ✗ | - |
Autonomous Driving
Autonomous driving develops vehicles that perceive road scenes, predict interactions, and plan and control safe movement with limited or no human input.
See all 576 papers