Enhancing Large Language Models (LLMs) for Telecom using Dynamic Knowledge Graphs and Explainable Retrieval-Augmented Generation
Organizations: Charlie · School of Computer Science, McGill University, Montreal, QC H3A 0E9, Canada. · Standards and Mobility Innovation Lab, Samsung Research America, Plano, Texas, TX 75023, USA.
Abstract
Large language models (LLMs) have shown strong potential across a variety of tasks, but their application in the telecom field remains challenging due to domain complexity, evolving standards, and specialized terminology. Therefore, general-domain LLMs may struggle to provide accurate and reliable outputs in this context, leading to increased hallucinations and reduced utility in telecom operations.To address these limitations, this work introduces KG-RAG-a novel framework that integrates knowledge graphs (KGs) with retrieval-augmented generation (RAG) to enhance LLMs for telecom-specific tasks. In particular, the KG provides a structured representation of domain knowledge derived from telecom standards and technical documents, while RAG enables dynamic retrieval of relevant facts to ground the model's outputs. Such a combination improves factual accuracy, reduces hallucination, and ensures compliance with telecom specifications.Experimental results across benchmark datasets demonstrate that KG-RAG outperforms both LLM-only and standard RAG baselines, e.g., KG-RAG achieves an average accuracy improvement of 14.3% over RAG and 21.6% over LLM-only models. These results highlight KG-RAG's effectiveness in producing accurate, reliable, and explainable outputs in complex telecom scenarios.
Figures & tables
| (a) Static vs Dynamic KG-RAG under streaming updates Method QA acc. (%) Staleness rate (%) Median delay (s) P95 delay (s) Static KG-RAG 72.1 37.8 – – Dynamic KG-RAG 84.0 11.4 5.2 14.7 |
| (b) Efficiency and time cost of KG-RAG on SPEC5G, TeleQnA, and ORAN-Bench-13K Metric SPEC5G TeleQnA ORAN-Bench-13K KG size (triples) 1.2M 0.6M 0.4M One-time KG construction (min) 24.6 13.8 8.9 Incremental update for 100 events (s) 2.3 1.7 1.2 Mean KG-RAG query latency (ms) 1080 860 920 P95 KG-RAG query latency (ms) 1760 1390 1470 |
Knowledge Augmentation for Language Models
Knowledge augmentation for language models adds external or newly learned information to improve factuality, reasoning, and domain performance.
See all 178 papers