From Structured Graphs to Unstructured Evidence: Agentic Root Cause Analysis on Digital Twins
Organizations: Ni2 Innovation Lab
Abstract
Root cause analysis over telecom and datacenter infrastructures is commonly addressed by methods that consume structured data, from graph traversal and rule-based correlation to probabilistic and learned models. Yet a digital twin of such an infrastructure cannot model everything at a reasonable cost. Operators therefore record much of what changes as unstructured data attached to the graph, where the discriminating evidence often sits. Methods restricted to structured attributes cannot use it. A diagnosis needs a layer that interprets this data. An agentic layer is a natural candidate, since which fragment matters depends on hypotheses that emerge during the investigation. We demonstrate its feasibility with ReAct, the most widely used agentic architecture. A single LLM interprets the descriptions and explores the graph through a typed tool interface exposed via the Model Context Protocol (MCP). On a benchmark of nine synthetic scenarios covering single-node, multi-node and distractor-heavy evidence (360 runs across four LLMs), a frontier-tier model names the root cause and its type on every run. It reaches 96.7% end-to-end diagnostic accuracy, which also requires the exact supporting evidence. A mid-tier model reaches 86.7%. Accuracy drops for every model when the evidence must be combined across several resources.
Figures & tables
| Model | Root cause | Evidence match | Cause type | Full diag. |
|---|---|---|---|---|
| Claude Opus 4.7 | 100/100/100/ 100 | 100/90/100/ 97 | 100/100/100/ 100 | 100/90/100/ 97 |
| Claude Haiku 4.5 | 100/63/100/ 88 | 100/90/100/ 97 | 100/100/97/ 99 | 100/63/97/ 87 |
| Llama 3.3 70B | 97/34/97/ 76 | 97/48/97/ 81 | 100/97/100/ 99 | 97/10/97/ 68 |
| GPT-OSS-120B | 70/47/73/ 63 | 70/43/70/ 61 | 70/80/70/ 73 | 70/27/70/ 56 |
| Model | Hallucination rate | Protocol compliance | Tool misuse |
|---|---|---|---|
| Claude Opus 4.7 | 0.00% | 100.0% | 0.00% |
| Claude Haiku 4.5 | 0.00% | 100.0% | 0.00% |
| Llama 3.3 70B | 0.00% | 100.0% | 0.00% |
| GPT-OSS-120B | 2.11% | 100.0% | 0.00% |
| Model | Tok. in | Tok. out | Total | Iter. | Full diag. |
|---|---|---|---|---|---|
| Claude Opus 4.7 | 20 555 | 1 612 | 22 166 | 5.0 | 96.7% |
| Claude Haiku 4.5 | 15 833 | 1 346 | 17 179 | 5.0 | 86.7% |
| Llama 3.3 70B | 14 662 | 441 | 15 103 | 6.2 | 68.2% |
| GPT-OSS-120B | 22 069 | 1 086 | 23 155 | 11.1 | 55.6% |
Root Cause Analysis
Root cause analysis identifies the initiating faults behind observed failures by tracing symptoms through causal and system dependencies.
See all 88 papers