Knowledge Graph RAG: Agentic Crawling and Graph Construction in Enterprise Documents
Organizations: Google AI, Global Services Delivery
Abstract
This research paper addresses the limitations of semantic search in complex enterprise document ecosystems. Traditional RAG pipelines often fail to capture hierarchical and interconnected information, leading to retrieval inaccuracies. We propose Agentic Knowledge Graphs featuring Recursive Crawling as a robust solution for navigating superseding logic and multi-hop references. Our benchmark evaluation using the Code of Federal Regulations (CFR) demonstrates that this Knowledge Graph-enhanced approach achieves a 70% accuracy improvement over standard vector-based RAG systems, providing exhaustive and precise answers for complex regulatory queries.
Figures & tables
| Metric | Vector RAG Approach | Knowledge Graph Approach |
|---|---|---|
| Correct/Complete Answers | 5 (25%) | 19 (95%) |
| Incomplete/Inaccurate | 8 (40%) | 1 (5%) |
| Refusals/No Answer | 7 (35%) | 0 (0%) |
| Total Questions | 20 | 20 |
| Question | According to 561.2 from 2002, what constitutes an ’account’, and what are some of the specific, distinct types of accounts that fall under this definition? |
|---|---|
| Golden Snippet | 561.2 Account. "T he term account means any savings account, demand account, certificate account, tax and loan account, note account, United States Treasury general account or United States Treasury time deposit-open account , whether in the form of a deposit or a share, held by an account holder in a savings association. " |
| Knowledge Graph Approach Answer | Based on the 2002 version of 561.2, an ’account’ is defined as any savings account, demand account, certificate account, tax and loan account, note account, United States Treasury general account, or United States Treasury time deposit-open account, held by an account holder in a savings association. Specific examples of account types mentioned within this definition include savings accounts, demand accounts, and certificate accounts. |
| KG Score | 57.14% |
| RAG Approach Answer | According to 561.2 from 2002, an "account" means any account established to provide benefits, a pension, a retirement plan, or compensation of any kind. Specific, distinct types of accounts that fall under this definition include: Benefit accounts, Pension accounts, Retirement plan accounts, Compensation accounts. |
| RAG Score | 9.52% |
| Feature | Vector RAG Limitation | Knowledge Graph Advantage |
|---|---|---|
| Structural Awareness | Treats citations as mere text strings; lacks the logic to recognize them as pointers to external authorities. | Models citations as explicit edges between nodes, allowing deterministic traversal of the regulatory web. |
| Temporal Precision | Struggles to differentiate between semantically similar chunks from different years, leading to versioning errors. | Encodes temporal attributes (e.g., has_version or valid_in_year ) as metadata or nodes to isolate specific timeframes. |
| Logical Relationships | Relies on semantic proximity, which often fails to capture "logical leaps" like exemptions or negations. | Explicitly maps relational logic (e.g., IS_CONSTRAINED_BY or DEFINES ), ensuring the model respects the hierarchy of definitions. |
Graph Retrieval-Augmented Generation
Graph Retrieval-Augmented Generation connects language models to knowledge graphs to retrieve relational evidence for grounded, multi-hop answers.
See all 232 papers