Retrieval-Augmented Generation (RAG) over Knowledge Graphs (KGs) suffers from the fact that indexing approaches may lose important contextual nuance when text is reduced to triples, thereby degrading performance in downstream Question-Answering (QA) tasks, particularly for multi-hop QA, which requires composing answers from multiple entities, facts, or relations. We propose a domain-agnostic, KG-based QA framework that covers both the indexing and retrieval/inference phases. A new indexing approach called Map-Disambiguate-Enrich-Reduce (MDER) generates context-derived triple descriptions and subsequently integrates them with entity-level summaries, thus avoiding the need for explicit traversal of edges in the graph during the QA retrieval phase. Complementing this, we introduce Decompose-Resolve (DR), a retrieval mechanism that decomposes user queries into resolvable triples and grounds them in the KG via iterative reasoning. Together, MDER and DR form an LLM-driven QA pipeline that is robust to sparse, incomplete, and complex relational data. Experiments show that on standard and domain specific benchmarks, MDER-DR achieves substantial improvements over standard RAG baselines (up to 66%), while maintaining cross-lingual robustness. Our code is available at https://github.com/DataSciencePolimi/MDER-DR_RAG.
Figures & tables
Figure 1: High‑level overview of our KG-based question answering framework, featuring the MDER indexing approach for condensing multi‑hop information during KG construction so that downstream retrieval does not need explicit hop traversal, and the DR retrieval mechanism for resolving queries through structured graph reasoning using MDER summaries, allowing multi‑entity reasoning without explicit KG path traversal.
Figure 2: Indexing pipeline including the Map‑Disambiguate‑Enrich‑Reduce (MDER) workflow. It begins with preprocessing, where input documents are segmented, summarized, and translated. The core pipeline then proceeds through: (1) Map extracts subject‑predicate‑object triples; (2) Disambiguate unifies fragmented or redundant entities; (3) Enrich adds contextual descriptions to triples; and (4) Reduce generates entity-centric summaries. The final output is a structured graph of interconnected document, chunk, entity, relationship, and triple nodes, optimized for downstream KG tasks, built upon a domain-agnostic RDF/OWL ontology.
Figure 3: Retrieval pipeline, including the Decompose-Resolve (DR) approach. It begins with a user query, which is translated into English. DR then produces a set of placeholder-augmented triples from that question and grounds each placeholder in KG entities through a retrieval and reasoning loop. Resolved entities are propagated across triples, and supporting evidence is accumulated throughout the resolution process. Once all placeholders are resolved, a final answer is synthesized using accumulated summaries.
Dataset
Evaluator
Match
LLM-only
Vector-RAG
GraphRAG
MDER-DR
Δ (%)
WikiQA
LLM-as-a-Judge
✓
0.412 ± 0.021
0.477 ± 0.022
0.422 ± 0.022
0.790 ± 0.012
66%
WikiQA
LLM-as-a-Judge
0.363 ± 0.012
0.476 ± 0.013
0.424 ± 0.013
0.698 ± 0.011
47%
WikiQA
Soft EM
✓
0.510 ± 0.022
0.538 ± 0.022
0.510 ± 0.022
0.800 ± 0.018
49%
WikiQA
Soft EM
0.408 ± 0.013
0.538 ± 0.013
0.516 ± 0.013
0.699 ± 0.012
30%
HotpotQA
LLM-as-a-Judge
✓
0.565 ± 0.021
0.610 ± 0.021
0.606 ± 0.021
0.667 ± 0.021
9%
HotpotQA
LLM-as-a-Judge
0.515 ± 0.012
0.578 ± 0.013
0.582 ± 0.012
0.659 ± 0.012
13%
Table 1: Evaluation scores on WikiQA, HotpotQA, and BenchEE grouped by evaluation method and language match/mismatch. Δ(%) indicates the percentage improvement in the score of MDER-DR compared with the best baseline.
Metric
Match
Mismatch
Soft EM
0.564±0.103
0.497±0.104
LLM-as-a-Judge
0.635±0.144
0.597±0.135
Table 2: Performance comparison based on language match vs. mismatch according to LLM-as-a-Judge and Soft EM methods.
Architecture
Match
Mismatch
LLM-only
0.696±0.029
0.636±0.029
Vector-RAG
0.762±0.034
0.624±0.038
GraphRAG
0.775±0.036
0.734±0.039
MDER-DR
0.910±0.023
0.909±0.023
Table 3: Human evaluation results on BenchEE, based on judgments from three energy‑domain experts.
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
Figure 4: Performance evaluation across different datasets and metrics. Results are shown for WikiQA, HotpotQA, and BenchEE datasets using the scores obtained with LLM-as-a-Judge and Soft EM, comparing language match vs. language mismatch conditions.
Multi-hop question answering studies how systems combine evidence across documents, facts, or modalities to answer questions requiring linked reasoning.
Retrieval-augmented multi-hop question answering (QA) decomposes a query into sub-questions and decomposes the corpus into smaller retrieval units such as sentences. Both forms of decomposition improve the pipeline, but we show that both share the same vulnerability, the loss of entity information, and that this loss breaks the pipeline at two separate points. The first point is retrieval, where a sub-question loses the entity resolved at the previous hop, leaving the retriever with nothing to match against. The second point is harder to see, because retrieval still appears to succeed. Once a passage is split into sentences, an isolated sentence loses the context that grounds its pronouns, so even with the correct sentence in hand the LLM cannot tell which entity the sentence is about. We isolate this second point as a distinct failure mode that we call lost-in-generation, and a retrieval-controlled experiment shows that it degrades answers even when the gold evidence is fixed in the context. We then propose Dual Entity Recovery RAG (DER-RAG), which keeps the grounding entity explicit from retrieval through to generation with two lightweight components, a two-way query decomposition that carries the resolved entity across sub-questions and a subject entity prefix attached to each sentence at generation time. DER-RAG needs no graph construction, no corpus modification, and no fine-tuning, yet on three multi-hop QA benchmarks it matches or exceeds strong baselines, including graph-based methods that depend on costly offline structures.
Multi-hop question answering (QA) requires reasoning across multiple documents, yet existing retrieval-augmented generation (RAG) approaches address this either through graph-based methods requiring additional online processing or iterative multi-step reasoning. We present IndexRAG, a novel approach that shifts cross-document reasoning from online inference to offline indexing. IndexRAG identifies bridge entities shared across documents and generates bridging facts as independently retrievable units, requiring no additional training or fine-tuning. Experiments on three widely-used multi-hop QA benchmarks (HotpotQA, 2WikiMultiHopQA, MuSiQue) show that IndexRAG improves F1 over Naive RAG by 4.6 points on average, while requiring only single-pass retrieval and a single LLM call at inference time. When combined with IRCoT, IndexRAG achieves the best average performance among all evaluated methods, including graph-based baselines such as HippoRAG2 and FastGraphRAG, while relying on a flat vector index. Our code is available at https://github.com/Continuum-AI-Corp/IndexRAG .
Zhenghua Bao, Yi Shi
Continuum AI Shanghai, China · Continuum AI San Francisco, CA, USA
Retrieval-augmented generation (RAG) frequently integrates knowledge graphs (KGs) for complex multi-hop question answering. However, their performance is increasingly bottlenecked by the knowledge structuring and reasoning processes. (i) Severe semantic loss: Distilling continuous texts into discrete symbols strips away contextual nuances and narrative coherence. (ii) Pronounced modality mismatch: Fragmented graph structures clash with the continuous texts LLMs are pre-trained on, while rewriting them into natural language introduces generative noise and omits information. To address these limitations, we propose ThreadRAG, a semantic-topology-based RAG framework for context-preserving knowledge structuring and modality-native evidence reasoning. ThreadRAG introduces a Semantic Topology Mapper (STM), which organizes retrieved documents into context-intact Semantic Nodes and constructs a Semantic Topology Graph (STG) through narrative, semantic, and lexical edges. It further incorporates Energy-Driven Pathfinding (EDP), which identifies query-relevant subgraphs via energy diffusion and deterministically linearizes them into coherent textual evidence paths. Experiments on three multi-hop QA benchmarks demonstrate that ThreadRAG consistently outperforms strong baselines. Notably, it achieves a 14.4% EM improvement over text-centric methods on HotpotQA and surpasses the best baseline by 5.8% EM on 2WikiMultihop, while reducing token cost to 23.3% of the strongest baseline.
Yufeng Li, Zaijing Li, Fuchen Zhang +3
Central South University, Changsha, China · Harbin Institute of Technology, Shenzhen, China