To augment Large Language Models (LLMs) for multi-hop question answering, a mainstream solution within Graph Retrieval Augmented Generation (GraphRAG) leverages lightweight retrievers to efficiently extract information from a given Knowledge Graph (KG). However, existing methods often overlook the inherent challenge of sparse semantic information in graphs. Specifically, our experiments reveal that these methods produce biased retrieval Semantic Shortcut Bias and Long-Tail Path Bias, leading to inadequate semantic modeling and limited GraphRAG effectiveness. To address these issues, we propose STAR, a semantic-tuned and tail-adaptive retriever for GraphRAG. STAR integrates two key learning paradigms: token-level interaction learning and path-weighted contrastive learning. The former employs a cross-attention architecture and a hard path mining mechanism to jointly model the query and path, thereby mitigating the Semantic Shortcut Bias. The latter introduces a tailored contrastive learning objective that utilizes tail-adaptive path weighting, designed to optimize the training process and ease the Long-Tail Path Bias. Extensive experiments demonstrate that STAR consistently outperforms baselines, achieving average retrieval performance gains of 1.8% and LLM QA performance improvements of 2.2% across all benchmark datasets. Our code is available at https://anonymous.4open.science/r/STAR-C583.
Figures & tables
Figure 1. Illustrations of semantic shortcut, where a retriever prefers a semantically similar but incorrect relation.
Figure 2. Long-tail distribution of path frequencies.
Figure 3. Analysis on Semantic Shortcut (Top) and Long-Tail Path Bias (Bottom) on correct and incorrect retrieval subsets. X-axis represents the ratio value (%).
Figure 4. Overview of our STAR, featuring token-level interaction learning and path-weighted contrastive learning to ease the two biases, respectively. Our cross-attentive architecture jointly models query-path pairs to capture fine-grained semantic interactions, optimized with a contrastive loss on hard-mined path samples. Simultaneously, our path-weighting scheme amplifies the learning signal from infrequent paths within the final loss LSTAR , to ensure robust performance across the entire data distribution. During inference, the trained STAR model guides a beam search to retrieve paths for final answer generation.
Dataset
#Train
#Dev
#Test
Max Hop
1-hop
2-hop
≥ 3-hop
WebQSP
2,543
283
1,628
2
65.49%
34.51%
-
CWQ
26,257
1,382
3,531
4
40.91%
38.34%
20.75%
GrailQA
3,800
200
1,000
4
68.93%
25.82%
5.25%
Table 1. Statistics, distribution of path depths, and hops.
Setting
Model
WebQSP
CWQ
GrailQA
Hits@1 (%)
F1 (%)
RT
Hits@1 (%)
F1 (%)
RT
Hits@1 (%)
F1 (%)
RT
LLM without KG
Qwen2.5-72B
58.1
39.4
3.5
32.4
27.3
4.3
24.3
18.3
4.5
Llama3.3-70B
62.5
43.2
2.8
39.5
34.1
3.6
26.3
20.3
4.0
DeepSeek-R1-70B
75.2
59.0
16.3
55.3
50.3
17.2
41.9
34.2
17.8
LLM-centric Retriever
RoG
87.1
71.6
1.6
83.3
64.8
1.2
73.1
63.8
2.3
Graph CoT
85.3
73.5
123.3
66.1
61.4
513.6
78.3
73.1
168.4
Table 2. Performance comparison with different baselines on the benchmark datasets. STAR consistently outperforms all baselines across various benchmarks in retrieval performance and often demonstrates superior retrieval efficiency.
Backbone
Retriever Type
Error
Shortcut
Long-tail
Union
WebQSP
SimCSE
Similarity-based
14.8
6.8 (45.8)
7.6 (51.6)
10.4 (70.1)
Cross-Attentive
12.6
4.6 (36.7)
6.7 (53.3)
8.4 (66.7)
w/ HPM
12.2
3.8 (31.3)
6.5 (49.1)
7.9 (66.2)
TweetNLP
Similarity-based
16.4
4.9 (29.9)
7.0 (42.7)
9.5 (58.2)
Cross-Attentive
12.4
4.5 (36.2)
6.3 (50.8)
7.6 (63.3)
Table 3. Ablation analysis (%) on STAR’s token-level interaction learning to mitigate Semantic Shortcut Bias. Error percentages are shown outside parentheses, with the relative contribution to total errors inside.
Objective
Error
Shortcut
Long-tail
Union
WebQSP
Contrastive Loss
12.6
4.6 (36.7)
6.7 (53.3)
8.4 (66.7)
w/ Weight
11.9
4.0 (33.3)
5.8 (49.1)
7.9 (66.2)
STAR
11.3
3.7 (32.7)
5.8 (51.1)
7.4 (65.1)
CWQ
Contrastive Loss
14.8
7.0 (47.2)
3.8 (25.9)
10.0 (67.6)
Table 4. Ablation analysis (%) on STAR’s path-weighted contrastive learning. Error percentages are shown outside parentheses, with the relative contribution to total errors inside.
Model
WebQSP
CWQ
GrailQA
LLaMA3.3-70B
75.3 (+35.9)
69.7 (+42.4)
77.2 (+58.9)
Qwen2.5-72B
72.3 (+29.1)
68.8 (+34.7)
76.7 (+56.4)
DeepSeek-R1-70B
86.3 (+27.3)
70.0 (+19.7)
78.2 (+44.0)
Table 5. F1 (%) performance of STAR with different LLM answer generators. Performance improvements over their respective counterparts in Table 2 are highlighted in brackets.
Dataset
K =1
K =3
K =5
K =7
WebQSP
88.7
93.9
95.0
95.2
CWQ
86.4
87.3
89.0
89.4
GrailQA
80.1
86.5
89.8
89.8
Table 6. Hits@1 (%) of STAR under different top- K settings.
Figure 5. Cross-Attention Visualization. Darker color indicates stronger attention. STAR assigns the highest score to the logically correct path place_of_death by aligning logically relevant tokens such as town and assassinated .
Retrieval-Augmented Generation (RAG) mitigates hallucinations in Large Language Models (LLMs) by grounding the generation process on external knowledge. However, standard RAG approaches struggle with multi-hop reasoning. While recent graph-based RAG methods improve the retrieval of interconnected chunks, they often rely on computationally expensive and error-prone LLM-based extraction pipelines. To address these issues, we propose TIGRAG (Token-Induced GraphRAG), an efficient graph-augmented RAG framework based on a token co-occurrence Knowledge Graph. TIGRAG directly models topological relationships between tokens using sliding-window co-occurrence statistics, thus enabling scalable graph construction. During inference, it combines graph-based semantic expansion and neural reranking to retrieve interconnected evidence for multi-hop reasoning. Specifically, it introduces an iterative entity-driven retrieval strategy that progressively expands the query using bridging entities extracted from previously retrieved contexts. We evaluated TIGRAG on three widely adopted multi-hop Question Answering (QA) benchmarks. Experimental results demonstrated that our framework consistently outperforms dense retrieval and graph-based RAG methods in both retrieval and downstream QA tasks, while substantially reducing indexing time, inference latency, and prompt footprint.
Gianluca Bonifazi, Christopher Buratti, Michele Marchetti +5
aUniversità Politecnica delle Marche, Ancona, Italy · bUniversità di Modena e Reggio Emilia, Modena, Italy
We present S-Path-RAG, a semantic-aware shortest-path Retrieval-Augmented Generation framework designed to improve multi-hop question answering over large knowledge graphs. S-Path-RAG departs from one-shot, text-heavy retrieval by enumerating bounded-length, semantically weighted candidate paths using a hybrid weighted k-shortest, beam, and constrained random-walk strategy, learning a differentiable path scorer together with a contrastive path encoder and lightweight verifier, and injecting a compact soft mixture of selected path latents into a language model via cross-attention. The system runs inside an iterative Neural-Socratic Graph Dialogue loop in which concise diagnostic messages produced by the language model are mapped to targeted graph edits or seed expansions, enabling adaptive retrieval when the model expresses uncertainty. This combination yields a retrieval mechanism that is both token-efficient and topology-aware while preserving interpretable path-level traces for diagnostics and intervention. We validate S-Path-RAG on standard multi-hop KGQA benchmarks and through ablations and diagnostic analyses. The results demonstrate consistent improvements in answer accuracy, evidence coverage, and end-to-end efficiency compared to strong graph- and LLM-based baselines. We further analyze trade-offs between semantic weighting, verifier filtering, and iterative updates, and report practical recommendations for deployment under constrained compute and token budgets.
Rong Fu, Yemin Wang, Tianxiang Xu +5
University of Macau · Xiamen University · Peking University +3
Graph-based retrieval-augmented generation (GraphRAG) has recently emerged as a powerful paradigm for knowledge-intensive question answering, especially for tasks that require structured evidence organization and multi-hop reasoning. However, existing GraphRAG systems are typically built in a one-size-fits-all manner, relying on a fixed retrieval framework and a single, often large and costly, generator LLM for all queries. This static design limits their ability to adapt to the complexity of varying questions and often incurs unnecessary computational cost. To fill in the gap, we propose GraphRAG-Router, a cost-efficient framework that adopts a hierarchical routing strategy to coordinate heterogeneous GraphRAGs and generator LLMs. Specifically, GraphRAG-Router is first warmed up through supervised fine-tuning and then optimized with a two-stage reinforcement learning procedure, whose second stage introduces a curriculum cost-aware reward to encourage difficulty-aware and economical generator allocation. Extensive experiments on six general-domain and multi-hop QA benchmarks show that GraphRAG-Router consistently outperforms state-of-the-art baselines, reducing the overuse of large LLMs by nearly 30% while maintaining strong generalization capability.
Dongzhe Fan, Chuanhao Ji, Zimu Wang +2
Department of Computer Science, New York University (Shanghai) · Department of Computer Science, University of Liverpool