Large Language Models (LLMs) often suffer from hallucination and struggle with complex reasoning tasks requiring multi-hop domain knowledge. While integrating Knowledge Graphs (KGs) provides a structured and verifiable information source, current KG-enhanced LLM paradigms usually rely on single-agent path extraction and fixed prompting, lacking adaptability and facing huge search spaces. To address these challenges, we propose RACER, a Reinforced Agent Collaboration framework for Explainable Reasoning on knowledge graphs. RACER employs a semantic-aware action pruning and teacher-guided reinforcement learning mechanism to efficiently extract high-quality reasoning pathways from large-scale KGs. Furthermore, to mitigate single-path generation pitfalls, we introduce a cross-task accumulated shared memory graph paired with an attention-driven multi-path knowledge refinement module. Finally, RACER orchestrates these components through a four-role multi-agent collaboration system (GraphAgent, TemplateAgent, AnswerAgent, and CriticAgent) to dynamically refine prompts and evaluate answers. Extensive experiments on CommonsenseQA and OpenBookQA datasets demonstrate that RACER significantly outperforms state-of-the-art KG-enhanced LLM baselines with an average improvement of 5%, offering robust and highly interpretable reasoning capabilities.
Figures & tables
Figure 1: The overall architecture of the proposed RACER framework. It illustrates the semantic-aware reinforcement learning path searching, the shared memory graph refinement process, and the multi-agent collaboration workflow.
Agent Role
System Instruction
Input / Output Format
TemplateAgent
You are a template generator. Turn graph-based triples into a short knowledge section for LLMs. MUST NOT answer the question. Write 3-6 concise sentences without mentioning scores.
You are an expert multiple-choice QA solver. Please answer with one letter only based on the provided background knowledge.
IN: Question, Options, Knowledge. OUT: One Letter (A, B, C, D).
CriticAgent
You are an expert QA critic. Analyze whether the model’s generated answer is likely correct, given the graph reasoning path and natural language knowledge.
Zhongguancun Laboratory, Beijing, China · Department of Electronic Engineering, Tsinghua University, Beijing, China · Ant International, Ant Group, Hangzhou, Zhejiang, China +1