ActionRAG: Evidence-Refining Graph Diffusion for Long-Term Memory in LLM Agents
Organizations: Actioneer, Mountain View, California, USA
Abstract
LLM agents need long-term memory that can recover precise and mutually consistent evidence from growing interaction histories, particularly when answers depend on relations among facts rather than isolated semantic matches. Current memory pipelines remain vulnerable at two stages: indexing errors can fragment repeated entities or merge distinct ones, and online retrieval often treats initial similarity scores as final even when the surrounding graph provides evidence for revising them. We introduce ActionRAG, a graph memory architecture that couples cautious indexing with query-time graph retroevaluation. Its indexing pipeline reconciles type labels and applies tiered entity resolution. Given a query, dual-channel entity and triple retrieval forms an initial evidence set and induces a bounded local graph. Query-conditioned receiver-normalized diffusion refines triple scores using local path structure. Seed protection, hub-penalized flux, and triple materialization preserve direct evidence while recovering missed connections. We evaluate ActionRAG on MemoryAgentBench (MAB), which tests accurate retrieval, conflict resolution, long-range understanding, and test-time learning. Across its eight deterministic-scoring columns, ActionRAG achieves 55.1 average accuracy, improving over the strongest retrieval-based memory baseline by 5.4 points. Under MAB's query-time cost accounting, mean synthesis cost stays below $0.001 per query on the four reported cost columns, and the sum of separately measured retrieval-side p99 components is 440.7 ms on our consumer Apple Silicon setup.
Figures & tables
| AR | TTL | LRU | CR | Overall | |||||
| Agent type | SH | MH | Event | MCC | Recom | DetQA | FC-SH | FC-MH | Avg. |
| Long-context agents | |||||||||
| GPT-4o-mini (128K) | 64.0 | 43.0 | 59.0 | 82.0 | 15.1 | 63.4 | 45.0 | 5.0 | 47.1 |
| GPT-4.1-mini (1M) | 83.0 | 66.0 | 82.6 | 75.6 | 16.7 | 56.3 | 36.0 | 5.0 | 52.7 |
| Simple RAG agents | |||||||||
| BM25 | 66.0 | 56.0 | 74.6 | 75.4 | 13.6 | 52.1 | 48.0 | 3.0 | 48.6 |
| Graph construction | Recon. | Summ. | Base | PPR | ActionRAG |
|---|---|---|---|---|---|
| Raw exact-match triplet graph | string only | none | 43.0 | 45.4 | 45.5 |
| Summarized exact-match graph | string only | node/rel. | 43.8 | 46.0 | 48.9 |
| Reconciled ActionRAG graph | node/type/rel. | node/rel.+prov. | 45.0 | 47.0 | 55.1 |
| Agent | BANKING | CLINIC | NLU | TREC-C | TREC-F | Avg. |
|---|---|---|---|---|---|---|
| GPT-4o LC | 96.0 | 96.0 | 90.0 | 87.0 | 69.0 | 87.6 |
| Claude-3.7-Sonnet LC | 97.0 | 98.0 | 86.0 | 87.0 | 79.0 | 89.4 |
| GPT-4o-mini LC | 93.0 | 93.0 | 87.0 | 73.0 | 66.0 | 82.4 |
| Qwen3-Embedding-4B | 90.0 | 88.0 | 86.0 | 67.0 | 59.0 | 78.0 |
| MemoRAG | 90.0 | 87.0 | 86.0 | 66.0 | 56.0 | 77.0 |
| BM25 | 89.0 | 89.0 | 84.0 | 62.0 | 53.0 | 75.4 |
| Agent | MH-DocQA | MCC | DetQA | FC-SH |
|---|---|---|---|---|
| GPT-4o-mini LC | 0.010 / 43.0 | 0.008 / 82.0 | 0.010 / 63.4 | 0.010 / 45.0 |
| GPT-4.1-mini LC | 0.043 / 66.0 | 0.011 / 75.6 | 0.013 / 56.3 | 0.027 / 36.0 |
| BM25 + gpt-4o-mini | 0.001 / 56.0 | 0.006 / 75.4 | 0.006 / 52.1 | 0.001 / 48.0 |
| MIRIX (4.1-mini) | 0.016 / 75.0 | 0.010 / 61.0 | 0.011 / 62.0 | 0.019 / 20.0 |
| ActionRAG | 0.00109 / 63.0 | 0.00031 / 82.0 | 0.00116 / 46.7 | 0.00111 / 61.3 |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Method | |||
|---|---|---|---|---|
| SH-DocQA | BM25 | 50.0 | 60.0 | 66.0 |
| SH-DocQA | Text-Embed-3-Large | 36.0 | 47.0 | 54.0 |
| SH-DocQA | HippoRAG-v2 | 60.0 | 69.0 | 76.0 |
| SH-DocQA | ActionRAG | 76.0 | 76.0 | 77.0 |
| MH-DocQA | BM25 | 49.0 | 54.0 | 56.0 |
| MH-DocQA | Text-Embed-3-Large | 37.0 | 41.0 | 44.0 |
| Config | BANK | CLINIC | NLU | TREC-C | TREC-F | MCC avg |
|---|---|---|---|---|---|---|
| default ( , , , , ) | 94.0 | 91.0 | 86.0 | 76.0 | 63.0 | 82.0 |
| 94.0 | 90.0 | 85.0 | 82.0 | 63.0 | 82.8 | |
| 92.0 | 89.0 | 86.0 | 79.0 | 64.0 | 82.0 | |
| 95.0 | 89.0 | 86.0 | 86.0 | 68.0 | 84.8 | |
| 93.0 | 88.0 | 87.0 | 83.0 | 63.0 | 82.8 | |
| 92.0 | 89.0 | 87.0 | 80.0 | 66.0 | 82.8 |
| Embedder | Dim | BANK | CLINIC | NLU | TREC-C | TREC-F | MCC avg |
|---|---|---|---|---|---|---|---|
| BGE-M3 | 1024 | 94.0 | 89.0 | 86.0 | 84.0 | 67.0 | 84.0 |
| text-embedding-3-large | 3072 | 92.0 | 91.0 | 88.0 | 74.0 | 60.0 | 81.0 |
| text-embedding-3-small | 1536 | 90.0 | 92.0 | 87.0 | 78.0 | 51.0 | 79.6 |
| Graph | Nodes | Tokens | Doc 1 | Doc 2 | Doc 3 | Doc 4 | Doc 5 | Avg | ms | ms | Ctx tok | Items retr. |
| 64K | 409 | 77.9K | 72 | 77 | 73 | 74 | 70 | 73.2 | 2212 | 5811 | 6844 | 103 |
| 128K | 775 | 156.8K | 69 | 75 | 69 | 69 | 70 | 70.4 | 2233 | 6325 | 6901 | 121 |
| full | 2948 | 651K | 75 | 76 | 63 | 67 | 64 | 69.0 | 2764 | 7664 | 6896 | 153 |
| 64K to full | 7.2x | 8.4x | +3 | -1 | -10 | -7 | -6 | -4.2 | +25% | +32% | flat | +1.5x |
| Setting | Symbol | Value | Setting | Symbol | Value |
|---|---|---|---|---|---|
| entity seeds | 10 | hop cap | 3 | ||
| concrete triple seeds | 10 | distance decay | 1.0 | ||
| entity expansion depth | 2 | traversal floor | 0.01 | ||
| triple expansion depth | 1 | direct-evidence weight | 0.15 | ||
| neighbors per expansion | n/a | 8 | prune threshold | 0.10 | |
| hub-degree cutoff | n/a | 80 | protected raw-score items | 10 |
LLM Agent Memory
Large language model agent memory lets agents retain, organize, retrieve, and update information across interactions and long-running tasks.
See all 373 papers