Agent memory allows LLM agents to use earlier interactions when answering new queries. Existing methods often compress interaction histories into summaries or other LLM-generated representations. Repeated generation adds cost and can discard answer-bearing details before the system knows what a future query will require. We propose EdgeMem, an agent-memory method built around a simple principle: preserve original interaction turns and organize them through complementary content, temporal, and episodic cues. EdgeMem realizes this principle with a multi-anchor hypergraph constructed by lightweight local processing. Retrieval directly returns source evidence and reserves LLM use for final answer generation, combining structured access to multi-session histories with faithful retention of the original conversation. Experiments on LoCoMo and LongMemEval-S show strong retrieval and memory-grounded question answering; on LoCoMo, EdgeMem achieves the highest strict-judge score among seven reproduced systems under a shared prompt (61.01 versus 58.70), while construction and retrieval require no generative-LLM calls. Overall, EdgeMem shows that preserving and organizing source evidence provides an effective and efficient foundation for agent memory without generative memory management.
Figures & tables
Figure 1. (a) LLM-based summarization and retrieval can lose answer-bearing evidence, while original-evidence preservation keeps it directly retrievable. (b) Existing memory frameworks incur substantial generative-LLM token costs in both memory construction and per-query answering. Top: a side-by-side comparison in which LLM-based summarization and retrieval drop an answer-bearing detail before answering, while original-evidence preservation retrieves it directly. Bottom: a grouped horizontal bar chart on a logarithmic token axis; EdgeMem's construction cost is zero and its answering cost is the lowest.
Figure 2. EdgeMem overview. Top (construction): the interaction history is retained as source turns and processed by lightweight local annotation; time, co-occurrence, and session grouping derive the time, co-occurrence, and episode anchor keys of one multi-anchor hypergraph. Bottom (retrieval): query cues drive deterministic evidence channels over the Time, Co-occurrence, and Episode Sub-Hypergraphs. Their selected source turns are fused under a fixed budget and passed to a single reader, which returns an answer or an explicit refusal. The reader is the pipeline’s single LLM stage. A two-stage diagram. During memory construction, source turns are retained unchanged and locally annotated with entities, lexical content, episode membership, and dates. Time, shared-key, and session grouping induce the Time, Co-occurrence, and Episode Sub-Hypergraphs within one multi-anchor hypergraph. During retrieval, date, entity, and lexical query cues drive the three deterministic evidence channels. Their source turns are fused into one evidence pack, after which a single language-model reader produces an answer or refusal.
System
Build tokens ↓
Build calls ↓
Build time ↓
Tokens per question ↓
Calls per question ↓
Time per question (s) ↓
EdgeMem
0
0
1.8 min
1,000
1
1.3
CAM
1.27M
1,516
75 min
19,745
4.9
11.8
CompassMem
1.76M
1,500
43 min
41,348
21.7
45.8
MemGAS
0.46M
544
17 min
3,146
2
3.7
MemoryOS
4.49M
12,730
≥ 1.6 h
5,116
2
4.7
A-Mem
11.77M
17,768
10.1 h
5,857
2
5.2
Table 1. Comparison with released memory systems on LoCoMo, all numbers from our metered runs: (a) memory lifecycle cost, (b) answer quality under the shared answer prompt (Sections 4.1 and 4.2 ). In this and the following tables, the best value in each column is bold, the second best underlined, arrows mark the preferred direction, and n/a marks quantities the design does not define.
System
Judge (all questions) ↑
Exact refusal ↑
Lenient refusal ↑
Matched refusal ↑
EdgeMem
61.76
92.57
92.57
92.57
CAM
41.64
n/a
1.58
38.96
CompassMem
40.81
n/a
18.02
79.28
MemGAS
34.26
n/a
23.65
74.77
MemoryOS
31.37
n/a
12.61
75.00
A-Mem
25.19
n/a
2.93
84.68
Table 2. Behavior on the 446 LoCoMo adversarial questions under the three scoring arms of Section 4.1 .
Figure 3. (a) Memory quality (lenient judge, Table 1 b) against each released pipeline’s per-question token cost (Table 1 a); upper left is better. (b) The anchor ladder: the accuracy each anchor adds in deployment order (Table 3 ); diamonds show co-occurrence and time alone. Two small panels. Left: scatter of accuracy versus token cost on a logarithmic axis; EdgeMem sits in the upper left. Right: waterfall from a flat baseline through episode, co-occurrence, and time increments to the full chain, with diamonds for co-occurrence-only and time-only variants.
Configuration
SJ ↑
F1 ↑
BLEU-4 ↑
ROUGE-L ↑
BERTScore ↑
flat turn BM25
49.74
19.40
4.14
19.00
85.38
+ episode Sub-Hypergraph
58.18
21.94
4.88
21.41
85.80
+ co-occurrence Sub-Hypergraph
60.43
22.12
4.92
21.53
85.83
+ time Sub-Hypergraph
61.01
22.44
5.03
21.82
85.90
co-occurrence only
55.39
20.66
4.52
20.07
85.64
time only
50.19
19.54
4.19
19.16
85.40
Table 3. Anchor ladder on LoCoMo under the shared answer prompt: the deployed path adds one Sub-Hypergraph per rung (upper block); the lower block lists non-deployed single- and pair-anchor variants.
@3
@10
System
R ↑
N ↑
R ↑
N ↑
SJ ↑
Tokens per question ↓
Full History †
n/a
n/a
n/a
n/a
50.60
103,137
MPNet †
66.17
75.47
85.11
80.63
53.20
8,173
Contriever †
71.06
79.72
90.00
84.29
55.40
8,286
MPC †
60.00
70.90
80.00
76.59
53.80
8,457
RecurSum †
67.23
78.33
87.66
83.28
35.40
8,853
Table 4. LongMemEval-S: session-level Recall (R) and NDCG (N) at k∈{3,10} ( n=470 ), strict-judge accuracy (SJ), and reader input tokens per question.
Memory / summary
Retrieved evidence
Final answer
Q1: What gaming equipment did John buy or refurbish? gold: Sennheiser headphones, Logitech mouse, gaming desk
A-Mem
✓ notes faithfully retain headphones, mouse , and the refurbished desk
× partial retrieval: D23:10 omitted; mouse and desk never reach the reader
× “new devices and headphones”—misses mouse and desk
Q2: What kind of beer does McGee’s bar serve? gold: stout, lager
CAM
× key fact dropped: gist layer omits “McGee’s” and “lager” ; the exact leaf is pruned
× cannot recover what construction discarded
× “stout and light beers”—misses lager
EdgeMem
✓ original turns kept: D21:15 (great stout), D23:3 (“good lager at McGee’s”)
✓ D21:15, D23:3 packed
✓ “great stout and lager beer”
Table 5. Three audited failures, each traced from memory through retrieval to the answer, against EdgeMem ’s handling of the same questions: a faithful memory retrieved incompletely (A-Mem), a key fact destroyed during summarization (CAM), and a faithful store whose agentic navigation selects no evidence (CompassMem). ✓ : correct or preserved; × : missed or incorrect.
Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory systems, including hierarchical ones, still often rely solely on vector similarity for retrieval. It tends to produce bloated evidence sets: adding many superficially similar dialogue turns yields little additional recall, but lowers retrieval precision, increases answer-stage context cost, and makes retrieved memories harder to inspect and manage. To address this, we propose HiGMem (Hierarchical and LLM-Guided Memory System), a two-level event-turn memory system that allows LLMs to use event summaries as semantic anchors to predict which related turns are worth reading. This allows the model to inspect high-level event summaries first and then focus on a smaller set of potentially useful turns, providing a concise and reliable evidence set through reasoning, while avoiding the retrieval overhead that would be excessively high compared to vector retrieval. On the LoCoMo10 benchmark, HiGMem achieves the best F1 on four of five question categories and improves adversarial F1 from 0.54 to 0.78 over A-Mem, while retrieving an order of magnitude fewer turns. Code is publicly available at https://github.com/ZeroLoss-Lab/HiGMem.
Shuqi Cao, Jingyi He, Fei Tan
East China Normal University, Shanghai, China · Shanghai Jiao Tong University, Shanghai, China
Long-term memory is essential for language agents to maintain coherent and effective behavior over extended, multi-session interactions. Existing memory systems mainly use retrieval at read time, while write-time memory formation still relies on direct extraction or compression. However, when future information needs are unknown, compressing an entire interaction in one pass can overlook locally important details that may matter later. To this end, we introduce RIME, a retrieval-induced memory framework that shifts memory construction from monolithic compression toward evidence-centered integration. RIME uses generic self-questions to retrieve focused dialogue evidence and grounds memory formation in both the retrieved evidence and relevant historical memories, which are jointly reconciled into an evolving memory bank with temporal and provenance information. At inference time, compressed memory serves as the primary rather than the sole source of evidence: when it cannot support an answer, RIME retrieves relevant source dialogue together with its local context to recover information omitted during memory formation, without resorting to full-history processing. Extensive experiments on LoCoMo with Qwen3-235B-A22B and GPT-5.6 Sol show that RIME consistently achieves the best performance across all three quality metrics among the compared methods, while requiring substantially fewer query-time LLM tokens.
Long-term memory enables LLM agents to leverage past interactions, but dialogue histories quickly exceed the context window, forcing agents to retrieve relevant subsets at query time. Because useful evidence is sparse and scattered across verbose conversations, retrieval faces a fundamental tension: broadening recall improves coverage but floods downstream reasoning with noise, while compressing memories at write time eases retrieval but irreversibly discards details that future queries may need. We introduce LazyMem, which resolves this tension by deferring all memory construction to query time. Given a retrieved candidate pool, a lightweight model processes it in overlapping parallel windows, selectively retaining and compressing only query-relevant content. The model is trained with supervised fine-tuning followed by reinforcement learning, using a reward that jointly encourages the identification of relevant messages and the generation of compressions that are faithful to the source and useful for answering the query. On LongMemEval, LazyMem-4B achieves an LLM-judge accuracy of 0.85, outperforming the strongest non-oracle baseline while using only 213 answer-context memory tokens, 21.0 times fewer than the baseline. It further generalizes to LoCoMo without target-domain training and reduces mean latency relative to the prior query-time baseline. Code is available at https://github.com/allacnobug/LazyMem.
Jing Yu, Yibo Zhao, Jiaming Zhang +1
School of Data Science and Engineering, East China Normal University