ECHO: A Cognitively Inspired, Auditable Memory Plane for Long-Horizon Agents
Organizations: XDream Robotics, Building T2, Moli Community, No. 1, Lane 188, Yuren Road, Pudong New Area, Shanghai 200120, China
Abstract
Long-horizon agents need memory that identifies relevant experience, resolves revisions, and exposes checkable provenance. We present ECHO (Embodied Context and History Orchestration), an auditable memory architecture and service prototype inspired by episodic encoding, consolidation, contextual reinstatement, reconsolidation, and executive control. This is functional inspiration, not neural equivalence; the empirical analysis focuses on retrieval and context construction. Development runs reach 96.29% Hit@10 and 73.64% turn Recall@5 on 1,536 LoCoMo category 1-4 questions, and 97.60% Hit@10, 88.84% turn Recall@5, and 88.71% session Recall@5 on all 500 LongMemEval-S questions. A five-history BEAM gate fails, and in a separate matched 91-question QA sample Mem0 OSS scores 64.84% versus ECHO's 41.76% (exact McNemar p = 0.00107), with a history-cluster interval crossing zero. A post-hoc audit found source-specific phrases in the query-expansion rules. Although no gold answer field entered the runtime, expansion-enabled retrieval scores are therefore descriptive development measurements, not independent confirmation.
Figures & tables
| Cognitive principle | Engineering commitment |
|---|---|
| Episodic encoding | Immutable, source-ordered experience traces |
| Semantic consolidation | Typed state projected separately from raw episodes |
| Reconsolidation | Append revisions; never erase the prior trace |
| Contextual recall | Cue-driven candidates resolved in valid/known time |
| Executive control | Operation routing, selective expression, and abstention |
| Operation | Internal requirement | Final surface |
|---|---|---|
| Fact | Minimal sufficient support | Minimal supported answer |
| Count | Complete member set, deduplicated by identity, and verified count | Numeric count; unit only if needed |
| List | Complete deduplicated set; requested order retained | Requested items only |
| Temporal arithmetic | Both endpoints, normalized unit, verified calculation | Requested duration or date only |
| Temporal lookup | Valid/known-time view and supported target state | Time-scoped fact only |
| Dataset | Reg./eval. | Hist. | Scope |
|---|---|---|---|
| LoCoMo | 1,986/1,982 | 10 | categories 1–4 primary; category 5 separate |
| LongMemEval-S | 500/500 | 500 | all six released question types |
| BEAM development | 20/18 | 1 | one 100K row; pilot only |
| BEAM fresh gate | 91/89 | 5 | preregistered histories; retrieval only |
| Dataset scope | Eval. | Hit@10 (%) | Turn R.@5 (%) | Turn R.@10 (%) | Sess. R.@5 (%) | Sess. R.@10 (%) |
|---|---|---|---|---|---|---|
| LoCoMo cat. 1–4 | 1,536 | 96.29 | 73.64 | 84.48 | – | – |
| LongMemEval-S | 500 | 97.60 | 88.84 | 91.74 | 88.71 | 93.46 |
| History row | Evaluated | Hit@10 (%) | Turn R. (%) | Sess. R. (%) | MRR |
|---|---|---|---|---|---|
| 6 | 18 | 94.44 | 47.06 | 51.11 | .6308 |
| 16 | 18 | 94.44 | 58.18 | 67.50 | .7102 |
| 12 | 18 | 61.11 | 22.99 | 40.00 | .4611 |
| 9 | 17 | 82.35 | 44.44 | 58.97 | .6123 |
| 5 | 18 | 61.11 | 42.62 | 46.67 | .4894 |
| Aggregate | 89 | 78.65 | 40.80 | 52.34 | .5804 |
| Sample | ECHO correct (%) | Mem0 correct (%) | (pp) | exact | |
|---|---|---|---|---|---|
| LoCoMo | 65 | 29 (44.62; 33.17–56.66) | 46 (70.77; 58.80–80.42) | -26.15 | .00333 |
| LongMemEval | 6 | 3 (50.00; 18.76–81.24) | 2 (33.33; 9.68–70.00) | +16.67 | 1.00000 |
| BEAM local 100K | 20 | 6 (30.00; 14.55–51.90) | 11 (55.00; 34.21–74.18) | -25.00 | .12500 |
| All sampled questions | 91 | 38 (41.76; 32.16–52.02) | 59 (64.84; 54.61–73.86) | -23.08 | .00107 |
| Source/system | Dataset | Reported metric | Score | Protocol distinction |
|---|---|---|---|---|
| Mem0 managed platform | LoCoMo | platform score | 92.5 | Top-200, production stack with proprietary optimizations |
| Mem0 managed platform | LongMemEval | platform score | 94.4 | same managed stack; not OSS and not ECHO retrieval recall |
| Mem0 managed platform | BEAM-1M / 10M | platform score | 64.1 / 48.6 | official larger scales, not the local one-row 100K pilot |
| Mem0 paper, base | LoCoMo | overall LLM-judge | GPT-4o-mini-era paper protocol and averaged judge runs | |
| Mem0 paper, graph | LoCoMo | overall LLM-judge | graph memory; different storage, reader, judge, and cutoff | |
| Zep / full context | LoCoMo | overall LLM-judge | author-reported baselines in the Mem0 paper |
| Variant | Hit@10 (%) | Turn R. (%) | Sess. R. (%) | MRR | Mean query (ms) | Mean ctx. (KiB) |
|---|---|---|---|---|---|---|
| Full v11 | 100.00 | 66.04 | 78.95 | 0.811 | 927.8 | 30.6 |
| Dense-only | 100.00 | 56.60 | 65.79 | 0.585 | 796.4 | 28.3 |
| Lexical-only | 83.33 | 50.94 | 78.95 | 0.463 | 825.6 | 36.2 |
| No query expansion | 83.33 | 39.62 | 60.53 | 0.644 | 427.5 | 30.5 |
| No session-support weight | 100.00 | 62.26 | 78.95 | 0.784 | 994.3 | 30.5 |
Agent Memory Management
Agent memory management studies how AI agents store, update, retrieve, compress, and forget information across long-running tasks.
See all 443 papers