cs.CLOct 25, 2026

The Price of Scale in Proactive Memory Recall

Authors: Yichuan Chen, Xin Wang

Organizations: School of Art and Design, Zhejiang Sci-Tech University, Hangzhou 310018, China

Abstract

A long-lived assistant that brings up memories without being asked must decide at every turn whether anything in its store is worth an interruption. We show that this decision is a multiple-testing problem whose difficulty grows with the store size NN. On streaming replays of LongMemEval and LoCoMo, a similarity threshold tuned to 5% false alarms at N=8N=8 reaches 87-100% at N=2048N=2048, across embedding models and for explicit and implicit cues; LLM judges show the same growth from a lower base. We prove that a gate with false-alarm rate αα operates at a per-item false-positive rate of about −ln⁡(1−α)/N-\ln(1-α)/N, which pins its hit rate to the far left of the single-comparison ROC curve and, under regular variation, makes it decay as a power of NN with an explicit constant. The resulting prediction matches the hit rate of a per-NN oracle threshold to within one percentage point. The analysis explains why lexical and semantic channels need thresholds growing like ln⁡N\ln N and ln⁡N\sqrt{\ln N}, and why per-cue normalisation roughly doubles the hit rate at matched false alarms. A cue-swap conformal gate, which compares the current cue with the user's other cues on the same store, needs no labels and has a finite-sample false-alarm guarantee under exchangeability; on LongMemEval it holds false alarms near 5% at the hit rate of a label-tuned threshold. Three annotators (Fleiss' κ=0.63κ=0.63) find that about nine in ten false alarms are genuine interruptions. Code and data: https://github.com/RiverChenStillCompiling/price-of-scale

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. MemTrace: Probing What Final Accuracy Misses in Long-Term Memory

    Jun 15, 2026Xianxuan Long, Zhikai Chen, Shenglai Zeng +3Temporal Reasoning in Language ModelsLLM Agent Memory

  2. TriggerBench: Investigating Prospective Memory for Large Language Models

    Jun 22, 2026Tianhua Zhang, Xinjiang Wang, Qianxi Zhang +6LLM EvaluationLong-Context Language Model Evaluation