cs.LGJun 23, 2026

Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memory

Authors: Beining WuZihao DingJun HuangYanxiao Zhao

Organizations: Department of Electrical Engineering and Computer Science, South Dakota State University, Brookings, SD 57007, USA · Virginia Commonwealth University, Richmond, VA, USA

Abstract

On-device language-model agents improve by accumulating experience in retrieved memory rather than by updating weights. This memory is hard-bounded and exposed: it consumes RAM and energy, reaches peers through a thin uplink, and becomes an attack surface because it is writable by what the agent reads. Existing systems each cover one part of this problem: agentic memories grow without a budget, on-device methods keep entries by success alone, and poisoning is studied mainly as an attack rather than as a memory-governance problem. We propose \sys{}, a single net-value-per-byte score that governs an agent's experience-memory lifecycle. The main idea is to let the budget act as the curator: each entry is scored as value minus harm, per byte, so one ruler decides what to keep, share, and trust. \sys{} makes three decisions: (1) \textbf{KEEP} evicts low-value bytes under the RAM and energy budget; (2) \textbf{SHARE} sends an insight only when its value exceeds its uplink cost; and (3) \textbf{TRUST} gates a peer entry by provenance. On language-model-agent task-drift benchmarks and a real heterogeneous Jetson testbed with two robot-arm nodes and a hub, \sys{} reduces memory by 2.7×2.7\times and uplink by 2.4×2.4\times, drives injection success from 0.75 to zero, and raises accuracy on cases corrupted by poison or stale memory. Curating by net value reduces footprint, energy, uplink, and injection success together without reducing accuracy. In this setting, forgetting by net value improves the agent rather than weakening it.

Explore similar work

CardsList
  1. MemRefine: LLM-Guided Compression for Long-Term Agent Memory

    Jun 11, 2026Minjae Kim, Jinheon Baek, Soyeong Jeong +1Agent MemoryRedundancy

  2. Are We Ready For An Agent-Native Memory System?

    Jun 23, 2026Wei Zhou, Xuanhe Zhou, Shaokun Han +5Agent MemoryLong-Term Memory