Memory-Augmented Language Models

Follow this topic Ask about this topic

Momentum

29 papers in the last four weeks, up 142% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 193

All topics

ISM:Self-Improving Strategy Memory for Continual Mathematical Reasoning
Jun 30, 2026Prakhar Dixit, Tim OatesContinual Learning for LLMs Memory-Augmented Language Models
Department of Computer Science, University of Maryland, Baltimore County, Baltimore, Maryland, USA
HippoSpark: An On-Demand Experience System for LLM Reasoning
Jun 29, 2026Jingyao Liu, Danling Meng, Chen Huang +5Retrieval-Augmented Generation Memory-Augmented Language Models
College of Computer Science, Sichuan University · Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education, China · College of Software Engineering, Sichuan University +3
MMLA: Memory-Mediated Learning Architecture for Predictive Dual-State Adaptation
Jun 27, 2026Junyi Zou, Avrova DonzContinual Learning for LLMs Test-Time Adaptation
1MMLA-org · 2Communication University of China (CUC), No. 1 Dingfuzhuang East Street, Chaoyang District, Beijing 100024, China
Erase-then-Delta Attention: Decoupling Erase and Write Addresses in Delta-Rule Linear Attention
Jun 25, 2026Xiao Li, Chengruidong Zhang, Hao Luo +15Memory-Augmented Language Models Long-Context Language Modeling
1Qwen Team · 2Nanjing University · 3Zhejiang University
Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One
Jun 24, 2026Alex KwonLLM Evaluation Memory-Augmented Language Models
Independent Researcher
ATMA: Length-Invariant Language Modeling via Polar Attention and Gated-Delta Compression Memory
Jun 23, 2026Habibullah AkbarMemory-Augmented Language Models Long-Context Language Modeling
Kreasof AI Jakarta, Indonesia
Towards Version-aware Operations and Transaction Memories for Multi-layer MeMo
Jun 23, 2026Peiran LiKnowledge Editing Continual Learning for LLMs
Freie Universität Berlin, Kaiserswerther Str. 16-18, 14195 Berlin, Germany
Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs
Jun 22, 2026Hongxun Ding, Xiang Yu, Chengbing Wang +4LLM Personalization Memory-Augmented Language Models
University of Science and Technology of China, China
Latent Personal Memory: Represent personal memory as dynamic soft prompts
Jun 18, 2026Debrup Das, Avinash Amballa, Yashas Malur Saidutta +3LLM Inference Efficiency Memory-Efficient Fine-Tuning
University of Massachusetts Amherst · Samsung Research America
User as Engram: Internalizing Per-User Memory as Local Parametric Edits
Jun 17, 2026Bojie LiKnowledge Editing LLM Personalization
Pine AI
Continual Self-Improvement with Lightweight Experiential Latent Memories
Jun 16, 2026Vaggelis Dorovatas, Nancy Kalaj, Rahaf AljundiContinual Learning for LLMs Memory-Augmented Language Models
Toyota Motor Europe · University of Trento
DYNA : Dynamic Episodic Memory Networks for Augmenting Large Language Models with Temporal Knowledge Graphs in Continuous Learning
Jun 14, 2026Ali Sarabadani, Mahtab TajvidiyanContinual Learning for LLMs Memory-Augmented Language Models
Department of Computer Engineering and Information Technology, University of Qom, Qom, Iran
Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift
Jun 14, 2026Weihang Su, Jiacheng Kang, Jingyan Xu +7Retrieval-Augmented Generation Continual Learning for LLMs
Department of Computer Science and Technology, Tsinghua University
Knowledge Graph Enhanced Memory-Augmented Retrieval for Long Context Modeling
Jun 12, 2026Ghadir Alselwi, Basem Suleiman, Hao Xue +4Memory-Augmented Language Models Knowledge Augmentation for Language Models
University of New South Wales, Sydney, NSW, Australia · 2Hong Kong University of Science and Technology (Guangzhou) · University of Southampton, Southampton, UK +2
Multi-Turn Reasoning When Context Arrives in Pieces: Scalable Sharding and Memory-Augmented RL
Jun 11, 2026Shu Tong Luo, Wenqin Liu, Rui Liu +2Memory-Augmented Language Models RL for Language Model Reasoning
The University of Melbourne · The University of Tokyo
Context-Driven Incremental Compression for Multi-Turn Dialogue Generation
Jun 10, 2026Yeongseo Jung, Jaehyeok Kim, Eunseo Jung +5Memory-Augmented Language Models Long-Context Modeling
Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong · NVIDIA AI Technology Center, NVIDIA · University of Tsukuba, Japan +1
Doc-to-Atom: Learning to Compile and Compose Memory Atoms
Jun 10, 2026Xingjian Diao, Wenbo Li, Yashas Malur Saidutta +3Memory-Augmented Language Models Long-Context Language Model Inference
AI Center-Mountain View, Samsung Electronics · Dartmouth College
Augmenting Molecular Language Models with Local $n$ -gram Memory
Jun 10, 2026Xinni Zhang, Zijing Liu, He Cao +2Memory-Augmented Language Models Language Modeling
1The Chinese University of Hong Kong · 2International Digital Economy Academy
Task-Aware Structured Memory for Dynamic Multi-modal In-Context Learning
Jun 10, 2026Zhirui Chen, Ziwei Chen, Ling ShaoMemory-Augmented Language Models Multimodal ICL
UCAS-Terminus AI Lab, University of Chinese Academy of Sciences, China · ByteDance Inc.
Recalling Too Well: Sycophancy Evaluation and Mitigation in Memory-Augmented Models
Jun 9, 2026Shelly Bensal, Axel Magnuson, Aparna Balagopalan +1LLM Sycophancy Memory-Augmented Language Models
Writer, Inc.
Parallel Causal Associative Fields: Gated Sparse Memory for Long-Context Language Modeling
Jun 9, 2026Muhammad AhmedMemory-Augmented Language Models Long-Context Language Model Inference
Independent Researcher
Titans-as-a-Layer: Test-Time Memory for Conversational Speech Emotion Recognition
Jun 7, 2026Daniel Chen, Qicong Hu, Yang Xiao +2Memory-Augmented Language Models Audio Understanding
Department of Computer Science, University of Auckland, Auckland, New Zealand · School of Computer and Information Technology, Melbourne, Australia
Tensorizing Engram: Sharing Latents Across N-Gram Embeddings is Beneficial in LLMs
Jun 6, 2026Wuyang Zhou, Yuxuan Gu, Giorgos Iacovides +3Text Embeddings LLM Compression
Department of Electrical and Electronic Engineering, Imperial College London, London, United Kingdom · AIP, RIKEN, Tokyo, Japan.
Position: Hippocampal Explicit Memory Is the Cornerstone for AGI
Jun 5, 2026Sangjun ParkMemory-Augmented Language Models LLM Memory
Department of Computer Science, University of Texas at Austin, TX, USA · Cognizant AI Labs, San Francisco, CA, USA
Why Limit the Residual Stream to Layers and Not Tokens? Persistent Memory for Continuous Latent Reasoning
Jun 5, 2026Mujtaba Farhan, Maheep ChaudharyMemory-Augmented Language Models Persistent Memory for Language Models
1Algoverse AI Research · 2Independent
Rethinking LoRA Memory Through the Lens of KV Cache Compression
Jun 4, 2026Chunsheng Zuo, Liaoyaqi Wang, William Jurayj +2Retrieval-Augmented Generation Memory-Augmented Language Models
Johns Hopkins University
Cartridges at Scale: Training Modular KV Caches over Large Document Collections
Jun 3, 2026Momchil Hardalov, Gonzalo Iglesias, Adrià de GispertMemory-Augmented Language Models KV Caching
Amazon AGI
Streaming Knowledge Compilation: Proactive Materiality-Scored Pinning for Time-Evolving LLM Wikis
Jun 3, 2026Juan M. HuertaMemory-Augmented Language Models Knowledge Augmentation for Language Models
Zinnia Tech Solutions 600 Steamboat Road Greenwich, CT 06830, USA
HybridThinker: Efficient Chain-of-Thought Reasoning via Compressed Memory and Transient Thought Steps
Jun 2, 2026Xin Liu, Runsong Zhao, Xinyu Liu +8Memory-Augmented Language Models Efficient Language Model Reasoning
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China · China Unicom Cloud-Link, China · NiuTrans Research, Shenyang, China
eMoT: evolving Memory-of-Thought via Symbolic Anchoring and Memory Corrosion
Jun 1, 2026Xiang Li, Jiwei Wei, Ke Liu +5Memory-Augmented Language Models LLM Mathematical Reasoning
Center for Future Media, University of Electronic Science and Technology of China, Chengdu, China

Jun 30, 2026, cs.LGJ/K move · Enter open · S save

ISM:Self-Improving Strategy Memory for Continual Mathematical Reasoning

Prakhar Dixit, Tim Oates

Department of Computer Science, University of Maryland, Baltimore County, Baltimore, Maryland, USA

Continual Learning for LLMs Memory-Augmented Language Models LLM Memory Mathematical Reasoning LLM Mathematical Reasoning

Open paper AskPDF arXiv

We propose Intelligent Schema Memory (ISM), a self-evolving memory-augmented system that improves mathematical reasoning for a frozen LLM under continual learning with hard episodic resets. ISM maintains a compact, self-refined bank of strategy schemas learned from both successful and failed episodes, with symbolic tools that check intermediate steps and certify answers. Without updating model parameters, ISM outperforms passive, retrieval, and reflection baselines on MATH-Hard and OlympiadBench, using 64% and 86% fewer schemas respectively than the strongest passive baseline. These results show that small, actively maintained, and verified strategy memories can support reliable continual mathematical reasoning under strict episodic isolation. The codebase is available at https://github.com/pdx97/ISM .

Momentum

Related topics

Latest papers 193