Memory-Augmented Language Models

Follow this topic Ask about this topic

Momentum

29 papers in the last four weeks, up 142% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 196

All topics

Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models
Jul 31, 2026Jin-woo Lee, Minkyung Song, Junghyun Oh +4Memory-Augmented Language Models KV Caching
Chungnam National University · KISTI
CoMem: Reusing Transformer Depth across Queries with Persistent Intermediate Residuals
Jul 30, 2026Hanzuo Liu, Xuan Qi, Chunyu Liu +6Memory-Augmented Language Models Long-Context Language Model Inference
Tsinghua University · Tencent
ConMem: Contribution-Aware Memory for Long-Horizon Manufacturing Inspection Logs
Jul 30, 2026Bingchen Liu, Yuanyuan Fang, Lei Liu +6Memory-Augmented Language Models Predictive Maintenance
Shandong University, School of Software Jinan, Shandong, China · Boston University, Metropolitan College Boston, MA, USA · North China Electric Power University, School of Control and Computer Engineering Beijing, Beijing, China +3
Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory
Jul 30, 2026Rubin Wei, Jiaqi Cao, Jiarui Wang +4Language Model Pretraining Memory-Augmented Language Models
LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Electronic Engineering, Tsinghua University
Subtract, Transport, or Replay? Auditable Deletion from Language-Model Memory
Jul 30, 2026Vishwajith RameshMemory-Augmented Language Models LLM Auditing
Vy Labs, Inc.
InferScale: GPU-Native KV Injection for Personalized LLM Serving
Jul 29, 2026Peter Li, Prashant PandeyLLM Serving Memory-Augmented Language Models
Northeastern University Boston, Massachusetts, USA
Metis: Memory Foundation Model
Jul 29, 2026Zeyu Zhang, Ziliang Guo, Yihang Sun +14Agent Memory Memory-Augmented Language Models
MemTensor (Shanghai) Technology Co., Ltd. · Shanghai Jiao Tong University · National University of Singapore +2
Voice Memory for Agentic Speech Recognition
Jul 29, 2026Chao-Han Huck Yang, Zih-Ching Chen, Piotr Zelasko +3Memory-Augmented Language Models Automatic Speech Recognition
NVIDIA
MemSFT: Mitigating Alignment Tax with an External Parametric Memory
Jul 28, 2026Jiarui Wang, Xiang Shi, Jiaqi Cao +8LLM Alignment Memory-Augmented Language Models
LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai AI Laboratory · School of Computer Science, Shanghai Jiao Tong University +1
Memory for Large Language Models
Jul 28, 2026Sining Zhoubian, Dan Zhang, Evgeny Kharlamov +1Memory-Augmented Language Models LLM Memory
Tsinghua University · National University of Singapore · Bosch AI
Raven: High-Recall Sequence Modeling with Sparse Memory Routing
Jul 28, 2026Arshia Afzal, Aviv Bick, Eric P. Xing +2Memory-Augmented Language Models Long-Context Language Modeling
EPFL · Carnegie Mellon University · MBZUAI +1
CALMRec: Causally Aligned Language Memory for Long-Horizon Recommendation
Jul 26, 2026Gengyu ZhanMemory-Augmented Language Models Recommender Systems
Shenzhen University
MaSRead: Content-Addressed Reading of Replicated Latent Stores
Jul 21, 2026Carlos Baquero, Luís Brito, João ResendeMemory-Augmented Language Models
FEUP & INESC TEC, Universidade do Porto, Porto, Portugal · ESTG, Instituto Politécnico de Viana do Castelo, Viana do Castelo, Portugal · DCC, FCUP, Universidade do Porto, Porto, Portugal
SmartRAG: Native Graph-Based RAG for Mobile Device
Jul 16, 2026Zhihan Jiang, Meng Li, Shenghao Liu +5Named Entity Recognition On-Device Language Model Inference
1Nanjing University · 2HUST · 3Southeast University
Smarter and Cheaper at Once: Byte-Exact KV-Cache Grafting Turns a Frozen Small Model into a Verified-Knowledge Flywheel
Jul 15, 2026Sietse SchelpeMemory-Augmented Language Models Knowledge Augmentation for Language Models
Corbenic AI
PReM: Learning What to Preserve and When to Refresh for Context Compression
Jul 15, 2026Bohan Yu, Lei Shen, Chenxi Zhou +5Memory-Augmented Language Models Long-Context Language Model Inference
Alibaba Group
Extending LLM Context via Associative Recurrent Memory
Jul 13, 2026Gleb Kuzmin, Ivan Rodkin, Aydar Bulatov +8Memory-Augmented Language Models Long-Context Language Modeling
1FusionBrain Lab 2MBZUAI 3Cognitive AI Systems Lab 4RUDN · 2MBZUAI · 6MIRAI +5
Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams
Jul 11, 2026Siddharth Pal, Viktoria RojkovaMemory-Augmented Language Models Long-Context Modeling
Creativity, honesty and designed forgetting emerge in small hyperbolic language models
Jul 10, 2026Kwan Soo Shin, In Seok Kang, Yunkyung MinLLM Sycophancy Memory-Augmented Language Models
PolymathMinds Lab, Seoul, Republic of Korea. · Department of Chemical Engineering, POSTECH, Pohang, and aSSIST University, Seoul, Republic of Korea. · Korean Educational Development Institute, Jincheon, Republic of Korea.
Co-LMLM: Continuous-Query Limited Memory Language Models
Jul 8, 2026Yair Feldman, Linxi Zhao, Nathan Godey +5Language Model Pretraining Memory-Augmented Language Models
Department of Computer Science Cornell University
TF-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models
Jul 8, 2026Yutang Ma, Kecheng Huang, Xikun Jiang +1Memory-Augmented Language Models Knowledge Augmentation for Language Models
The Chinese University of Hong Kong · Beijing Institute of Technology, Zhuhai
Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity
Jul 8, 2026Loïc Cabannes, Pierre-Emmanuel Mazaré, Gergely Szilvasy +6Long-Context Retrieval Memory-Augmented Language Models
Meta FAIR · Inria Paris & ENS-PSL University · University of Tübingen
MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning
Jul 8, 2026Ruilin Tong, Dong GongContinual Learning for LLMs Memory-Augmented Language Models
University of New South Wales (UNSW Sydney)
Do You Remember? Toward Memory-Centric Multimodal AI
Jul 7, 2026Xuguang Yu, Weigang Zheng, Minyue YuMemory-Augmented VLMs Multimodal Memory
From Application-Layer Simulation to Native Meta-Architecture: Structural Tension as an Endogenous Driver for Heterogeneous AI Evolution
Jul 7, 2026Heting MaoLLM Alignment Memory-Augmented Language Models
Shanghai Lixin University of Accounting and Finance
MemDefrag: Latent Memory Defragmentation for Large Language Models
Jul 7, 2026Ruiyi Yan, Zhuoyuan Mao, Yiwen GuoContinual Learning for LLMs Memory-Augmented Language Models
Kyoto University · LIGHTSPEED · Independent Researcher
Akashic: A Low-Overhead LLM Inference Service with MemAttention
Jul 7, 2026Yang Liu, Zhaokai Luo, Huayi Jin +7LLM Serving Memory-Augmented Language Models
Xiaohongshu Inc., China · ShangHai JiaoTong University · Peking University
Parametric Memory Decoding for Zero-Shot Routing in LoRA-Based External Parametric Memory
Jul 5, 2026Fengxian Ji, Zhuohan Xie, Jingpu Yang +3Zero-Shot Learning Memory-Augmented Language Models
1MBZUAI, United Arab Emirates · Institute of Automation, Chinese Academy of Sciences, China
PraMem: Practice-derived Experiential Memory for Long-horizon Behavior Prediction
Jul 3, 2026Zhuoqun Li, Boxi Cao, Jiawei Chen +11Memory-Augmented Language Models Next-Action Prediction
Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Fudan University +1
DRIFTLENS: Measuring Memory-Induced Reasoning Drift in Personalized Language Models
Jul 2, 2026Xi Fang, Weijie Xu, Yingqiang Ge +3LLM Personalization Memory-Augmented Language Models
1Amazon

Jul 31, 2026, cs.CLJ/K move · Enter open · S save

Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models

Jin-woo Lee, Minkyung Song, Junghyun Oh, Seunghoon Han+3

Chungnam National University · KISTI

Memory-Augmented Language Models KV Caching LLM Inference Acceleration

Open paper AskPDF arXiv

Heterogeneous Large Language Model (LLM) systems increasingly rely on shared contexts, retrieved evidence, and multi-agent dialogue histories, yet their internal key-value (KV) caches remain model-specific and cannot be reused across architectures. Consequently, each model must repeatedly prefill or store caches for the same context, limiting the scalability of multi-model reasoning and long-context generation. We propose Mixture-of-Translators(MoT), a cache translation framework that maps context KV caches from a source LLM into the cache space of a target LLM. Unlike prior approaches that depend on a single projection path or global shared latent space, MoT uses multiple translator modules to capture diverse source--target mappings. To further reduce residual translation error, we introduce a Context Correction Loss that aligns the replayed target trajectory with the native target trajectory. We reveal two competing failure modes in cache translation: propagated translation shift from early injection and last-state shift from late injection. MoT addresses them through translator mixtures and target-side correction. Across homogeneous and heterogeneous translations among Qwen2.5, GPT-2, and OPT models, MoT preserves downstream QA performance, including Qwen2.5-7B-scale translation with 51.0% average closed-set QA accuracy and 0.43 average extractive QA F1. In practical case studies, MoT enables quality-preserving memory reuse for multi-agent reasoning and retains 96.3% of direct-context quality in long-context cache-augmented generation, demonstrating scalable KV cache reuse across heterogeneous LLMs.

Momentum

Related topics

Latest papers 196