Memory-Augmented Language Models

Ask about this topic

Momentum

29 papers in the last four weeks, up 142% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 193

All topics
CardsList

  1. EngramEdit: Decoupled Knowledge Updates in LLMs through Conditional Memory

    Oct 7, 2026Hongru Cai, Ran Wei, Wenjie Wang +4Knowledge EditingFactual Knowledge in Language Models

    The Hong Kong Polytechnic University · Hangzhou Diagens Biotechnology Co., Ltd · University of Science and Technology of China

  2. YANchor-4B: Effective Long-Horizon Reasoning in O(N) Time with O(1) Memory

    Oct 7, 2026Huishan Ji, Hua Xu, Weiming Zhang +1Efficient Language Model ReasoningMemory-Augmented Language Models

    Rocore Matrix

  3. Cache the Encoder Within:Compact, Reusable Memory across LLM Queries

    Oct 7, 2026Hanzuo Liu, Chunyu Liu, Chaofan Lin +2Persistent Memory for Language ModelsMemory-Augmented Language Models

    Tsinghua University

  4. Towards In-Parameter Memory Augmentation for Large Language Models

    Oct 6, 2026Haoyu Huang, Zhongwei Xie, Jiaxin Bai +6Memory-Augmented Language ModelsPersistent Memory for Language Models

    The Hong Kong University of Science and Technology · Hong Kong Baptist University

  5. Test-Time Adaptation of Reasoning Strategies with Bayesian Nonparametric Memory

    Oct 5, 2026Keshav Ramji, Tahira Naseem, Ramón Fernandez AstudilloMemory-Augmented Language ModelsBayesian Mixture Models

    IBM Research AI

  6. Voltic: Distinguishing Volatility from Stochasticity in Recurrent Memory

    Oct 5, 2026Parsa Hejabi, Morteza Dehghani, Payam PirayKalman FilteringBayesian Filtering

    University of Southern California

  7. Universal Test-Time Training

    Oct 4, 2026Zefan Cai, Qinzhe Hu, Ziqiao Ma +2Memory-Augmented Language ModelsRecurrent Transformers

    University of Wisconsin–Madison · University of Michigan–Ann Arbor · Adobe

  8. MemStrata: 95% and 90.91% Source-Aware Accuracy on LongMemEval-500 and LoCoMo-1540 with a Local Qwen 3.8 27B Q4_K_M Reader

    Oct 4, 2026Neeraj YadavLLM EvaluationMemory-Augmented Language Models

    Called It Inc.

  9. Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives

    Oct 1, 2026Zhiyun ShiMemory-Augmented Language ModelsPersistent Memory for Language Models

    Nanyang Technological University, Singapore

  10. Role-aware Heuristic Episodic Attention for Conversational LLMs

    Oct 1, 2026Wanyang Hong, Zhaoning Zhang, Yi Chen +5Memory-Augmented Language ModelsLong-Context Language Model Inference

    National Key Laboratory of Parallel and Distributed Computing, College of Computer Science and Technology, National University of Defense Technology, Changsha, China.

  11. Can Computation from Earlier Problems Help LLMs Solve New Ones?

    Sep 30, 2026Jipei He, Wenhui Tan, Xiaoyi Yu +4Memory-Augmented Language ModelsLLM Inference

    Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China · University of Modena and Reggio Emilia, Italy

  12. Learning What to Remember: Long-horizon Counterfactual Memory Optimization

    Sep 29, 2026Jiaming Tang, Mingyan Liu, Armin SarabiMemory-Augmented Language ModelsPersistent Memory for Language Models

    Department of Electrical Engineering and Computer Science, University of Michigan

  13. Context Language Models

    Sep 29, 2026Rulin Shao, Shannon Zejiang Shen, Junjie Oscar Yin +10Memory-Augmented Language ModelsLLM Context Management

    University of Washington · Meta Superintelligence Labs · MIT +1

  14. ReLMem: Learning Recurrent Memory for Longitudinal EHR Modeling

    Sep 29, 2026Zijie Meng, Xiwei Dai, Yingying Zhang +3Memory-Augmented Language ModelsClinical Prediction

    Zhejiang University · Tencent Jarvis Lab

  15. ER-JEPA: Experience Replay Improves Joint-Embedding Predictive Learning in Language Models

    Sep 29, 2026Jingnan Pu, Zi-En Fan, Feng LianMemory-Augmented Language ModelsJoint-Embedding Predictive Architecture

    School of Automation Science and Technology, Xi’an Jiaotong University No. 28, West Xianning Road, Xi’an, Shaanxi 710049, China

  16. CoEM: Empowering Long-Context Reasoning with Commit-on-Evidence Memory

    Sep 29, 2026Jingguang Li, Yebo Wu, Zuyi Guo +7Memory-Augmented Language ModelsPersistent Memory for Language Models

    Korea Advanced Institute of Science & Technology · University of Macau · Massachusetts Institute of Technology

  17. Cartridges++: KV Cache Compression without Off-Context Derailment

    Sep 28, 2026Sonia Laguna, Joao Monteiro, Marco Cuturi +2Memory-Augmented Language ModelsLong-Context Language Model Inference

    Apple

  18. FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models

    Sep 28, 2026Bowen Yang, Jingbo Zhou, Qinghong Miao +1Memory-Augmented Language ModelsLLM Memory

    Large Model Frontier Research Department, Baidu Inc., China · Nanyang Technological University

  19. Single-Layer MeMo as a Randomized Hamming-Kernel Classifier

    Sep 28, 2026Alessandro StraziotaMemory-Augmented Language ModelsNext-Token Prediction

    Department of Enterprise Engineering University of Rome “Tor Vergata” Rome, Italy

  20. LSTMem: Hierarchical Long Short-Term Online Memory for Large Language Models

    Sep 27, 2026Xianglong Shi, Ruijie Yang, Sirui Zhao +4Memory-Augmented Language ModelsPersistent Memory for Language Models

    University of Science and Technology of China

  21. Memory Attention

    Sep 23, 2026Jiale KangMemory-Augmented Language ModelsLLM Inference Acceleration

  22. FLEET: From Logits Entropy to Enhanced Trajectories in Text Generation

    Sep 23, 2026Oleksii Streltsov, Oleksandra VitkoLanguage Model DecodingMemory-Augmented Language Models

    Department of Artificial Intelligence, Kharkiv National University of Radio Electronics, Kharkiv, Ukraine

  23. MemoryAthena: Adaptive Routing over Latent and Generated Memories

    Sep 22, 2026Mingyuan Li, Guangsheng Yu, Juyuan Zhang +4Memory-Augmented Language ModelsPersistent Memory for Language Models

    ELLIS Institute of Finland · University of Turku · University of Technology Sydney +2

  24. Latest Exact Match Attention

    Sep 22, 2026Moritz BrösamleTransformer ExpressivityMemory-Augmented Language Models

    Department of Mathematics, University of Tübingen, Germany

  25. ARM: Attention with Routed-Memory for Learnable Sparse Control

    Sep 21, 2026Qiuhao Zeng, Jerry Huang, Peng Lu +7Memory-Augmented Language ModelsLong-Context Language Model Inference

    University of Toronto, Canada · Vector Institute, Canada · RIKEN AIP, Japan +3

  26. Where Should a Document Live: Context, Representations, or Parameters?

    Sep 15, 2026Nathanaël Carraz Rakotonirina, Momchil Hardalov, Gonzalo Iglesias +1Memory-Augmented Language ModelsKnowledge Augmentation for Language Models

    Amazon AGI

  27. Persistent Recurrent Memory Between Transformer Layers - Improves Language Model Generalization

    Sep 15, 2026Eduardo Novaes HeringMemory-Augmented Language ModelsDecoder-Only Language Models

    FITec Labs / Ericsson São Paulo

  28. Smarter by the Moment: Environment-Driven Dynamic Policies for Continual LLM Improvement

    Sep 15, 2026Ting-Wei Chang, Po-Chun Chen, Hen-Hsen Huang +1Continual Learning for LLMsMemory-Augmented Language Models

    Department of Computer Science and Information Engineering, National Taiwan University, Taiwan · Institute of Information Science, Academia Sinica, Taiwan · AI Research Center (AINTU), National Taiwan University, Taiwan

  29. Register Tokens for Bounded-State Reasoning in Diffusion Language Models

    Sep 14, 2026Albert Ge, Chandan Singh, Yufan Zhuang +3Memory-Augmented Language ModelsDiffusion Language Models

    University of Wisconsin–Madison · Microsoft Research · UC San Diego

  30. MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup

    Sep 14, 2026Muchen Li, Leonid Sigal, Renjie LiaoMemory-Augmented Language ModelsPersistent Memory for Language Models

    University of British Columbia · 2Vector Institute for AI · 3Canada CIFAR AI Chair +1

  31. ConvMem: Convolutional Memory for Long-Context Reasoning

    Sep 9, 2026Hongming Zhang, Zhaozhen Gu, Fengshuo Bai +6Memory-Augmented Language ModelsLong-Context Modeling

    Institute of Automation, Chinese Academy of Sciences

  32. From Retrieval to Weights: Parametric Individualization of Small Language Models with Individual Text Corpora

    Sep 9, 2026Christoph Wigbels, Ali Abusaleh, Markus T. Jansen +2Memory-Augmented Language ModelsMemorization in Language Models

    Bergische Universität Wuppertal · Goethe-Universität Frankfurt

  33. Less Is Personal: Learning Minimal Sufficient User Profiles for Personalized Language Models

    Sep 8, 2026Minghang Liu, Qiang Qiu, Yuanzhuo Wang +2LLM PersonalizationMemory-Augmented Language Models

    State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · University of Chinese Academy of Sciences, Beijing, China

  34. Separating Stream Stability from Long-Term Recall in Language Models

    Sep 7, 2026Peipei Cao, Xin Zhang, Jie Tang +3Memory-Augmented Language ModelsLong-Context Language Model Evaluation

    School of Computer and Electronic Information, Guangxi University · School of Information Science and Engineering, Chongqing Jiaotong University · School of Computer Science and Technology, Guangdong University of Technology

  35. ProtLingo: Efficient Protein Language Modeling via Conditional Memory and Expert Routing

    Sep 7, 2026Mingrui Li, Sixian Shen, Minzhang Li +4Mixture-of-Experts Language ModelsProtein Fitness Prediction

    ShanghaiTech University

  36. RecurTrace: Adaptive Latent Reasoning with Loop-Time Memory

    Sep 3, 2026Yuxiang Wang, Kunyu Feng, Yingda Shen +3Memory-Augmented Language ModelsRecurrent Transformers

    The Chinese University of Hong Kong, Shenzhen · The Chinese University of Hong Kong · Tianjin University +2

  37. Replacing Training with Memory: Listwise Selection for Text-to-SQL

    Sep 1, 2026Yeonseok Jeong, Soyoung Yoon, Seongjun Lee +1Memory-Augmented Language ModelsLearning to Rank

    IPAI, Seoul National University · KAIST

  38. Safin-1: Safety from Within through Memory-Native State Evolution

    Aug 31, 2026Ming Zhang, Kaisen Yang, Shu Yu +15Memory-Augmented Language ModelsLLM Safety Alignment

    Shanghai AI Laboratory

  39. What It Costs to Compose, Rebuild, and Correct Precomputed Memory

    Aug 31, 2026Asa ShepardLLM Inference EfficiencyMemory-Augmented Language Models

    Department of Computer Science, Williams College

  40. Strong Drafts Need Compact Memories: Long-Context Speculative Decoding with Compressed KV Cache

    Aug 31, 2026Tong Yuan, Chengxi Liao, Zeyi WenMemory-Augmented Language ModelsKV Caching

    Data Science and Analytics Thrust, Information Hub, The Hong Kong University of Science and Technology (Guangzhou)

  41. When Errors Become Memories: Causal Pathway Tracing in Multi-Turn Memory-Augmented LLMs

    Aug 31, 2026Shuyao Xiao, Shengling Wang, Xuan Chen +8Memory-Augmented Language ModelsCausal Interventions in Language Models

    College of Artificial Intelligence, Beijing Normal University, Beijing, China · 2Beike Language and Intelligence, Beijing, China · Center for Data Science, New York University, New York, NY, USA

  42. Memory Is Not Always Needed: Characterizing Conditional Memory in Scientific Reasoning

    Aug 25, 2026Zhen Bi, Xueshu Chen, Yan Wang +6Memory-Augmented Language ModelsScientific Reasoning

    Huzhou Normal University · Alibaba Group · Bota Biosciences +1

  43. Does Episodic Memory Help Close the Lexical Frequency Gap in Sensitivity to Syntactic Contrasts? A Test Using Retrieval-Augmented Language Models

    Aug 24, 2026Jing Liu, Najoung KimMemory-Augmented Language ModelsLanguage Modeling

    CoML Team, LSCP ENS, Université PSL, EHESS, CNRS · Department of Linguistics Boston University

  44. Frozen Memory Is Not Enough: Rethinking External Memory as Extraction

    Aug 17, 2026Mingyuan Li, Guangsheng Yu, Xu Wang +1Memory-Augmented Language ModelsKnowledge Augmentation for Language Models

    ELLIS Institute Finland · University of Turku · University of Technology Sydney

  45. MARCH: Scaling Recurrent Memory with Content-Routed State Anchors

    Aug 12, 2026Ming Zhang, Kaisen Yang, Shu Yu +6Long-Context RetrievalIn-Context Retrieval

    Shanghai AI Laboratory · Tsinghua University · Fudan University

  46. LoKiFormer: Locality-aware Attention with Decoupled Knowledge Memory for Efficient Large Language Model Pretraining

    Aug 12, 2026Qiuwu Chen, Zimo Liu, Yuchen Li +8Language Model PretrainingMemory-Augmented Language Models

    AIGCode · South China University of Technology · Pazhou Laboratory

  47. EvoMem: Memory-Augmented Evolution for Code Optimization

    Aug 11, 2026Viktor Volkov, Valentin Khrulkov, Andrey V. Galichin +8Memory-Augmented Language ModelsEvolutionary Optimization

    AXXX, Moscow, Russia · Applied AI Institute, Moscow, Russia · Lomonosov Moscow State University, Moscow, Russia

  48. AquiLLM: An Architecture for Supporting Tacit Knowledge Capture in Research Groups

    Aug 9, 2026Jack Stark, Srinath Saikrishnan, Vikram Seenivasan +3Memory-Augmented Language ModelsKnowledge Augmentation for Language Models

    University of California, Los Angeles, Los Angeles, California, USA · Southern Oregon University, Ashland, Oregon, USA

  49. PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory

    Aug 4, 2026Dawei Liu, Haixu Song, Shuang Cheng +9Memory-Augmented Language ModelsLong-Context QA

    Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Tsinghua University +3

  50. Maglev: Sliding Recurrent Memory

    Aug 3, 2026Bo Liu, Qiang LiuMemory-Augmented Language ModelsNext-Token Prediction

    The University of Texas at Austin

  51. Structured Memory for Edge Language Models: Persistent Context and Corpus Retrieval via O(1) SSM State Injection

    Aug 3, 2026Anusha Madan Gopal, Aras Pirbadian, Kristofor D. Carlson +2Retrieval-Augmented GenerationOn-Device Language Model Inference

    BrainChip Inc. 23041 Avenida de la Carlota, Laguna Hills, CA

  52. LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference

    Aug 3, 2026Zhichen Liu, Ruihan Sun, Hengjie Yang +4Memory-Augmented Language ModelsLLM Inference

    Southern University of Science and Technology · Xidian University

  53. Mamba with Hierarchical Memory: Solving Representation Bottleneck in Long Sequence Modeling

    Aug 3, 2026Qinwen Wang, Jieping Luo, Aoxiang Qin +5Long-Context RetrievalMemory-Augmented Neural Networks

    The Chinese University of Hong Kong, Shenzhen · Hainan Bielefeld University of Applied Sciences · BrainGalaxy

  54. DART: Decoded Attention over Recurrent States for Efficient Long-Context Sequence Modeling

    Aug 3, 2026Yixiao Qian, Song Chen, Pengkai Wang +3Memory-Augmented Language ModelsKV Caching

    College of Control Science and Engineering, Zhejiang University · Department of Mathematics, National University of Singapore · Hong Kong Polytechnic University +1

  55. RING: Retrieval-Internalized Generation for Continual Large-Scale Knowledge Injection

    Aug 3, 2026Shicheng Xu, Liang Pang, Liyi Chen +7Retrieval-Augmented GenerationContinual Learning for LLMs

    State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · University of Chinese Academy of Sciences · Xiaohongshu Inc.

  56. Tokenizer-Agnostic Engram Module

    Jul 31, 2026Jia Peng Lim, Hai Leong ChieuMemory-Augmented Language ModelsLanguage Modeling

    Singapore Management University · DSO National Laboratories

  57. TransMem: Transforming Hidden States into Memory for Large Language Models

    Jul 31, 2026Haodong Lei, Junming Liu, Yirong Chen +4Memory-Augmented Language ModelsLLM Agent Memory

    Southeast University, Nanjing, Jiangsu, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China

  58. Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models

    Jul 31, 2026Jin-woo Lee, Minkyung Song, Junghyun Oh +4Memory-Augmented Language ModelsKV Caching

    Chungnam National University · KISTI

  59. CoMem: Reusing Transformer Depth across Queries with Persistent Intermediate Residuals

    Jul 30, 2026Hanzuo Liu, Xuan Qi, Chunyu Liu +6Memory-Augmented Language ModelsLong-Context Language Model Inference

    Tsinghua University · Tencent

  60. ConMem: Contribution-Aware Memory for Long-Horizon Manufacturing Inspection Logs

    Jul 30, 2026Bingchen Liu, Yuanyuan Fang, Lei Liu +6Memory-Augmented Language ModelsPredictive Maintenance

    Shandong University, School of Software Jinan, Shandong, China · Boston University, Metropolitan College Boston, MA, USA · North China Electric Power University, School of Control and Computer Engineering Beijing, Beijing, China +3