Memory-Augmented Language Model Agents

Follow this topic Ask about this topic

Momentum

50 papers in the last four weeks, up 233% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 275

All topics

OCR-Memory: Optical Context Retrieval for Long-Horizon Agent Memory
Apr 29, 2026Jinze Li, Yang Zhang, Xin Yang +5Agent Memory Agent Memory Management
The University of Hong Kong · University of North Texas · University of Tsukuba +1
When Continual Learning Moves to Memory: A Study of Experience Reuse in LLM Agents
Apr 29, 2026Qisheng Hu, Quanyu Long, Wenya WangContinual Learning for LLM Agents LLM Agent Memory
Nanyang Technological University
StratMem-Bench: Evaluating Strategic Memory Use in Virtual Character Conversation Beyond Factual Recall
Apr 29, 2026Yerong Wu, Tianxing Wu, Minghao Zhu +2Conversational Memory AI Agent Benchmarks
School of Computer Science and Engineering, Southeast University, China · 2Key Laboratory of New Generation Artificial Intelligence Technology and its Interdisciplinary Applications (Southeast University), Ministry of Education, China · 3Independent Researcher +1
From Soliloquy to Agora: Memory-Enhanced LLM Agents with Decentralized Debate for Optimization Modeling
Apr 28, 2026Jianghao Lin, Zi Ling, Chenyu Zhou +4Multi-Agent Debate Multi-Agent LLMs
Antai College of Economics and Management, Shanghai Jiao Tong University · University of Chicago Booth School of Business · School of Economics and Management, Tsinghua University +1
MultiHedge: Adaptive Coordination via Retrieval-Augmented Control
Apr 27, 2026Feliks Bańka, Jarosław A. ChudziakRetrieval-Augmented Generation LLM Decision-Making
The Faculty of Electronics and Information Technology, Warsaw University of Technology, Warsaw, Poland
GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs
Apr 26, 2026Tao Feng, Haozhen Zhang, Zijie Lei +2Multi-Agent LLM Systems LLM Agent Orchestration
Department of Computer Science University of Illinois Urbana-Champaign Urbana, IL, USA
AEL: Agent Evolving Learning for Open-Ended Environments
Apr 23, 2026Wujiang Xu, Jiaojiao Han, Minghao Guo +4LLM Agent Self-Improvement LLM Agents
Rutgers University · Independent Researcher
Cross-Session Threats in AI Agents: Benchmark, Evaluation, and Algorithms
Apr 22, 2026Ari AzarafroozCybersecurity AI Agent Security
Intrinsec AI
Co-Evolving LLM Decision and Skill Bank Agents for Long-Horizon Tasks
Apr 22, 2026Xiyang Wu, Zongxia Li, Guangyao Shi +5Continual Learning for LLM Agents Game-Playing Agents
University of Maryland · University of Southern California · Good Start Labs +2
Memory-Augmented LLM-based Multi-Agent System for Automated Feature Generation on Tabular Data
Apr 22, 2026Fengxian Dong, Zhi Zheng, Xiao Han +5Tabular ML Multi-Agent LLMs
University of Science and Technology of China · Zhejiang University of Technology · Meituan
Dual-Cluster Memory Agent: Resolving Multi-Paradigm Ambiguity in Optimization Problem Solving
Apr 22, 2026Xinyu Zhang, Yuchen Wan, Boxuan Zhang +4Large Language Model-Guided Optimization Agent Memory Management
School of Computer Science and Technology, Xi’an Jiaotong University · 2Ministry of Education Key Laboratory of Intelligent Networks and Network Security, China · 3Shaanxi Province Key Laboratory of Big Data Knowledge Engineering, China
EvoAgent: An Evolvable Agent Framework with Skill Learning and Multi-Agent Delegation
Apr 22, 2026Aimin Zhang, Jiajing Guo, Fuwei Jia +3Multi-Agent LLM Systems LLM Agent Skill Learning
Focus AI Center, Focus Technology Co., Ltd. · Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology · Nanjing University of Science and Technology
FOCAL: Filtered On-device Continuous Activity Logging for Efficient Personal Desktop Summarization
Apr 21, 2026Haoran Yin, Zhiyuan Wen, Jiannong Cao +2Efficient VLM Inference Text Summarization
The Hong Kong Polytechnic University Hong Kong, China · China Mobile Communications Company Limited Research Institute Beijing, China
EmbodiedLGR: Integrating Lightweight Graph Representation and Retrieval for Semantic-Spatial Memory in Robotic Agents
Apr 20, 2026Paolo Riva, Leonardo Gargani, Matteo Frosi +1Graph Retrieval-Augmented Generation Embodied QA
Department of Electronics, Information, and Bioengineering (DEIB), Politecnico di Milano, Milan, Italy
AdaExplore: Failure-Driven Adaptation and Diversity-Preserving Search for Efficient Kernel Generation
Apr 17, 2026Weihua Du, Jingming Zhuo, Yixin Dong +9Test-Time Adaptation GPU Kernel Optimization
1Carnegie Mellon University · University of Washington · 3Arm Ltd.
PolicyBank: Evolving Policy Understanding for LLM Agents
Apr 16, 2026Jihye Choi, Jinsung Yoon, Long T. Le +2AI Agent Benchmarks AI Agent Governance
Google Cloud · University of Wisconsin-Madison
IE as Cache: Information Extraction Enhanced Agentic Reasoning
Apr 16, 2026Hang Lv, Sheng Liang, Hongchao Gu +5Agentic Reasoning LLM Information Extraction
University of Science and Technology of China · Huawei Technologies Co., Ltd.
SGA-MCTS: Decoupling Planning from Execution via Training-Free Atomic Experience Retrieval
Apr 16, 2026Xin Xie, Dongyun Xue, Wuguannan Yao +5LLM Planning Memory-Augmented Language Model Agents
Ant Digital Technologies, Ant Group · Hefei Comprehensive National Science Center, Hefei, China
DeepTutor: Towards Agentic Personalized Tutoring
Apr 10, 2026Bingxi Zhao, Jiahao Zhang, Xubin Ren +4LLM Personalization Intelligent Tutoring Systems
The University of Hong Kong
CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery
Apr 2, 2026Ao Qu, Han Zheng, Zijian Zhou +14Large Language Model-Guided Optimization Multi-Agent Collaboration
MIT · Singapore-MIT Alliance for Research and Technology · NUS +7
Oblivion: Self-Adaptive Agentic Memory Control through Decay-Driven Activation
Mar 31, 2026Ashish Rana, Chia-Chien Hung, Qumeng Sun +2Long-Horizon LLM Agents Agent Memory Management
NEC Laboratories Europe, Heidelberg, Germany · GWDG, Georg-August-Universität Göttingen, Göttingen, Germany
APEX-EM: Non-Parametric Online Learning for Autonomous Agents via Structured Procedural-Episodic Experience Replay
Mar 31, 2026Pratyay Banerjee, Masud Moshtaghi, Ankit ChadhaContinual Learning for LLM Agents Persistent Memory for Language Models
Amazon, AGI / Sunnyvale, USA
From Stateless to Situated: Building a Psychological World for LLM-Based Agents
Mar 26, 2026Boning Zhao, Yutong Hu, Xinnuo LiEmotional Support Conversation LLM Agents
Independent Researcher, Shanghai, China · New York University, New York, NY, USA
Retrieval-Augmented LLM Agents: Learning to Learn from Experience
Mar 18, 2026Thomas Palmeira Ferraz, Romain Deffayet, Vassilina Nikoulina +2Fine-Tuning LLM Agent Training
NAVER LABS Europe, Meylan, France
From Experiments to Expertise: Scientific Knowledge Consolidation for AI-Driven Computational Physics
Mar 13, 2026Haonan HuangAI Agents for Scientific Discovery Computational Materials Science
Department of Physics, Princeton University, Princeton, NJ 08540, USA.
Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoning
Feb 13, 2026Kehao Zhang, Shangtong Gui, Sheng Yang +2Persistent Memory for Language Models Long-Context Inference
1Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences (ICT/CAS) · University of Chinese Academy of Sciences, Beijing, China · 4Li Auto Inc. +1
SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning
Feb 9, 2026Peng Xia, Jianwen Chen, Hanyang Wang +10LLM Agent Skill Learning RL for LLM Agents
UNC-Chapel Hill · University of Chicago · University of California San Diego +3
Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updates
Jan 26, 2026Yibo Li, Zijie Lin, Ailin Deng +5Continual Learning for LLM Agents Reinforcement Learning
National University of Singapore, Singapore.
PEARL: Self-Evolving Assistant for Time Management with Reinforcement Learning
Jan 17, 2026Bingxuan Li, Jeonghwan Kim, Cheng Qian +4Long-Horizon Agent Tasks RL for LLM Agents
University of Illinois at Urbana-Champaign · Viven
StackPlanner: A Centralized Hierarchical Multi-Agent System with Task-Experience Memory Management
Jan 9, 2026Ruizhe Zhang, Xinke Jiang, Zhibang Yang +12Multi-Agent LLM Systems Multi-Agent Collaboration
School of Computer Science, Peking University, Beijing, China · 2National Engineering Research Center for Software Engineering, Peking University, Beijing, China · 3Key Laboratory of High Confidence Software Technologies, Ministry of Education, Beijing, China +5

Apr 29, 2026, cs.CLJ/K move · Enter open · S save

OCR-Memory: Optical Context Retrieval for Long-Horizon Agent Memory

Jinze Li, Yang Zhang, Xin Yang, Jiayi Qu+4

The University of Hong Kong · University of North Texas · University of Tsukuba+1

Agent Memory Agent Memory Management Memory-Augmented Language Model Agents

Open paper AskPDF arXiv

Autonomous LLM agents increasingly operate in long-horizon, interactive settings where success depends on reusing experience accumulated over extended histories. However, existing agent memory systems are fundamentally constrained by text-context budgets: storing or revisiting raw trajectories is prohibitively token-expensive, while summarization and text-only retrieval trade token savings for information loss and fragmented evidence. To address this limitation, we propose Optical Context Retrieval Memory (OCR-Memory), a memory framework that leverages the visual modality as a high-density representation of agent experience, enabling retention of arbitrarily long histories with minimal prompt overhead at retrieval time. Specifically, OCR-Memory renders historical trajectories into images annotated with unique visual identifiers. OCR-Memory retrieves stored experience via a \emph{locate-and-transcribe} paradigm that selects relevant regions through visual anchors and retrieves the corresponding verbatim text, avoiding free-form generation and reducing hallucination. Experiments on long-horizon agent benchmarks show consistent gains under strict context limits, demonstrating that optical encoding increases effective memory capacity while preserving faithful evidence recovery.

Momentum

Related topics

Latest papers 275