Continual Learning for LLM Agents

LLM: Large Language Model

Overview

Continual learning for large language model agents asks how they can improve from ongoing interaction, feedback, and changing environments rather than starting each task from scratch. Common approaches store and retrieve episodes, rules, or reusable skills; refine prompts and agent harnesses; or use reinforcement learning and fine-tuning to consolidate experience into model parameters. Work evaluates these methods in long-horizon settings such as web tasks, coding, games, and embodied environments, where agents must transfer what they learn to later tasks. A central tension is balancing adaptation with retention: accumulated memories and updates can cause interference, stale guidance, or forgetting, and gains in one setting do not always transfer to another.

Latest papers

CardsList

221 papers32 papers in the last four weeks, down 27% on the four weeks before. 0.2% of all new papers.

  1. Lifelong Embodied Navigation Learning

    Mar 6, 2026Xudong Wang, Jiahua Dong, Baichen Liu +3Embodied NavigationContinual Learning for LLM Agents

  2. CGL: Advancing Continual GUI Learning via Reinforcement Fine-Tuning

    Mar 3, 2026Zhenquan Yao, Zitong Huang, Yihan Zeng +5Continual Learning for LLM AgentsRL for GUI Agents

  3. AOI: Turning Failed Trajectories into Training Signals for Autonomous Cloud Diagnosis

    Mar 3, 2026Pei Yang, Wanyi Chen, Asuka Yuxi Zheng +13LLM Agent TrainingAI Agent Reliability

  4. Position: Modular Memory is the Key to Continual Learning Agents

    Mar 2, 2026Vaggelis Dorovatas, Malte Schwerin, Andrew D. Bagdanov +21Continual Learning for LLM AgentsMemory-Augmented Agents

  5. Help Without Being Asked: A Deployed Proactive Agent System for On-Call Support with Continuous Self-Improvement

    Feb 25, 2026Fengrui Liu, Xiao He, Tieying ZhangProactive AssistanceCustomer Support Automation

  6. Your Code Agent Can Grow Alongside You with Structured Memory

    Feb 25, 2026Yi-Xuan Deng, Xiaoqin Liu, Yi Zhang +2Software Engineering AgentsMemory-Augmented Agents

  7. A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents

    Jan 18, 2026Tianxin Wei, Ting-Wei Li, Zhining Liu +26Continual Learning for LLM AgentsMulti-Agent Reasoning

  8. Evolving Programmatic Skill Networks

    Jan 7, 2026Haochen Shi, Xingdi Yuan, Bang LiuContinual Learning for LLM AgentsLLM-Based Program Synthesis

  9. Memento No More: Coaching AI Agents to Master Multiple Tasks via Hints Internalization

    Feb 3, 2025Minttu Alakuijala, Ya Gao, Georgy Ananov +4Continual Learning for LLM AgentsLLM Agent Skill Learning