Overview

Lifelong learning agents study how AI systems can keep adapting through ongoing interaction instead of relying only on a fixed training phase. Common approaches include persistent memory and selective retrieval, extracting and composing reusable skills, online reinforcement learning, and updating or combining policies as tasks change. Researchers evaluate these methods in long-horizon settings such as embodied navigation, simulated worlds, web tasks, and multi-session conversations, where agents must both improve and retain earlier capabilities. A central challenge is deciding what experience to preserve and when to reuse it: helpful transfer can also cause forgetting, interference, or reliance on outdated information.

Latest papers

CardsList

59 papers10 papers in the last four weeks, up 25% on the four weeks before. 0.1% of all new papers.

  1. Toward Knowledge-Centric AI: Discovering, Internalizing, and Using Explicit Knowledge Across Agents and Generations

    Nov 2, 2026Yisen Gao, Haoyu Huang, Zhongwei Xie +7Knowledge RepresentationLifelong Learning Agents

  2. Skill++: Towards Lifelong Agents via Routing-Aware Skill Refinement

    Oct 31, 2026Hanrong Zhang, Minghao Liang, Jiawei Wu +10LLM Agent Skill RetrievalContinual Learning for LLM Agents

  3. Continual Reinforcement Learning Is an Integration Problem

    Oct 30, 2026Nis Meinert, Jakob Gawlikowski, Edward Grant +6Continual RLLifelong Learning Agents

  4. Ask to Evolve: A Unified Harness for Lifelong Embodied Navigation with Hybrid Action Space and Persistent Memory

    Oct 29, 2026Kai Sheng, Liuyi Wang, Jinlong Li +3Embodied NavigationLifelong Learning Agents

  5. VEvo-Harness: Causally-Guarded Self-Evolving Harness for Agentic Image Generation

    Oct 29, 2026Yuan Wang, Yuhang Yu, Mengting Chen +4Agentic Image GenerationSelf-Improving Agents

  6. Holding a Steady Course: Knowledge Evolution from Expertise and Lessons for Continual Agent Learning

    Oct 25, 2026Wenzhe Fan, Benjamin Steenhoek, Gaurav Mittal +1Lifelong Learning AgentsAgent Skill Learning

  7. Phronix: The Capability-Centric Learning Paradigm for Agents

    Oct 22, 2026Hariharan Devarajan, Neeraj Rajesh, Aniruddha Marathe +3LLM Agent Skill LearningLLM Agent Harnesses

  8. Learning What to Remember: Resource-Efficient Self-Improvement for Lifelong Agents

    Oct 19, 2026Guannan Lai, Zi-Yang Bai, Jun-Peng Jiang +1Memory Management for LLM AgentsLifelong Learning Agents

  9. Selm: Self-Evolving Library Management for Multi-Skill Agent Optimization

    Oct 17, 2026Mengxi Hu, Yuxuan Hu, Jinbo Su +6LLM Agent Skill LearningLLM Agents

  10. AgentGarten: Code Worlds for Evolving Agents

    Oct 8, 2026Jiawei Chi, Shangchen Miao, Zhiyuan Shi +12Self-Evolving AgentsNeural Rendering

  11. How to Find and Reuse Policies for Continuous Adaptation in Lifelong Reinforcement Learning

    Oct 2, 2026Saptarshi Nath, Inish M. D'Souza, Antonio Carta +2Continual RLLifelong Learning Agents

  12. Learning from Research: Toward Lifelong Agent Harness Evolution

    Sep 30, 2026Jingbo Yang, Kwei-Herng Lai, Xiaowen Wang +3Large Language Model-Guided OptimizationLifelong Learning Agents

  13. ASENA: Self-evolving Agents for Embodied Navigation

    Sep 30, 2026An-Chieh Cheng, Isabella Liu, Edmund Bu +7Embodied NavigationLarge Language Model-Based Robot Planning

  14. STRATA: Self-Learning Through Role-Aligned Tiered Agents for Real-Time Strategy Games

    Sep 30, 2026Xinhe Tian, Xiaoyue Zhang, Ziyou Zhang +4Multi-Agent CoordinationGame-Playing Agents

  15. CORTEX: A Verified Experience Layer for Generalist Agents

    Sep 27, 2026Garapati Keerthana, Manik GuptaAI Agent ReliabilityLifelong Learning Agents

  16. ThinkFlow: Self-Evolving Probabilistic Latent Memory for Lifelong Conversational Agents

    Sep 15, 2026Cai Ke, Xin Liu, Han Zhang +6Test-Time AdaptationLifelong Learning Agents

  17. Agents in the Large: Perception-Centered Architecture for Persistent Agents

    Aug 31, 2026Shihan Dou, Haoxiang Jia, Shichun Liu +14Cognitive Architectures for AI AgentsLifelong Learning Agents

  18. TimeSage-EV: A Live Benchmark for Agentic Time Series Analysis in Evolving Environments

    Aug 14, 2026Qingren Yao, Yaxuan Kong, Yuqi Nie +6Agentic Time Series ForecastingTime Series QA

  19. Quo Vadis, World Modeling?

    Aug 3, 2026Yu Yang, Xuemeng Yang, Licheng Wen +17World Model LearningLifelong Learning Agents

  20. PATH-Bench: Path-Dependent Evaluation of Lifelong Agents

    Aug 2, 2026Xidong Yang, Xingyi Zhang, Wenhao Li +7Continual Learning for LLM AgentsLifelong Learning Agents

  21. Multi-scale Mixture of World Models for Embodied Agents in Evolving Environments

    Jul 1, 2026Jinwoo Jang, Daniel J. Rho, Sihyung Yoon +2World Model LearningWorld Models

  22. AhaBench: Do Agents Turn Experience into Reusable Insights? A Long-Horizon Benchmark for Continual Learning

    Jun 30, 2026Zerui Cheng, Jiawei Xu, Huacan Chai +3Continual Learning for LLM AgentsLifelong Learning Agents