Continual Learning for LLM Agents

LLM: Large Language Model

Ask about this topic

Momentum

23 papers in the last four weeks, up 109% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 123

All topics
CardsList

  1. Learning Situation-Conditioned Thinking Policies for Long-Term LLM Agents

    Oct 7, 2026Hong SuLLM Agent MemoryLong-Horizon LLM Agents

    School of Computer Science, Chengdu University of Information Technology, Chengdu, China

  2. SkillCycle: Co-Evolving Agent Policies and Skill Banks

    Oct 7, 2026Ling Li, Qiuyu Shen, Zheng Jiang +3LLM Agent Skill LearningSelf-Improving Agents

    Tsinghua University · Northwestern Polytechnical University

  3. ServeLearnBench: How Well Can Agents Self-Improve from Serving Experience?

    Oct 6, 2026Haizhong Zheng, Yizhuo Di, Ranajoy Sadhukhan +2Continual Learning for LLM AgentsLLM Agent Evaluation

    Carnegie Mellon University · Amazon

  4. ASCENT: Online Test-Time Training of Long-Horizon Agents via Self-Distillation of Verified Experience

    Oct 4, 2026Haodong Lu, Dong GongContinual Learning for LLM AgentsTest-Time Training

    University of New South Wales (UNSW Sydney)

  5. EVISKILL: Grounding Skill Evolution in Replayable Evidence

    Oct 4, 2026Yan Zhou, Yili Wang, Yiwei Dai +2Continual Learning for LLM AgentsExperience Replay

    School of Artificial Intelligence, Jilin University, Changchun, China

  6. Decoupling Memory from Context: Structured Memory for Token-Efficient Test-Time Continual Learning

    Oct 2, 2026Yehya Farhat, Michael Desmond, Anastasios KyrillidisContinual Learning for LLM AgentsContinual Learning for LLMs

    Rice University, Department of Computer Science Houston, TX, USA · IBM Research Yorktown Heights, NY, USA

  7. From Knowledge Access to Source Learning: Developing Source-Specific Competence

    Oct 1, 2026Lucheng Fu, Kejing Xia, Yiyang Wang +10Continual Learning for LLM AgentsKnowledge Augmentation for Language Models

    Georgia Institute of Technology · University of Illinois at Urbana-Champaign · University of California, Los Angeles

  8. Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents

    Oct 1, 2026Beining Wu, Zihao Ding, Jun HuangContinual Learning for LLM AgentsGUI Agents

    Department of Electrical Engineering and Computer Science, South Dakota State University

  9. ReLiveGym: Evaluating Long-Lived Agents over Weeks of Replayed Reality

    Sep 30, 2026Xisen Jin, Jingheng Li, Zhenglun Chen +2Continual Learning for LLM AgentsLong-Horizon Agent Evaluation

    Sahara AI · University of Southern California

  10. OverForge: Reasoning Through Strategies and Tactics Helps Cooperative Lifelong Adaptation

    Sep 30, 2026Oana Madalina Fron, Ojas Shirekar, Chirag RamanContinual Learning for LLM AgentsMulti-Agent LLM Systems

    Tapri Lab, Department of Pattern Recognition and Bioinformatics, Delft University of Technology, Delft, The Netherlands

  11. Self-Evolving Harness on Multiple Tasks with the Agent as Its Own Optimizer

    Sep 29, 2026Qiankai XuContinual Learning for LLM AgentsAI Agent Evaluation

    Nanjing University

  12. Semantic Projection for Continual Self-Evolution of Language Agents

    Sep 29, 2026Ziyu Liu, Jun Chen, Lixu WangContinual Learning for LLM AgentsLLM Agent Skill Learning

    University of Pennsylvania · Hark · The Chinese University of Hong Kong, Shenzhen

  13. Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agents

    Sep 28, 2026Tong Zhao, Reed Li, Yuyang Hu +5Continual Learning for LLM AgentsTest-Time Training

    Renmin University of China · Tencent

  14. Self-Evolving Agents via Likelihood-Guided Tool-Space Optimization

    Sep 28, 2026Xuanqi Zhang, Ruinan Jin, Running Yang +4Continual Learning for LLM AgentsLLM Agent Self-Improvement

    University of British Columbia · Vector Institute · Columbia University

  15. NLPG: Natural-Language Policy Gradients for Self-Evolving Language Agents

    Sep 27, 2026Xu Liu, WenZhang Wei, Jun Cao +4Continual Learning for LLM AgentsPolicy Optimization

    School of Electronic Information, Wuhan University, Wuhan 430079, China · School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

  16. SCLATE: a Substrate for Continual-Learning Agent Training and Evaluation

    Sep 26, 2026Youngmok Jung, Sirajul Salekin, Henry Tran +3Continual Learning for LLM AgentsLong-Horizon Agent Evaluation

    Apple

  17. Scope Before You Persist: Preventing Cross-Family Interference in Agent Memory

    Sep 24, 2026Yezhou Cheng, Runjia Du, Zeming Liu +5Agent MemoryContinual Learning for LLM Agents

    Independent · Northwestern University · Pinterest, Inc.

  18. CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agents

    Sep 22, 2026Trang Nguyen, Eulrang Cho, Bingqing Chen +1Continual Learning for LLM AgentsTest-Time Scaling

    Carnegie Mellon University · Bosch Center for AI

  19. RPMem: Learning Long-Term Recurrent Parametric Memory Across Sessions for LLM Agents

    Sep 20, 2026Fanyu Zhao, Ruike Cao, Liang Dong +6Continual Learning for LLM AgentsLLM Agent Memory

    Fudan University · Qwen Business Unit of Alibaba

  20. An Architecture for Long-Horizon Agents: Levels, Ticks and Cascaded Intelligence

    Sep 17, 2026Erik Nijkamp, Anurag Koul, Egor Pakhomov +1Cognitive Architectures for AI AgentsContinual Learning for LLM Agents

    Salesforce AI Research

  21. CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents

    Sep 16, 2026Jiaxuan Jiang, Liyuan He, Zhixuan FangContinual Learning for LLM AgentsMulti-Agent Systems

    IIIS, Tsinghua University, Beijing, China · Shanghai Qi Zhi Institute, Shanghai, China · School of Artificial Intelligence, Shanghai Jiao Tong University, Shanghai, China

  22. ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents

    Sep 15, 2026Shuhan Xue, Jianyuan Zhong, Ziyuan Nan +10Continual Learning for LLM AgentsAI-Assisted Scientific Research

  23. EMR: Self-Evolving Medical Multi-Agent System via Experience Mining and Reuse

    Sep 14, 2026Dongsheng Shi, Yue Li, Xin Yi +1Continual Learning for LLM AgentsMulti-Agent LLM Systems

    East China Normal University · City University of Hong Kong

  24. LifeMem: Enabling Lifelong Experience Reuse for LLM Agents

    Sep 14, 2026Yuli Qiu, Yutong Li, Wei Su +5Continual Learning for LLM AgentsLLM Agent Skill Learning

    School of Computer Science and Technology, Beijing Institute of Technology · School of Computer Science and Engineering, Beihang University · Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology +1

  25. When Synthetic Data Hurts: On Catastrophic Forgetting in Skill Retrieval for LLM Agents

    Sep 12, 2026Syed Shariyar Murtaza, Yifan Nie, Utkarsh Soni +2Continual Learning for LLM AgentsFine-Tuning

    Manulife, 200 Bloor St E, Toronto, ON M4W 1E5, Canada

  26. Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents

    Sep 8, 2026Wenbo Gao, Zhaomou Song, Zhiyuan Ji +7Continual Learning for LLM AgentsAgent Skill Learning

    1The Hong Kong Polytechnic University · 2Huawei · 3Renmin University of China

  27. SkillGLoW: Procedural-Family Skill Consolidation for Self-Improving Agents on Long-Horizon Task Streams

    Sep 2, 2026Ao Yan, Xin Zhang, Jiawei Du +1LLM Agent Skill LearningContinual Learning for LLM Agents

    National University of Singapore, Singapore · Institute of Advanced Intelligence and Computing (IAIC), Singapore

  28. PRACTICE: From Experience to Expertise in Self-Evolving Embodied Agents

    Aug 31, 2026Ziyi Bai, Siqi Li, Tinglei Huang +1Continual Learning for LLM AgentsRobot Skill Learning

    Beijing Academy of Artificial Intelligence (BAAI) · Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences

  29. Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidation

    Aug 23, 2026Wenzhi Li, Dong Nie, Rui Lan +7Continual Learning for LLM AgentsContinual Learning

    Zhejiang University · Indepedent Researcher · Xiaohongshu +2

  30. Harness Continual Learning: Continual Adaptation Beyond Model Parameters

    Aug 19, 2026Borui Kang, Jinrui Gu, Junhan Lv +3Continual Learning for LLM AgentsContinual Learning

    State Key Laboratory for Novel Software Technology, Nanjing University, China · University of Wollongong, Australia