Continual Learning for LLM Agents

LLM: Large Language Model

Ask about this topic

Momentum

23 papers in the last four weeks, up 109% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 123

All topics
CardsList

  1. Learning Situation-Conditioned Thinking Policies for Long-Term LLM Agents

    Oct 7, 2026Hong SuLLM Agent MemoryLong-Horizon LLM Agents

    School of Computer Science, Chengdu University of Information Technology, Chengdu, China

  2. SkillCycle: Co-Evolving Agent Policies and Skill Banks

    Oct 7, 2026Ling Li, Qiuyu Shen, Zheng Jiang +3LLM Agent Skill LearningSelf-Improving Agents

    Tsinghua University · Northwestern Polytechnical University

  3. ServeLearnBench: How Well Can Agents Self-Improve from Serving Experience?

    Oct 6, 2026Haizhong Zheng, Yizhuo Di, Ranajoy Sadhukhan +2Continual Learning for LLM AgentsLLM Agent Evaluation

    Carnegie Mellon University · Amazon

  4. ASCENT: Online Test-Time Training of Long-Horizon Agents via Self-Distillation of Verified Experience

    Oct 4, 2026Haodong Lu, Dong GongContinual Learning for LLM AgentsTest-Time Training

    University of New South Wales (UNSW Sydney)

  5. EVISKILL: Grounding Skill Evolution in Replayable Evidence

    Oct 4, 2026Yan Zhou, Yili Wang, Yiwei Dai +2Continual Learning for LLM AgentsExperience Replay

    School of Artificial Intelligence, Jilin University, Changchun, China

  6. Decoupling Memory from Context: Structured Memory for Token-Efficient Test-Time Continual Learning

    Oct 2, 2026Yehya Farhat, Michael Desmond, Anastasios KyrillidisContinual Learning for LLM AgentsContinual Learning for LLMs

    Rice University, Department of Computer Science Houston, TX, USA · IBM Research Yorktown Heights, NY, USA

  7. From Knowledge Access to Source Learning: Developing Source-Specific Competence

    Oct 1, 2026Lucheng Fu, Kejing Xia, Yiyang Wang +10Continual Learning for LLM AgentsKnowledge Augmentation for Language Models

    Georgia Institute of Technology · University of Illinois at Urbana-Champaign · University of California, Los Angeles

  8. Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents

    Oct 1, 2026Beining Wu, Zihao Ding, Jun HuangContinual Learning for LLM AgentsGUI Agents

    Department of Electrical Engineering and Computer Science, South Dakota State University

  9. ReLiveGym: Evaluating Long-Lived Agents over Weeks of Replayed Reality

    Sep 30, 2026Xisen Jin, Jingheng Li, Zhenglun Chen +2Continual Learning for LLM AgentsLong-Horizon Agent Evaluation

    Sahara AI · University of Southern California

  10. OverForge: Reasoning Through Strategies and Tactics Helps Cooperative Lifelong Adaptation

    Sep 30, 2026Oana Madalina Fron, Ojas Shirekar, Chirag RamanContinual Learning for LLM AgentsMulti-Agent LLM Systems

    Tapri Lab, Department of Pattern Recognition and Bioinformatics, Delft University of Technology, Delft, The Netherlands

  11. Self-Evolving Harness on Multiple Tasks with the Agent as Its Own Optimizer

    Sep 29, 2026Qiankai XuContinual Learning for LLM AgentsAI Agent Evaluation

    Nanjing University

  12. Semantic Projection for Continual Self-Evolution of Language Agents

    Sep 29, 2026Ziyu Liu, Jun Chen, Lixu WangContinual Learning for LLM AgentsLLM Agent Skill Learning

    University of Pennsylvania · Hark · The Chinese University of Hong Kong, Shenzhen

  13. Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agents

    Sep 28, 2026Tong Zhao, Reed Li, Yuyang Hu +5Continual Learning for LLM AgentsTest-Time Training

    Renmin University of China · Tencent

  14. Self-Evolving Agents via Likelihood-Guided Tool-Space Optimization

    Sep 28, 2026Xuanqi Zhang, Ruinan Jin, Running Yang +4Continual Learning for LLM AgentsLLM Agent Self-Improvement

    University of British Columbia · Vector Institute · Columbia University

  15. NLPG: Natural-Language Policy Gradients for Self-Evolving Language Agents

    Sep 27, 2026Xu Liu, WenZhang Wei, Jun Cao +4Continual Learning for LLM AgentsPolicy Optimization

    School of Electronic Information, Wuhan University, Wuhan 430079, China · School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

  16. SCLATE: a Substrate for Continual-Learning Agent Training and Evaluation

    Sep 26, 2026Youngmok Jung, Sirajul Salekin, Henry Tran +3Continual Learning for LLM AgentsLong-Horizon Agent Evaluation

    Apple

  17. Scope Before You Persist: Preventing Cross-Family Interference in Agent Memory

    Sep 24, 2026Yezhou Cheng, Runjia Du, Zeming Liu +5Agent MemoryContinual Learning for LLM Agents

    Independent · Northwestern University · Pinterest, Inc.

  18. CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agents

    Sep 22, 2026Trang Nguyen, Eulrang Cho, Bingqing Chen +1Continual Learning for LLM AgentsTest-Time Scaling

    Carnegie Mellon University · Bosch Center for AI

  19. RPMem: Learning Long-Term Recurrent Parametric Memory Across Sessions for LLM Agents

    Sep 20, 2026Fanyu Zhao, Ruike Cao, Liang Dong +6Continual Learning for LLM AgentsLLM Agent Memory

    Fudan University · Qwen Business Unit of Alibaba

  20. An Architecture for Long-Horizon Agents: Levels, Ticks and Cascaded Intelligence

    Sep 17, 2026Erik Nijkamp, Anurag Koul, Egor Pakhomov +1Cognitive Architectures for AI AgentsContinual Learning for LLM Agents

    Salesforce AI Research

  21. CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents

    Sep 16, 2026Jiaxuan Jiang, Liyuan He, Zhixuan FangContinual Learning for LLM AgentsMulti-Agent Systems

    IIIS, Tsinghua University, Beijing, China · Shanghai Qi Zhi Institute, Shanghai, China · School of Artificial Intelligence, Shanghai Jiao Tong University, Shanghai, China

  22. ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents

    Sep 15, 2026Shuhan Xue, Jianyuan Zhong, Ziyuan Nan +10Continual Learning for LLM AgentsAI-Assisted Scientific Research

  23. EMR: Self-Evolving Medical Multi-Agent System via Experience Mining and Reuse

    Sep 14, 2026Dongsheng Shi, Yue Li, Xin Yi +1Continual Learning for LLM AgentsMulti-Agent LLM Systems

    East China Normal University · City University of Hong Kong

  24. LifeMem: Enabling Lifelong Experience Reuse for LLM Agents

    Sep 14, 2026Yuli Qiu, Yutong Li, Wei Su +5Continual Learning for LLM AgentsLLM Agent Skill Learning

    School of Computer Science and Technology, Beijing Institute of Technology · School of Computer Science and Engineering, Beihang University · Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology +1

  25. When Synthetic Data Hurts: On Catastrophic Forgetting in Skill Retrieval for LLM Agents

    Sep 12, 2026Syed Shariyar Murtaza, Yifan Nie, Utkarsh Soni +2Continual Learning for LLM AgentsFine-Tuning

    Manulife, 200 Bloor St E, Toronto, ON M4W 1E5, Canada

  26. Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents

    Sep 8, 2026Wenbo Gao, Zhaomou Song, Zhiyuan Ji +7Continual Learning for LLM AgentsAgent Skill Learning

    1The Hong Kong Polytechnic University · 2Huawei · 3Renmin University of China

  27. SkillGLoW: Procedural-Family Skill Consolidation for Self-Improving Agents on Long-Horizon Task Streams

    Sep 2, 2026Ao Yan, Xin Zhang, Jiawei Du +1LLM Agent Skill LearningContinual Learning for LLM Agents

    National University of Singapore, Singapore · Institute of Advanced Intelligence and Computing (IAIC), Singapore

  28. PRACTICE: From Experience to Expertise in Self-Evolving Embodied Agents

    Aug 31, 2026Ziyi Bai, Siqi Li, Tinglei Huang +1Continual Learning for LLM AgentsRobot Skill Learning

    Beijing Academy of Artificial Intelligence (BAAI) · Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences

  29. Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidation

    Aug 23, 2026Wenzhi Li, Dong Nie, Rui Lan +7Continual Learning for LLM AgentsContinual Learning

    Zhejiang University · Indepedent Researcher · Xiaohongshu +2

  30. Harness Continual Learning: Continual Adaptation Beyond Model Parameters

    Aug 19, 2026Borui Kang, Jinrui Gu, Junhan Lv +3Continual Learning for LLM AgentsContinual Learning

    State Key Laboratory for Novel Software Technology, Nanjing University, China · University of Wollongong, Australia

  31. Evo-Harness: Context-to-Harness Skill Compilation for Self-Evolving Agents

    Aug 15, 2026Tianxin Wei, Zhan Shi, Minhua Lin +14Continual Learning for LLM AgentsLLM Agent Skill Learning

    University of Illinois Urbana-Champaign · Amazon · The Pennsylvania State University +3

  32. Towards a Formal Definition of Agent Memory: Basis, Span, Optimality, and the Sequential Memory Problem

    Aug 12, 2026Hongyao TangAgent MemoryContinual Learning for LLM Agents

    Tianjin University

  33. MERA: Model Evolution and Routing with Skill Adaptation for Agentic Systems at Scale

    Aug 11, 2026Yuhang Yao, Zeyu Wang, Wanyi Chen +8Continual Learning for LLM AgentsLLM Fine-Tuning

    Carnegie Mellon University · University of California, Los Angeles · Soochow University +3

  34. Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA

    Aug 10, 2026Mind Lab, :, Vin Bo +74Continual Learning for LLM AgentsAgentic RL

  35. OpenLoopEvolve: A Verifiable Self-Evolution Framework for Loop Policies in Long-Horizon Complex Tasks

    Aug 10, 2026Siqi Wang, Xinlin Li, Zhenglin Li +1Continual Learning for LLM AgentsLong-Horizon LLM Agents

  36. Agentic Router: An Execution-Grounded Continual Learning Approach With Memory

    Aug 10, 2026Yuxuan Chen, Rongpeng Li, Zhifeng Zhao +3Continual Learning for LLM AgentsLLM Agents

    Zhejiang University, Hangzhou 310027, China · Zhejiang Lab, Hangzhou 310012, China · State Grid Hebei Electric Power Co., Ltd., Hebei, China +1

  37. Tree-of-Experience: Hierarchical Experience Management for Self-Evolving Agents

    Aug 10, 2026Zihao Deng, Yining Zhu, Leiming Wang +6Continual Learning for LLM AgentsLLM Agent Self-Improvement

  38. EMAS: Stabilizing Multi-Agent System Evolution through Evidence-Guided Revision

    Aug 7, 2026Chao Fei, Qingyi Si, Kaihua Liang +3Continual Learning for LLM AgentsMulti-Agent System Optimization

    King Abdullah University of Science and Technology (KAUST) · Fudan University

  39. Controlled Memory Interference in Continual LLM Agents

    Aug 7, 2026Ao Ding, Hongzong LI, Shiqin Tang +4Continual Learning for LLM AgentsAgent Memory Poisoning

    China University of Geosciences (Beijing) · Northwestern Polytechnical University · The Hong Kong University of Science and Technology +4

  40. Learning Globally Reusable Skills for Coding Agents

    Aug 6, 2026Chen Yang, Jiashuo Tian, Ziqi Wang +3Continual Learning for LLM AgentsSoftware Engineering Agents

    Tianjin University · Tsinghua University

  41. ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?

    Aug 4, 2026Tianyi Guan, Yiding Wang, Haotong Yang +5Continual Learning for LLM AgentsLLM Agent Evaluation

    Institute for Artificial Intelligence, Peking University · 2Beijing Institute for General Artificial Intelligence

  42. AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injection

    Aug 4, 2026Shihao Weng, Yang Feng, Xiaofei Xie +1Continual Learning for LLM AgentsLLM Agent Security

    Nanjing University · Singapore Management University · Nanyang Technological University

  43. ESCROW: Guarded and Dual-Objective Continual Maintenance for Agents in Policy-Governed Enterprise Workflows

    Aug 3, 2026Ruoqi Shu, Chen Dan, Xuhui Wang +4Continual Learning for LLM AgentsBusiness Process Automation

    BMO Financial Group

  44. CoEvo-Mem: Co-Evolving Retrieval Policy and Memory Bank for LLM Agents

    Aug 3, 2026Bowen Ye, Yongchao Xu, Zhijian Li +3Continual Learning for LLM AgentsAdaptive RAG

    Alibaba Group, Hangzhou, China · School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China · University of Science and Technology of China, Hefei, China

  45. Learning What to Remember and What to Internalize in LLM Self-Evolution via Adaptive Memory-Parameter Coordination

    Aug 2, 2026Tianyun Ji, Zhenya Huang, Jiayu Liu +3Continual Learning for LLM AgentsAgent Harness Optimization

    University of Science and Technology of China Hefei, Anhui, China · City University of Hong Kong Hong Kong, China · Hefei Normal University Hefei, Anhui, China +1

  46. PATH-Bench: Path-Dependent Evaluation of Lifelong Agents

    Aug 2, 2026Xidong Yang, Xingyi Zhang, Wenhao Li +7Continual Learning for LLM AgentsLifelong Learning Agents

    East China Normal University · Tongji University · Ant Group +5

  47. CrystalMem: Elastic Memory for Self-Evolving LLM Agents via Knowledge Crystallization

    Jul 31, 2026Beining Wu, Jun HuangAgent MemoryContinual Learning for LLM Agents

    Department of Electrical Engineering and Computer Science, South Dakota State University, Brookings, SD 57006 USA

  48. UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams

    Jul 28, 2026Siyu Xia, Chenheng Zhang, Yanting Wu +8Continual Learning for LLM AgentsOnline Continual Learning

    Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, China · State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University +3

  49. Learning on the Job: Continual Learning from Deployment Feedback for Frozen-Weights Agents

    Jul 24, 2026Valentin Tablan, Scott Taylor, Kristoffer BernhemContinual Learning for LLM AgentsContinual Learning

    The Memory Company

  50. Recursive Harness Self-Improvement

    Jul 17, 2026Hyunin Lee, Jinglue Xu, Jeffrey Seely +3Continual Learning for LLM AgentsAgent Harness Optimization

    1Sakana AI, 2UC Berkeley

  51. Do Agent Optimizers Compound? A Continual-Learning Evaluation on Terminal-Bench 2.0

    Jul 15, 2026Wenxiao Wang, Priyatham Kattakinda, Soheil FeiziContinual Learning for LLM AgentsAgent Harness Optimization

  52. Self-Improving AI Coding Agents Through Accumulated Behavioral Rules: A Closed-Loop Framework

    Jul 13, 2026Aditya Aggarwal, Nahid Farhady GhalatyLLM Self-CorrectionContinual Learning for LLM Agents

    Microsoft

  53. ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory

    Jul 11, 2026Jiayi Tian, Shiao Liu, Yuting Xu +30Continual Learning for LLM AgentsRobotics

    AMAP CV Lab Alibaba Group

  54. Auto: The AGI Compiler

    Jul 5, 2026Jaber Jaber, Osama JaberContinual Learning for LLM AgentsLLM-Based Program Synthesis

    RightNow AI

  55. UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

    Jul 5, 2026Niu Lian, Alan Chen, Zhehao Yu +8Continual Learning for LLM AgentsGUI Agents

    Tsinghua Shenzhen International Graduate School, Tsinghua University · Harbin Institute of Technology, Shenzhen · Zhejiang University +2

  56. No Time Like the Present: Agentic Test-Time Training for LLM Agents

    Jul 3, 2026Yanbo Wang, Jinhua Hao, Yuze Shi +2Continual Learning for LLM AgentsTest-Time Training

    Kuaishou Technology

  57. Object-Centric Environment Modeling for Agentic Tasks

    Jul 3, 2026Yiyang Li, Tianyi Ma, Zehong Wang +2Continual Learning for LLM AgentsWorld Models

    University of Notre Dame · †Corresponding Author

  58. The Past Is Prologue: A Plug-in Controller for Selective Updates in Sequentially Evolving LLM Memory

    Jun 30, 2026Zihan Chen, Songwei Dong, Chengshuai Shi +4Continual Learning for LLM AgentsPersistent Memory for Language Models

    University of Virginia · Princeton University · University of Central Florida

  59. AhaBench: Do Agents Turn Experience into Reusable Insights? A Long-Horizon Benchmark for Continual Learning

    Jun 30, 2026Zerui Cheng, Jiawei Xu, Huacan Chai +3Continual Learning for LLM AgentsLifelong Learning Agents

    Princeton University · Tencent Hy · Tsinghua University +2

  60. Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineering

    Jun 29, 2026Yongbin Kim, Yashar Talebirad, Osmar R. ZaianeContinual Learning for LLM AgentsMulti-Agent LLM Systems

    Department of Computing Science, University of Alberta, Edmonton, Canada · Alberta Machine Intelligence Institute (Amii), Edmonton, Canada