LLM Agent Self-Improvement

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

44 papers in the last four weeks, up 267% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 189

All topics

DemoEvolve: Demonstration-Guided Harness Evolution under Sparse Feedback
May 23, 2026Lirong Che, Yuzhe yang, Peiwen lin +4Agent Harness Optimization LLM Agent Self-Improvement
Tsinghua University · AgiBot
SkillOpt: Executive Strategy for Self-Evolving Agent Skills
May 22, 2026Yifan Yang, Ziyang Gong, Weiquan Huang +12Large Language Model-Guided Optimization LLM Agent Self-Improvement
Microsoft · Shanghai Jiao Tong University · Tongji University +1
MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
May 21, 2026Qianshu Cai, Yonggang Zhang, Xianzhang Jia +5Software Engineering Agents LLM Agent Self-Improvement
University of Science and Technology of China · Hong Kong Generative AI Research & Development Center · The Hong Kong University of Science and Technology +1
EVE-Agent: Evidence-Verifiable Self-Evolving Agents
May 21, 2026Yamato Arai, Yuma IchikawaLLM Agent Self-Improvement LLM Agent Training
Fujitsu Limited Department of Basic Science · The University of Tokyo · Fujitsu Limited +1
Search-E1: Self-Distillation Drives Self-Evolution in Search-Augmented Reasoning
May 21, 2026Zihan Liang, Yufei Ma, Ben Chen +4Tool-Augmented Language Model Agents On-Policy Self-Distillation
Ratchet: A Minimal Hygiene Recipe for Self-Evolving LLM Agents
May 21, 2026Xing Zhang, Yanwei Cui, Guanghui Wang +4Continual Learning for LLM Agents LLM Agent Self-Improvement
AWS Generative AI Innovation Center · HSBC Holdings Plc., HSBC Technology Center, China
Echo: Learning from Experience Data via User-Driven Refinement
May 21, 2026Hande Dong, Xiaoyun Liang, Jiarui Yu +15Continual Learning for LLM Agents LLM Agent Self-Improvement
Tencent, CodeBuddy
Trace2Skill: Verifier-Guided Skill Evolution for Long-Context EDA Agents
May 20, 2026Zijian Du, Nathaniel PinckneyElectronic Design Automation Code Generation
NVIDIA · Santa Clara, CA, USA
GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation
May 20, 2026Sixiang Chen, Zhaohu Xing, Tian Ye +7Agentic Image Generation LLM Agent Self-Improvement
The Hong Kong University of Science and Technology (Guangzhou) · Meituan · The Hong Kong University of Science and Technology +1
Library Drift: Diagnosing and Fixing a Silent Failure Mode in Self-Evolving LLM Skill Libraries
May 19, 2026Xing Zhang, Yanwei Cui, Guanghui Wang +4Continual Learning for LLM Agents LLM Agent Self-Improvement
1AWS Generative AI Innovation Center · 2HSBC Holdings Plc., HSBC Technology Center, China.
Harnessing LLM Agents with Skill Programs
May 18, 2026Hongjun Liu, Yifei Ming, Shafiq Joty +1LLM Agent Self-Improvement LLM Agent Skill Learning
New York University · Salesforce AI Research
FORGE: Self-Evolving Agent Memory With No Weight Updates via Population Broadcast
May 15, 2026Igor Bogdanov, Chung-Horng Lung, Thomas Kunz +3LLM Agent Memory LLM Agent Self-Improvement
Carleton University Ottawa, Ontario, Canada · Defence R&D Canada Ottawa, Ontario, Canada · Cistel Technology Ottawa, Ontario, Canada
Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
May 14, 2026Shihao Qi, Jie Ma, Rui Xing +15Multi-Agent Collaboration LLM Agent Self-Improvement
MOE KLINNS Lab · School of Cyber Science and Engineering, Xi’an Jiaotong University · School of Software Engineering, Xi’an Jiaotong University +6
SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestration
May 13, 2026Mingda Zhang, Tiesunlong Shen, Haoran Luo +4LLM Agent Orchestration LLM Agent Self-Improvement
The Chinese University of Hong Kong, Shenzhen · National University of Singapore · Nanyang Technological University +1
PIVOT: Bridging Planning and Execution in LLM Agents via Trajectory Refinement
May 11, 2026Tuo Zhang, Alin-Ionut Popa, Yan Xu +2LLM Agent Self-Improvement Long-Horizon LLM Agents
Amazon
SkillEvolver: Skill Learning as a Meta-Skill
May 11, 2026Genrui Zhang, Erle Zhu, Jinfeng Zhou +2LLM Agent Self-Improvement LLM Agent Skill Learning
2Beijing Jiaotong University · 1Tsinghua University
Workspace Optimization: How to Train Your Agent
May 10, 2026Elad Sarafian, Gal Kaplun, Ron Banner +2Multi-Agent LLM Systems LLM Agent Self-Improvement
NVIDIA · NVIDIA & Technion
Kintsugi: Learning Policies by Repairing Executable Knowledge Bases
May 10, 2026Teng Cao, Yu Deng, Hikaru Shindo +6Robot Policy Learning LLM Agent Self-Improvement
Artificial Intelligence and Machine Learning Lab, Technical University of Darmstadt, Germany · Hessian Center for Artificial Intelligence (hessian.AI), Germany · Department of Computer Science, Technical University of Darmstadt, Germany +6
Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptation
May 10, 2026Ye Yu, Xiaopeng Yuan, Haibo Jin +3Continual Learning for LLM Agents LLM Agent Self-Improvement
University of Illinois Urbana-Champaign, IL, USA
SkillGen: Verified Inference-Time Agent Skill Synthesis
May 9, 2026Yuchen Ma, Yue Huang, Han Bao +5LLM Agent Self-Improvement LLM Agent Skill Learning
Munich Center for Machine Learning, LMU Munich · University of Notre Dame · Microsoft Research
OPT-BENCH: Evaluating the Iterative Self-Optimization of LLM Agents in Large-Scale Search Spaces
May 9, 2026Xiaozhe Li, Jixuan Chen, Xinyu Fang +4Large Language Model-Guided Optimization LLM Agent Self-Improvement
Tongji University1 · Shanghai AI Lab2 · University of California San Diego5 +2
SkillMaster: Toward Autonomous Skill Mastery in LLM Agents
May 9, 2026Min Yang, Jinghua Piao, Xu Xia +4LLM Agent Self-Improvement LLM Agent Skill Learning
Shandong University · Zhongguancun Academy · Tsinghua University +2
FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestration
May 8, 2026Zhengding Hu, Mingge Lu, Zhen Wang +8LLM Agent Orchestration LLM Agent Workflow Optimization
University of California, San Diego · Georgia Institute of Technology
SkillLens: Adaptive Multi-Granularity Skill Reuse for Cost-Efficient LLM Agents
May 8, 2026Ziyang Yu, Yongliang Miao, Liang Zhao +2LLM Agent Self-Improvement LLM Agent Skill Learning
Emory University
SHARP: A Self-Evolving Human-Auditable Rubric Policy for Financial Trading Agents
May 7, 2026Xiwen Chen, Wenhui Zhu, Songzhu Zheng +3Reinforcement Learning Credit Assignment in RL
Morgan Stanley · Arizona State University · Columbia University +1
TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planning
May 7, 2026Junkai Li, Yunghwei Lai, Tianyi Zhu +3LLM Self-Refinement Healthcare
1Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China · Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China · School of Computing, National University of Singapore, Singapore
ANNEAL: Adapting LLM Agents via Governed Symbolic Patch Learning
May 4, 2026Safayat Bin Hakim, Keyan Guo, Wenkai Tan +3LLM Agent Self-Improvement AI Agent Governance
University of Maryland, Baltimore County · University at Buffalo · University of Colorado Boulder +1
Skills-Coach: A Self-Evolving Skill Optimizer via Training-Free GRPO
Apr 30, 2026Yu Tian, Jiawei Chen, Lifan Zheng +5LLM Agent Self-Improvement LLM Agent Skill Learning
University of Chinese Academy of Sciences · 2East China Normal University · 3Zhongguancun Academy +3
Self-Evolving Software Agents
Apr 29, 2026Marco Robol, Paolo GiorginiSoftware Engineering Agents LLM Agent Self-Improvement
University of Trento · Trento, Italy
SiriusHelper: An LLM Agent-Based Operations Assistant for Big Data Platforms
Apr 29, 2026Yu Shen, Shiyang Liu, Qihang He +14Customer Support Automation LLM Agent Orchestration
TEG, Tencent Inc., China · School of Computer Science, Peking University, China

May 23, 2026, cs.AIJ/K move · Enter open · S save

DemoEvolve: Demonstration-Guided Harness Evolution under Sparse Feedback

Lirong Che, Yuzhe yang, Peiwen lin, Xu Cao+3

Tsinghua University · AgiBot

Agent Harness Optimization LLM Agent Self-Improvement Learning from Demonstration Long-Horizon LLM Agents

Open paper AskPDF arXiv

Harness evolution enables frozen language model agents to adapt to unfamiliar tasks by modifying the external programs that govern their behavior. For long-horizon tasks, each rollout is costly, and a limited interaction budget may yield few examples of effective behavior. Sparse, delayed feedback also makes it difficult for a coding agent to diagnose failures and determine which modifications will improve performance. We present DemoEvolve, which uses human demonstrations to guide harness evolution under limited interaction budgets. The coding agent examines demonstrations alongside its own rollout history, extracts strategies and the conditions under which they apply, and turns them into reusable harness components. We compare demonstration guidance with self-rollout evolution and augmentation with retrieved textual knowledge under the same evolution procedure and agent interaction budget. On held-out seeds, DemoEvolve improves mean capped final-round progress from 16.83 to 20.00 in Balatro and mean floor reached from 18.17 to 28.83 in Slay the Spire 2, compared with the respective base harnesses. These results suggest that demonstrations can help harness evolution make better use of limited interaction experience by providing concrete guidance for diagnosis and modification.

Momentum

Related topics

Latest papers 189