LLM Agent Self-Improvement

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

44 papers in the last four weeks, up 267% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 189

All topics

SkillChain: Closing the Loop on Skill Evolution for Image-Based E-Commerce AI Assistants
Jun 11, 2026Yimin Hu, Mengtao Xu, Hao Guo +3LLM Agent Self-Improvement LLM Agent Skill Learning
Alibaba Group
Fantastic Scientific Agents and How to Build Them: AgentBuild for Rietveld Refinement
Jun 11, 2026Woong Shin, Craig A. Bridges, Marshall T. McDonnell +1AI Agents for Scientific Discovery LLM Agent Self-Improvement
Oak Ridge National Laboratory, Oak Ridge, TN, USA
EEVEE: Towards Test-time Prompt Learning in the Real World for Self-Improving Agents
Jun 9, 2026Weixian Xu, Shilong Liu, Mengdi WangContinual Learning for LLM Agents LLM Agent Self-Improvement
Shanghai Jiao Tong University · Princeton University
Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution
Jun 9, 2026Xucong Wang, Ziyu Ma, Shidong Yang +4LLM Agent Self-Improvement LLM Agent Training
University of Science and Technology of China · AMAP, Alibaba Group
SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinement
Jun 9, 2026Srishti Gautam, Arjun Radhakrishna, Sumit GulwaniLLM Self-Refinement LLM Agent Self-Improvement
Microsoft
Regimes: An Auditable, Held-Out-Gated Improvement Loop Demonstrated on LongMemEval with ActiveGraph
Jun 8, 2026Yohei NakajimaAgent Failure Analysis AI Agent Evaluation
Untapped Capital activegraph.ai
OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamics
Jun 8, 2026Mingxian Lin, Shengju Qian, Yuqi Liu +9VLM Evaluation Game-Playing Agents
1The University of Hong Kong · 2LIGHTSPEED · 3The Chinese University of Hong Kong +1
Multi-Turn Evaluation of Deep Research Agents Under Process-Level Feedback
Jun 8, 2026Rishabh Sabharwal, Hongru Wang, Amos Storkey +1Deep Research Agents AI Agent Evaluation
School of Informatics, University of Edinburgh, United Kingdom · Huawei Technologies Co., Ltd., Edinburgh, United Kingdom
From 0-to-1 to 1-to-N: Reproducible Engineering Evidence for MetaAI Recursive Self-Design
Jun 8, 2026Dun Li, Jiatao Li, Hongzhi LiLLM Agent Self-Improvement Self-Improving Agents
Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China · Merchant Marine College, Shanghai Maritime University, Shanghai 201306, China · College of Big Data and Artificial Intelligence, Chizhou University, Chizhou 247100, China
Self-Harness: Harnesses That Improve Themselves
Jun 8, 2026Hangfan Zhang, Shao Zhang, Kangcong Li +5Agent Harness Optimization LLM Agent Self-Improvement
Shanghai Artificial Intelligence Laboratory
Bayesian-Agent: Posterior-Guided Skill Evolution for LLM Agent Harnesses
Jun 6, 2026Xiaojun Wu, Cehao Yang, Honghao Liu +7Agent Harness Optimization LLM Agent Workflow Optimization
1IDEA Research · 2The Hong Kong University of Science and Technology (Guangzhou) · 3DataArcTech Ltd.
SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization
Jun 4, 2026Qi Zhang, Zhaopeng Feng, Xiaonan Shi +8LLM Agent Self-Improvement LLM Agent Skill Learning
1Zhejiang University · 2Tongyi Lab · 3National University of Singapore
Evolving Agents in the Dark: Retrospective Harness Optimization via Self-Preference
Jun 4, 2026Wenbo Pan, Shujie Liu, Chin-Yew Lin +5Software Engineering Agents Agent Harness Optimization
City University of Hong Kong · Microsoft Research Asia
Parthenon Law: A Self-Evolving Legal-Agent Framework
Jun 3, 2026Hejia Geng, Leo LiuLLM Agent Evaluation LLM Agent Self-Improvement
SePO: Self-Evolving Prompt Agent for System Prompt Optimization
Jun 3, 2026Wangcheng Tao, Han Wu, Weng-Fai WongLLM Agent Self-Improvement Automatic Prompt Optimization
National University of Singapore · City University of Hong Kong
FederatedSkill: Federated Learning for Agentic Skill Evolution
Jun 2, 2026Jingbo Yang, Guanyu Yao, Yang Zhang +3LLM Agent Self-Improvement LLM Agent Skill Learning
UC Santa Barbara · MIT-IBM Watson AI Lab · Cisco Research
Better with Experience: Self-Evolving LLM Agents for Evidence-Grounded Health Community Notes
Jun 1, 2026Zihang Fu, Fanxiao Li, Jianyang Gu +5Healthcare LLM Agent Self-Improvement
National University of Singapore · Yunnan University · The Ohio State University +1
HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems
Jun 1, 2026Mingju Chen, Can Lv, Guibin Zhang +2Agent Harness Optimization LLM Agent Self-Improvement
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, School of Artificial Intelligence, Beihang University · Tsinghua University
Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams
Jun 1, 2026Zewen Liu, Zhan Shi, Yisi Sang +7Continual Learning for LLM Agents Agent Harness Optimization
Emory University · Amazon · The Pennsylvania State University +2
SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
May 31, 2026Yuxuan Liu, Zhaochen Su, Lingyun Xie +11LLM Agent Self-Improvement LLM Agent Skill Learning
The Hong Kong University of Science and Technology · Harbin Institute of Technology · Harbin Institute of Technology, Shenzhen +2
AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
May 29, 2026Weitong Qian, Beicheng Xu, Zhongao Xie +16Multi-Agent LLM Systems LLM Agent Memory
Peking University, Beijing, China
MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
May 29, 2026Bowen Ren, Heyan Huang, Yinghao Li +1Continual Learning for LLM Agents LLM Agent Self-Improvement
School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China · Beijing Institute of Technology Southeast Academy of Information Technology, Putian, China
Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
May 28, 2026Minhua Lin, Juncheng Wu, Zijun Wang +14LLM Agent Evaluation Agent Harness Optimization
1The Pennsylvania State University · 2UC Santa Cruz · 3Amazon +3
GRASP: Gated Regression-Aware Skill Proposer for Self-Improving LLM Agents
May 28, 2026Johannes Moll, Jean-Philippe Corbeil, Jiazhen Pan +4LLM Agent Self-Improvement LLM Agent Skill Learning
1Technical University of Munich and TUM University Hospital · 2Microsoft Healthcare & Life Sciences
SkillBrew: Multi-Objective Curation of Skill Banks for LLM Agents
May 28, 2026Wentao Hu, Zhendong Chu, Yiming Zhang +6LLM Agent Self-Improvement LLM Agent Skill Learning
City University of Hong Kong · Squirrel Ai Learning · University of Science and Technology of China +4
SkillGrad: Optimizing Agent Skills Like Gradient Descent
May 26, 2026Hanyu Wang, Yifan Lan, Bochuan Cao +2Large Language Model-Guided Optimization LLM Agent Self-Improvement
College of Information Sciences and Technology The Pennsylvania State University University Park, PA, USA
Libra: Training the Environment for Agentic Information Retrieval
May 26, 2026Xuan Zhao, Andy Chiu, Gengyu WangAI Coding Agents LLM Agent Self-Improvement
Salesforce
SIA: Self Improving AI with Harness & Weight Updates
May 26, 2026Prannay Hebbar, Yogendra Manawat, Samuel Verboomen +4Agent Harness Optimization LLM Agent Self-Improvement
Hexo Labs Palo Alto · Hexo Labs Brussels · University of Oxford +1
CyberEvolver: Structured Self-Evolution for Cybersecurity Agents On the Fly
May 25, 2026Yihe Fan, Changyi Li, Lichen Xu +4LLM Agent Self-Improvement Automated Penetration Testing
Fudan University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China · Shanghai Pudong Research Institute of Cryptology
SetupX: Can LLM Agents Learn from Past Failures in Functionality-Correct Code Repository Setup?
May 25, 2026Zihang Zhou, Ziqian Ren, Yukai Wu +7Software Engineering Agents LLM Agent Self-Improvement
Shanghai Jiao Tong University · Beijing University of Posts and Telecommunications · Independent Researcher +2

Jun 11, 2026, cs.CLJ/K move · Enter open · S save

SkillChain: Closing the Loop on Skill Evolution for Image-Based E-Commerce AI Assistants

Yimin Hu, Mengtao Xu, Hao Guo, Yuheng Song+2

Alibaba Group

LLM Agent Self-Improvement LLM Agent Skill Learning Tool-Using Vision-Language Agents E-Commerce

Open paper AskPDF arXiv

Image-based AI assistants are now deployed at production scale on e-commerce platforms, where a single uploaded image can trigger fundamentally different user intents: product search, style recommendation, visual encyclopedia, or utility tool calls, each demanding its own response format, tool invocation, and domain knowledge. Without per-intent behavioral constraints, LLM-based systems conflate these heterogeneous modes and fall short of domain quality standards, while the breadth and dynamism of the intent space render manual engineering infeasible. To address this, we present SkillChain, which closes the production feedback loop on Skill evolution, automating the lifecycle of Skills through three stages: Skill Creator for bootstrapping from task specs and trajectories, Route Optimizer for routing alignment, and Body Refiner for iterative Skill Body refinement via dual-path LLM-Judge evaluation. Deployed on a production-scale e-commerce image assistant, SkillChain substantially improves aggregate response quality, with the strongest gains on structural compliance and content quality; a one-week online A/B experiment further confirms significant gains in user engagement, content consumption, and long-term retention.

Momentum

Related topics

Latest papers 189