cs.LGNov 13, 2026

What to Practice Next? Latent Profile-Guided Task Selection for Skill-Evolving LLM Agents

Authors: Qijin Zhang, Hanzhen Wang, Yan Huang, Zhongxiang Dai, Shuang Qiu

Organizations: City University of Hong Kong · Institute of Automation, Chinese Academy of Sciences · Five Ages · The Chinese University of Hong Kong, Shenzhen

Abstract

Task selection shapes the experiences available for skill evolution in LLM agents, yet fixed practice schedules overlook differences in skill requirements and evolving task value. Most existing methods, however, rely on fixed schedules or scalar measures of progress, leaving nonstationary skill demands unaddressed. We propose SPG-Select, a framework for allocating limited practice budget using a multidimensional profile inferred from binary outcomes via MIRT. The framework predicts surrogate progress, defined as the difference between consecutive profile estimates, and prioritizes progress in dimensions with larger estimated proficiency gaps. Our SPG-Select-R policy combines these predictions with uncertainty-based exploration and periodic restarting to accommodate nonstationarity. We evaluate SPG-Select on ALFWorld and WebShop with three skill-evolution backends. In the reported runs, SPG-Select-R achieves higher mean held-out terminal success than uniform sampling in all six backend-benchmark combinations, with gains of 1.49-13.18 percentage points on ALFWorld and 0.93-3.13 points on WebShop. Under a predictable linear surrogate model and boundedness assumptions, we establish a high-probability dynamic pseudo-regret bound for surrogate task allocation in terms of parameter path variation.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning

    May 7, 2026Yaorui Shi, Yuxin Chen, Zhengxi Lu +6LLM Agent Skill LearningLLM Agent Skill Retrieval

  2. SkillGrad: Optimizing Agent Skills Like Gradient Descent

    May 26, 2026Hanyu Wang, Yifan Lan, Bochuan Cao +2Large Language Model-Guided OptimizationLLM Agent Self-Improvement

  3. Optimal Skill Selection for LLM Agents with Provable Bicriteria Guarantees

    Aug 20, 2026Yu Chen, Ruishuo Chen, Xun Wang +2Submodular OptimizationLLM Agent Skill Learning