Overview

Agent skill learning studies how agents acquire, represent, retrieve, and combine reusable behaviors, from motor primitives in robotics to tool-use procedures in language-model agents. Common approaches include hierarchical reinforcement learning and latent skill discovery, imitation from demonstrations, and external skill libraries refined from successful and failed trajectories using verification or reinforcement learning. Work is tested in settings such as LIBERO and ALFWorld for embodied tasks, WebArena for web use, and benchmarks that measure continual learning and skill transfer. A central challenge is making skills reliable and useful on held-out tasks: more updates or broader libraries can improve coverage but also cause drift, costly retrieval, or unsafe behavior, so evaluation increasingly examines transfer, execution quality, and lifecycle safety.

Latest papers

CardsList

174 papers41 papers in the last four weeks, up 95% on the four weeks before. 0.2% of all new papers.

  1. Does Your Generalist Skill Optimizer Really Incentivize Agentic Tasks? Rethinking Skill Optimization via Bipartite Attribution

    Oct 27, 2026Jiawei Zhou, Bo Peng, Yuxuan Huang +4Agent Skill LearningLLM Agent Skill Evaluation

  2. Back to Basics: A Skill-Centric Approach to Generalist Web Agents

    Oct 26, 2026Minh Pham-Dinh, Md Farhan Ishmam, Hernan Yupanqui +2Web AgentsLLM Agent Skill Learning

  3. High-resolution tactile observation makes hidden racket-control mechanisms learnable

    Oct 26, 2026Haoyang Tian, Zhengwei Li, Houcheng Li +6Agent Skill Learning

  4. Intrinsic Goals for Autonomous Agents: Hierarchical Exploration Captures Future Volitional Action in Drosophila

    Oct 25, 2026Declan Kutscher, Reece Keller, Alyn Kirsch +2Intrinsic MotivationIntrinsic Reward Methods

  5. Holding a Steady Course: Knowledge Evolution from Expertise and Lessons for Continual Agent Learning

    Oct 25, 2026Wenzhe Fan, Benjamin Steenhoek, Gaurav Mittal +1Lifelong Learning AgentsAgent Skill Learning

  6. SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web Agents

    Oct 24, 2026Bo-Yu Chen, Zhi Zhou, Yu-Feng LiAgent Skill LearningWeb Agent Benchmarks

  7. Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting

    Oct 21, 2026Zhipeng Chen, Yunsen Liang, Yanxi Chen +12Recursive Self-ImprovementSelf-Evolving Agents

  8. GRADUS: Discovering and Recovering Agent Lessons from the Environment's Latent Syllabus

    Oct 20, 2026Qing Ping, Wei Yang, Panpan Xu +4LLM Agent TrainingLLM Agent Trajectory Synthesis

  9. Distill Until Divergence: Error-Truncated Hindsight Distillation for Agentic RL

    Oct 16, 2026Yibin Huang, Conghui ZhuAgentic RLStep-Level Credit Assignment in RL

  10. Evolving Together, Failing Apart: The Skill-Policy Co-evolution Trap in Self-Improving Agents

    Oct 14, 2026Yujie Feng, Xiaobin Wang, Jinluan Yang +5Self-Improving AgentsAI Agent Evaluation

  11. EvolvingBrain: An Adaptive Skill System for Multi-modal Agents Self-Evolution in Open Worlds

    Oct 14, 2026Runxuan Liu, Jingqi Shi, Baoxin Wang +10Self-Evolving AgentsAgent Skill Learning

  12. When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents

    Oct 14, 2026Tao Yu, Zhongtian Luo, Yuchen Long +19Agent Skill LearningSelf-Evolving Agents

  13. EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents

    Oct 12, 2026Bin Yu, Shijie Lian, Zhaolong Shen +10Tool-Using AgentsSpatial Reasoning

  14. Imitation Holds a Key to Evolution: Localized Repair and Verified Skill Acquisition for Adaptive Agents

    Oct 12, 2026Kai Hu, Hua HuangImitation LearningAgent Skill Learning

  15. When Skills Remain But Access Fails: Factorized Skill Memory for Continual Skill Internalization

    Oct 11, 2026Haomiao Qiu, Yining Tang, Hongyi Wan +3Continual Learning for LLM AgentsAgent Skill Learning

  16. EnactOpt: Diagnosis-Guided Harness Evolution for Embodied Agents

    Oct 10, 2026ZhiYuan Feng, Zhuoshi Pan, Zhaolu Kang +5Agent Harness OptimizationEmbodied AI

  17. StateSkill-Agent: An Effective and Efficient Embodied Agent via State-conditioned Skill

    Oct 10, 2026Changxu Wei, Jingyi Zhang, Zhiyu Zheng +6Finite-State MachineLLM Agent Skill Learning

  18. Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction

    Oct 9, 2026Yuqi Huang, Hui Li, Yifei Cao +9GUI AgentsAgent Skill Learning

  19. Agentic-TTT: Training test-time policy for test-time training

    Oct 8, 2026Jiahao Lu, Mohan KankanhalliTest-Time TrainingLLM Agent Self-Improvement

  20. UniSkill: Learning Actor-Aligned Skill Proposals for an Evolving Policy

    Oct 7, 2026Yifei Lu, Cheng Liu, Dianzhi Yu +4LLM Agent Skill LearningAgent Skill Learning

  21. SkillSandbox: Skill Verification via Dynamic Scenario Synthesis

    Oct 7, 2026Serin Kim, Kwangwook Seo, Dokyung Song +2Agent Skill LearningSelf-Evolving Agents

  22. A self-learning scientific agent for X-ray diffraction

    Oct 6, 2026Bin Cao, Huichi Zhou, Runyu Yang +7AI Agents for Scientific DiscoveryMaterials Science

  23. Is this machine playing?

    Oct 5, 2026Nathan Cloos, Antonio Norelli, Daniel Durbin +3Agent Skill LearningSelf-Improving Agents

  24. Mining Agent Skills from Production Traces

    Oct 5, 2026Yue Ran Kang, Colton Mikolajczyk, Chhaya Methani +4Enterprise AI AgentsLLM Agents

  25. TeleTune: Evolving Agent Skills From Offline Telemetry

    Oct 4, 2026Justin Chih-Yao Chen, Elias Stengel-Eskin, Yan Chen +6Computer-Use AgentsLLM Agent Skill Learning

  26. Training Numerical Intelligence via Auto-Diagnosis and Skill Discovery

    Oct 2, 2026Peter Chen, Wotao YinAgent Skill LearningAutomated Algorithm Discovery

  27. PsyEvo: A Personalized Counseling Agent That Self-Evolves at Test Time

    Oct 2, 2026Yuting Yan, Shihao Xu, Junhao Yu +6LLM Agent Self-ImprovementMental Health Counseling