LLM Agent Skill Evaluation

LLM: Large Language Model

Latest papers

CardsList

32 papers7 papers in the last four weeks, up 133% on the four weeks before. 0.0% of all new papers.

  1. M4Bench: Evaluating Procedural Specification for Clinical EHR Derivation Agents

    Oct 27, 2026Hannes Ill, Rafi Al Attrach, Rajna Fani +5Coding Agent BenchmarksAI Coding Agents

  2. Does Your Generalist Skill Optimizer Really Incentivize Agentic Tasks? Rethinking Skill Optimization via Bipartite Attribution

    Oct 27, 2026Jiawei Zhou, Bo Peng, Yuxuan Huang +4Agent Skill LearningLLM Agent Skill Evaluation

  3. Beyond Gain: Measuring Skill Internalization for Agent Skill Retirement

    Oct 23, 2026Yanze Wang, Pengfei Yao, Tianyi Sun +5LLM Agent Skill EvaluationAI Agent Benchmarks

  4. One Skill Takes Over: Clashing Agent Skills and a One-File Fix

    Oct 18, 2026Parsa Razmara, Seyedarmin Azizi, Ardalan AryashadAI Coding AgentsLLM Agent Skill Evaluation

  5. Break It Down, Pass It On: Cross-Task Skill Transfer in LLM Agents

    Aug 20, 2026Yiyang Feng, Biddut Sarker Bijoy, Niranjan Balasubramanian +1LLM Agent Skill LearningExperience Learning for LLM Agents

  6. Demystifying Agent Skills: Why They Work-Until They Don't

    Aug 14, 2026Zhiyuan Jiang, Fangrui Huang, Hanwen Xing +6LLM Agent Skill EvaluationLLM Agents

  7. SkillEval: Decomposing Agent Skill Quality into Interpretable Signals

    Aug 7, 2026Jiahui Han, Qinuo Li, Ziheng Peng +6LLM Agent EvaluationAutomated Evaluation

  8. Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?

    Aug 5, 2026Jinyi Han, Yuanjian Xu, Ying Liao +6LLM Agent EvaluationLLM Agent Skill Retrieval

  9. Authoring Agent Skills: A Software-Engineering Approach

    Jul 27, 2026Giuseppe DestefanisLLM Agent Skill EvaluationLLM Agents

  10. SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Use

    Jul 2, 2026Jiayin Zhu, Kelong Mao, Yudong Guo +4LLM Agent Skill EvaluationLLM Agent Evaluation

  11. SkillAudit: From Fixed-Suite Benchmarking to Skill-Centered Assessment

    Jun 21, 2026Dexu Yu, Youhua Li, Zhaoyang Guan +12AI Agent AuditingAutomated Evaluation

  12. A Framework for Evaluating Agentic Skills at Scale

    Jun 16, 2026Maksim Shaposhnikov, Nicolas Fortuin, Simon Stipcich +3LLM Agent Skill EvaluationLLM Agent Evaluation

  13. SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior

    Jun 10, 2026Zhiyu Chen, Zihan Guo, Bo Huang +4LLM Agent EvaluationLLM Agent Skill Evaluation

  14. Skill Coverage: A Test Adequacy Metric for Agent Skills

    Jun 9, 2026Boyin Tan, Xiaowei Huang, Youcheng SunLLM Agent EvaluationAI Agent Benchmarks

  15. OpenSkillEval: Automatically Auditing the Open Skill Ecosystem for LLM Agents

    May 22, 2026Jiahao Ying, Boxian Ai, Wei Tang +2LLM Agent Skill EvaluationLLM Agent Evaluation

  16. Toward User Comprehension Supports for LLM Agent Skill Specifications

    May 19, 2026Zikai Alex WenLLM Agent EvaluationLLM Agent Skill Evaluation

  17. SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents

    May 18, 2026Yifan Zhou, Zhentao Zhang, Ziming Cheng +8LLM Agent EvaluationLLM Agent Skill Learning

  18. Counterfactual Trace Auditing of LLM Agent Skills

    May 12, 2026Xiaolin Zhou, Jinbo Liu, Li Li +2Software Engineering AgentsLLM Agent Skill Evaluation