LLM Agent Skill Evaluation

LLM: Large Language Model

Latest papers

32 papers7 papers in the last four weeks, up 133% on the four weeks before. 0.0% of all new papers.

SkillTester: Benchmarking Utility and Security of Agent Skills
Mar 28, 2026Leye Wang, Zixing Wang, Anjie XuLLM Agent Skill Evaluation AI Agent Security Benchmarks
Key Laboratory of High Confidence Software Technologies, Ministry of Education, Peking University, Beijing, China · Northwestern Polytechnical University, Xi’an, China
SkillNet: Create, Evaluate, and Connect AI Skills
Feb 26, 2026Yuan Liang, Ruobin Zhong, Haoming Xu +47LLM Agent Skill Evaluation Agent Skill Learning

Mar 28, 2026J/K move · Enter open · S save

SkillTester: Benchmarking Utility and Security of Agent Skills

Leye Wang, Zixing Wang, Anjie Xu

Key Laboratory of High Confidence Software Technologies, Ministry of Education, Peking University, Beijing, China · Northwestern Polytechnical University, Xi’an, China

LLM Agent Skill Evaluation AI Agent Security Benchmarks Agent Skill Security Auditing

Open paper AskPDF arXiv

This technical report presents SkillTester, a tool for evaluating the utility and security of agent skills. Its evaluation framework combines paired baseline and with-skill execution conditions with a separate security probe suite. Grounded in a comparative utility principle and a user-facing simplicity principle, the framework normalizes raw execution artifacts into a utility score, a security score, and a three-level security status label. More broadly, it can be understood as a comparative quality-assurance harness for agent skills in an agent-first world. The public service is deployed at https://skilltester.ai, and the broader project is maintained at https://github.com/skilltester-ai/skilltester.

Latest papers

SkillTester: Benchmarking Utility and Security of Agent Skills

SkillNet: Create, Evaluate, and Connect AI Skills