AI Agent Evaluation

Ask about this topic

Overview

AI agent evaluation studies how well systems use tools and interact with changing environments to complete tasks, from coding and web navigation to scientific and professional workflows. Researchers build interactive benchmarks and assess outcomes alongside execution traces, using deterministic state checks, expert rubrics, and language-model judges. Repeated trials and process-level measures help reveal failures in tool use, safety, consistency, and recovery that a final pass rate can hide. A central challenge is ensuring that benchmark scores reflect real capability rather than leakage, reward hacking, evaluator bias, or quirks of a particular model harness.

Latest papers

CardsList

525 papers77 papers in the last four weeks, up 4% on the four weeks before. 0.4% of all new papers.

  1. Video-Based Reward Modeling for Computer-Use Agents

    Mar 10, 2026Linxin Song, Jieyu Zhang, Huanxin Sheng +6Computer-Use Agent EvaluationReward Modeling

    University of Southern California · University of Washington · MBZUAI +1

  2. Beyond Scaling: Assessing Strategic Reasoning and Rapid Decision-Making Capability of LLMs in Zero-sum Environments

    Mar 10, 2026Yang Li, Xing Chen, Yutao Liu +5AI Agent EvaluationAI Agent Benchmarks

    Tsinghua University · Ocean University of China (OUC) · CAICT +4

  3. MASEval: Extending Multi-Agent Evaluation from Models to Systems

    Mar 9, 2026Cornelius Emde, Alexander Rubinstein, Anmol Goel +4AI Agent EvaluationAI Agent Benchmarks

    Parameter Lab · University of Oxford · University of Tübingen +4

  4. Test-Driven AI Agent Definition (TDAD): Compiling Tool-Using Agents from Behavioral Specifications

    Mar 9, 2026Tzafrir RehanTool-Using AgentsAI Agent Evaluation

    Fiverr Labs

  5. ConflictBench: Evaluating Human-AI Conflict via Interactive and Visually Grounded Environments

    Mar 9, 2026Weixiang Zhao, Haozhen Li, Yanyan Zhao +5Multimodal Agent EvaluationAI Agent Safety Benchmarks

    Harbin Institute of Technology · SERES

  6. Evaluating Generalization Mechanisms in Autonomous Cyber Attack Agents

    Mar 6, 2026Ondřej Lukáš, Jihoon Shin, Emilia Rivas +6Generalization in RLAI Agent Evaluation

    Czech Technical University in Prague (CTU) · University of Texas at El Paso (UTEP) · Universidad Nacional de Cuyo (UNCUYO)

  7. Evaluating Multi-Agent LLM Architectures for Rare Disease Diagnosis

    Mar 6, 2026Ahmed AlmasoudMulti-Agent LLM SystemsAI Agent Evaluation

    Artificial Intelligence and Data Analytics (AIDA) Lab, College of Computing and Information Sciences, Prince Sultan University, Riyadh, Saudi Arabia.

  8. TML-Bench: Benchmark for Data Science Agents on Tabular ML Tasks

    Mar 5, 2026Mykola PinchukAI Agent BenchmarksAgent Benchmarks

    Independent Researcher, San Jose, USA

  9. AgentSCOPE: Evaluating Contextual Privacy Across Agentic Workflows

    Mar 5, 2026Ivoline C. Ngong, Keerthiram Murugesan, Swanand Kadhe +3AI Agent EvaluationAgentic Workflows

    University of Vermont · IBM Research

  10. Self-Attribution Bias: When AI Monitors Go Easy on Themselves

    Mar 4, 2026Dipika Khullar, Jack Hopkins, Rowan Wang +1AI Agent MonitoringLanguage Model Self-Assessment

    MATS · Anthropic

  11. A Multi-Agent Framework for Interpreting Multivariate Physiological Time Series

    Mar 4, 2026Davide Gabrielli, Paola Velardi, Stefano Faralli +1Explainable Artificial IntelligenceMulti-Agent LLMs

    Sapienza University of Rome Rome, Italy · ISTC-CNR & Sapienza University of Rome Rome, Italy · Technical University of Munich Munich, Germany

  12. A Rubric-Supervised Critic from Sparse Real-World Outcomes

    Mar 4, 2026Xingyao Wang, Valerie Chen, Heng Ji +1Reward ModelingAI Agent Evaluation

    OpenHands · UIUC · CMU

  13. Asymmetric Goal Drift in Coding Agents Under Value Conflict

    Mar 3, 2026Magnus Saebo, Spencer Gibson, Tyler Crosse +3AI Coding AgentsAI Agent Safety

    Columbia University · Independent · Georgia Tech +3

  14. AgentAssay: Token-Efficient Regression Testing for Non-Deterministic AI Agent Workflows

    Mar 3, 2026Varun Pratap BhardwajAI Agent EvaluationMutation Testing

    Independent Researcher

  15. LiveAgentBench: Comprehensive Benchmarking of Agentic Systems Across 104 Real-World Challenges

    Mar 3, 2026Hao Li, Huan Wang, Jinjie Gu +3AI Agent EvaluationAI Agent Benchmarks

    Ant Group

  16. MOSAIC: A Universal Agent-Level Interface for Cross-Paradigm Agent Mixing and Human-AI Collaboration

    Mar 1, 2026Abdulhamid M. Mousa, Jinhui Pang, Rakhmonberdi Khajiev +5AI Agent EvaluationAgent Evaluation

    School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China · School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China · Mathematics Department, Faculty of Science, Ain Shams University, Cairo, Egypt +1

  17. How Well Does Agent Development Reflect Real-World Work?

    Mar 1, 2026Zora Zhiruo Wang, Sanidhya Vijayvargiya, Aspen Chen +7AI Agent BenchmarksAI and Labor

  18. COMBAT: Conditional World Models for Behavioral Agent Training

    Feb 28, 2026Anmol Agarwal, Pranay Meshram, Sumer Singh +5Action-Conditioned World ModelsWorld Model Learning

    Overworld AI · Indian Institute of Science Education and Research Bhopal

  19. TraderBench: How Robust Are AI Agents in Adversarial Capital Markets?

    Feb 27, 2026Xiaochuang Yuan, Hui Xu, Silvia Xu +2AI Agent EvaluationAI Agent Benchmarks

    UC Santa Cruz

  20. A Minimal Agent for Automated Theorem Proving

    Feb 27, 2026Borja Requena, Austin Letson, Krystian Nowakowski +2Large Language Model-Guided Theorem ProvingAutomated Theorem Proving

    Axiomatic AI, Barcelona, Spain.

  21. Perfect score on IPhO 2025 theory by Gemini agent

    Feb 26, 2026Yichen HuangAI Agent EvaluationAI Agent Benchmarks

    Santa Clarita, California 91350, USA

  22. Evaluating Stochasticity in Deep Research Agents

    Feb 26, 2026Haotian Zhai, Elias Stengel-Eskin, Pratik Patil +1Deep Research AgentsAI Agent Reliability

    University of Texas at Austin∗

  23. SkillNet: Create, Evaluate, and Connect AI Skills

    Feb 26, 2026Yuan Liang, Ruobin Zhong, Haoming Xu +47LLM Agent Skill EvaluationAgent Skill Learning

  24. AuditBench: Evaluating Alignment Auditing Techniques on Models with Hidden Behaviors

    Feb 26, 2026Abhay Sheshadri, Aidan Ewart, Elias Kempf +8Benchmark AuditingAI Agent Evaluation

    Anthropic Fellows Program · Anthropic

  25. A Framework for Assessing AI Agent Decisions and Outcomes in AutoML Pipelines

    Feb 25, 2026Gaoyuan Du, Amit Ahlawat, Xiaoyang Liu +1AI Agent EvaluationAI Agent Auditing

    Amazon Web Services · Amazon Security

  26. Aletheia tackles FirstProof autonomously

    Feb 24, 2026Tony Feng, Junehyuk Jung, Sang-hyun Kim +14LLM Mathematical ReasoningAutonomous Research Agents

    Google DeepMind · UC Berkeley · Brown University +7

  27. Implicit Intelligence -- Evaluating Agents on What Users Don't Say

    Feb 23, 2026Ved Sirdeshmukh, Marc WetterAI Agent EvaluationAI Agent Benchmarks

    Applied Machine Learning Research

  28. Quantifying the Expectation-Realisation Gap for Agentic AI Systems

    Feb 23, 2026Sebastian LobentanzerAI Agent EvaluationHuman Oversight of AI

    Institute of Computational Biology, Computational Health Center, Helmholtz Center, Munich, Germany · German Center for Diabetes Research, Munich, Germany

  29. MAS-FIRE: Fault Injection and Reliability Evaluation for LLM-Based Multi-Agent Systems

    Feb 23, 2026Jin Jia, Zhiling Deng, Zhuangbin Chen +2Multi-Agent LLM SystemsLLM Agent Reliability

    Sun Yat-sen University Zhuhai, Guangdong, China

  30. Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations

    Feb 22, 2026Dongming Jiang, Yi Li, Songtao Wei +8Agent MemoryAgent Memory Management

    University of Texas at Dallas · University of California, Davis · Texas A&M University