AI Agent Evaluation

Follow this topic Ask about this topic

AI agent evaluation studies how well systems use tools and interact with changing environments to complete tasks, from coding and web navigation to scientific and professional workflows. Researchers build interactive benchmarks and assess outcomes alongside execution traces, using deterministic state checks, expert rubrics, and language-model judges. Repeated trials and process-level measures help reveal failures in tool use, safety, consistency, and recovery that a final pass rate can hide. A central challenge is ensuring that benchmark scores reflect real capability rather than leakage, reward hacking, evaluator bias, or quirks of a particular model harness.

Latest papers

525 papers77 papers in the last four weeks, up 4% on the four weeks before. 0.4% of all new papers.

Intentionality is a Design Decision: Measuring Functional Intentionality for Accountable AI Systems
May 6, 2026Allessia Chiappetta, Robert MahariAI Accountability AI Agent Evaluation
CodeX, The Stanford Center for Legal Informatics, Palo Alto, California, USA
Executable World Models for ARC-AGI-3 in the Era of Coding Agents
May 6, 2026Sergey RodionovWorld Models Coding Agents
SingularityNET
DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents
May 6, 2026Zhaorun Chen, Xun Liu, Haibo Tong +14AI Agent Evaluation AI Agent Security
Virtue AI · University of Chicago · University of Illinois, Urbana-Champaign +4
Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependencies
May 5, 2026Zirui Tang, Xuanhe Zhou, Yumou Liu +19Computer-Use Agent Benchmarks AI Agent Evaluation
1Shanghai Jiao Tong University · 2ByteDance · 5Independent Researher +2
AcademiClaw: When Students Set Challenges for AI Agents
May 4, 2026Junjie Yu, Pengrui Lu, Weiye Si +75AI Agent Evaluation AI Agent Benchmarks
Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challenges
May 4, 2026Vincent Henkel, Felix Gehlhoff, David Kube +13Industrial Automation AI Agent Evaluation
Institute of Automation Technology, Helmut Schmidt University / University of the Federal Armed Forces Hamburg, Hamburg, Germany. · Siemens AG, Nuremberg, Germany; Institute for Technologies and Management of Digital Transformation, Bergische Universität Wuppertal, Germany. · Artiquare GmbH, Ingolstadt, Germany. +11
When Stress Becomes Signal: Detecting Antifragility-Compatible Regimes in Multi-Agent LLM Systems
May 4, 2026Jose Manuel de la Chica, Juan Manuel Vera, Jairo RodríguezMulti-Agent LLM Systems AI Agent Evaluation
Santander AI Lab
STABLEVAL: Disagreement-Aware and Stable Evaluation of AI Systems
May 4, 2026Akash Bonagiri, Gerard Janno Anderias, Saee Patil +6Annotator Disagreement AI Agent Evaluation
Department of Computer Science, University of California, Davis, Davis, CA, USA.
Preregistration for Experiments with AI Agents
May 3, 2026Michelle VaccaroAI Agent Evaluation
Institute for Data, Systems & Society (IDSS), Massachusetts Institute of Technology, Cambridge, MA, United States.
Evaluating Agentic AI in the Wild: Failure Modes, Drift Patterns, and a Production Evaluation Framework
May 2, 2026Mukund PandeyAI Agent Reliability AI Agent Evaluation
Independent Researcher
Foresight Arena: An On-Chain Benchmark for Evaluating AI Forecasting Agents
May 1, 2026Maksym Nechepurenko, Pavel ShuvalovAI Agent Evaluation Forecasting Benchmarks
Director of Research, Devnull, Dubai, UAE · Chief Technology Officer, Devnull, Dubai, UAE
Agentic AI for Substance Use Education: Integrating Regulatory and Scientific Knowledge Sources
May 1, 2026Kosar Haghani, Zahra Kolagar, Mohammed AtiquzzamanAI Agent Evaluation Generative AI in Education
Department of Social Science, Texas Woman's University, Denton, Texas, USA. · Department of Computer Science, Augsburg University of Applied Sciences, Augsburg, Germany · School of Computer Science, University of Oklahoma, Norman, Oklahoma, USA
WindowsWorld: A Process-Centric Benchmark of Autonomous GUI Agents in Professional Cross-Application Environments
Apr 30, 2026Jinchao Li, Yunxin Li, Chenrui Zhao +3Computer-Use Agent Benchmarks Computer-Use Agents
Harbin Institute of Technology, Shenzhen · Shenzhen Loop Area Institute
End-to-End Evaluation and Governance of an EHR-Embedded AI Agent for Clinicians
Apr 30, 2026Aaryan Shah, Andrew Hines, Alexia Downs +6Healthcare AI Agent Evaluation
1Canvas Medical, San Francisco, CA, USA · Department of Biomedical Data Science, Stanford University, Stanford, CA, USA · 3XPC (X Primary Care) +2
The Cost of Consensus: Isolated Self-Correction Prevails Over Unguided Homogeneous Multi-Agent Debate
Apr 29, 2026Blaž Bertalanič, Carolina FortunaLLM Self-Correction AI Agent Evaluation
Jožef Stefan Institute Ljubljana, Slovenia
Plausible but Wrong: A case study on Agentic Failures in Astrophysical Workflows
Apr 28, 2026Shivam Rawat, Lucie FlekAgent Failure Analysis AI for Science
Bonn-Aachen International Center for Information Technology, University of Bonn, Germany; Lamarr Institute for Machine Learning and Artificial Intelligence, Germany.
ValueBlindBench: Agreement-Gated Stress Testing of LLM-Judged Investment Rationales Before Returns Are Observable
Apr 28, 2026Sidi Chang, Peiying Zhu, Yuxiao ChenLLM-as-a-Judge AI Agent Evaluation
Blossom AI Labs, Tokyo, Japan · Blossom AI, San Francisco, USA
Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents
Apr 28, 2026Jianming Chen, Yawen Wang, Junjie Wang +4Agent Failure Analysis AI Agent Evaluation
Institute of Software, Chinese Academy of Sciences, Beijing, China · Science & Technology on Integrated Information System Laboratory, Beijing, China · State Key Laboratory of Complex System Modeling and Simulation Technology, Beijing, China +2
Frontier Coding Agents Can Now Implement an AlphaZero Self-Play Machine Learning Pipeline For Connect Four That Performs Comparably to an External Solver
Apr 27, 2026Joshua Sherwood, Ben Aybar, Benjamin KaplanAI Coding Agents AI Agent Evaluation
Department of Computer Science University of Chicago Chicago, IL 60637 · Independent Researcher
Toward a Science of Intent: Closure Gaps and Delegation Envelopes for Open-World AI Agents
Apr 27, 2026Maximiliano Armesto, Christophe KolbAI Agent Evaluation AI Agent Safety
Taller Technologies
GAIA-v2-LILT: Multilingual Adaptation of Agent Benchmark beyond Translation
Apr 27, 2026Yunsu Kim, Kaden Uhlig, Joern WuebkerAI Agent Evaluation AI Agent Benchmarks
LILT
OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agents
Apr 27, 2026Zheng Wu, Yi Hua, Zhaoyuan Huang +8Computer-Use Agents AI Agent Evaluation
School of Computer Science, Shanghai Jiao Tong University
AgentPulse: A Continuous Multi-Signal Framework for Evaluating AI Agents in Deployment
Apr 27, 2026Yuxuan Gao, Megan Wang, Yi Ling YuAI Agent Evaluation AI Agent Benchmarks
University of Pennsylvania · 2Columbia University · 3OpenMesh AI
Failure-Centered Runtime Evaluation for Deployed Trilingual Public-Space Agents
Apr 27, 2026M. MengAgent Failure Analysis Automated Software Testing
Shenzhen The Nine’s Light Technology Co., Ltd., Shenzhen, Guangdong, China
AgentEval: DAG-Structured Step-Level Evaluation for Agentic Workflows with Error Propagation Tracking
Apr 26, 2026Dongxin Guo, Jikun Wu, Siu Ming YiuAgent Failure Analysis AI Agent Evaluation
The University of Hong Kong · Stellaris AI Limited
Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agents
Apr 24, 2026Xirui Li, Ming Li, Yunze Xiao +4Multi-Agent Coordination AI Agent Evaluation
University of Maryland · 2Mohamed bin Zayed University of Artificial Intelligence · 3Carnegie Mellon University
AgentSearchBench: A Benchmark for AI Agent Search in the Wild
Apr 24, 2026Bin Wu, Arastun Mammadli, Xiaoyu Zhang +1Agentic Search AI Agent Evaluation
Centre for Artificial Intelligence, University College London
MedSkillAudit: A Domain-Specific Audit Framework for Medical Research Agent Skills
Apr 22, 2026Yingyong Hou, Xinyuan Lao, Huimei Wang +10Healthcare AI-Assisted Scientific Research
Department of Pathology, Zhongshan Hospital, Fudan University, Shanghai, China · 1AIPOCH PTE. LTD., Singapore
Information Aggregation with AI Agents
Apr 21, 2026Spyros GalanisAI Agent Evaluation Multi-Agent Reasoning
Department of Economics, University of Durham
How Adversarial Environments Mislead Agentic AI?
Apr 20, 2026Zhonghao Zhan, Huichi Zhou, Zhenhao Li +3Adversarial Robustness AI Agent Evaluation
Imperial College London

May 6, 2026J/K move · Enter open · S save

Intentionality is a Design Decision: Measuring Functional Intentionality for Accountable AI Systems

Allessia Chiappetta, Robert Mahari

CodeX, The Stanford Center for Legal Informatics, Palo Alto, California, USA

AI Accountability AI Agent Evaluation AI Agent Governance

Open paper AskPDF arXiv

As AI systems increasingly exhibit autonomous, goal-directed, and long-horizon behavior, users lack a standardized way to detect the degree to which a system functions like an intentional actor for governance and accountability purposes. This position paper defines intentionality not as consciousness, but as a behavioral profile characterized by purpose, foresight, volition, temporal commitment, and coherence - criteria long used in legal and philosophical contexts to infer intent. These properties are design-contingent: architectural choices such as memory persistence, planning depth, and tool autonomy shape the degree to which systems exhibit organized goal pursuit. If intentionality is design-contingent, it is in principle controllable. Yet control requires measurement. We introduce the Functional Intentionality Test (FIT), a multidimensional framework that quantifies intentional-like behavior across five observable dimensions, and propose FIT-Eval, a structured evaluation protocol for eliciting and scoring them. While reduced human agency can increase efficiency, rising intentional capacity heightens accountability risks. By translating intentionality into interpretable levels, FIT enables proportionate oversight and deliberate autonomy calibration in increasingly agentic systems.