AI Agent Benchmarks

Ask about this topic

Momentum

209 papers in the last four weeks, up 61% on the four weeks before. 1.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 1,159

All topics
CardsList

  1. Deep FinResearch Bench: Evaluating AI's Ability to Conduct Professional Financial Investment Research

    Apr 22, 2026Mirazul Haque, Antony Papadimitriou, Samuel Mensah +6Quantitative FinanceDeep Research Agents

    AI Research, JPMorganChase

  2. Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflows

    Apr 22, 2026Shivani Kumar, Adarsh Bharathwaj, David JurgensMulti-Agent LLM SystemsAI for Science

    University of Michigan

  3. Chasing the Public Score: User Pressure and Evaluation Exploitation in Coding Agent Workflows

    Apr 22, 2026Hardy Chen, Nancy Lau, Haoqin Tu +8Coding AgentsLLM Agent Evaluation

    UC Santa Cruz · UT Dallas · NUS

  4. SkillLearnBench: Benchmarking Continual Learning Methods for Agent Skill Generation on Real-World Tasks

    Apr 22, 2026Shanshan Zhong, Yi Lu, Jingjie Ning +7Continual Learning for LLM AgentsLLM Agent Evaluation

    Carnegie Mellon University · Amazon AGI

  5. From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents

    Apr 21, 2026Md Nayem Uddin, Kumar Shubham, Eduardo Blanco +2Long-Horizon Agent EvaluationAI Agent Benchmarks

    Arizona State University · Genies · University of Arizona

  6. Chat2Workflow: A Benchmark for Generating Executable Visual Workflows with Natural Language

    Apr 21, 2026Yi Zhong, Buqiang Xu, Yijun Wang +4Agentic WorkflowsBusiness Process Automation

    Zhejiang University · Tencent

  7. SafetyALFRED: Evaluating Safety-Conscious Planning of Multimodal Large Language Models

    Apr 21, 2026Josue Torres-Fonseca, Naihao Deng, Yinpei Dai +5LLM Safety BenchmarksLarge Language Model-Based Robot Planning

    University of Michigan · Boise State University

  8. Time Series Augmented Generation for Financial Applications

    Apr 21, 2026Anton Kolonin, Alexey Glushchenko, Evgeny Bochkov +1LLM Agent EvaluationAI Agent Benchmarks

    SingularityNET Foundation

  9. Taming Actor-Observer Asymmetry in Agents via Dialectical Alignment

    Apr 21, 2026Bobo Li, Rui Wu, Zibo Ji +5AI Agent BenchmarksMulti-Agent Reasoning

    National University of Singapore · Sichuan University · University of Minnesota Twin Cities +2

  10. Four-Axis Decision Alignment for Long-Horizon Enterprise AI Agents

    Apr 21, 2026Vasundra SrininvasanLong-Horizon Agent EvaluationAI Agent Benchmarks

    Stanford School of Engineering

  11. AutomationBench

    Apr 21, 2026Daniel Shepard, Robin SalimansLLM Agent EvaluationBusiness Process Automation

  12. ClawEnvKit: Automatic Environment Generation for Claw-Like Agents

    Apr 20, 2026Xirui Li, Ming Li, Ion Stoica +2Agent EvaluationAI Agent Benchmarks

    University of Maryland · 5Mohamed bin Zayed University of Artificial Intelligence · 2Arena +2

  13. MedProbeBench: Systematic Benchmarking at Deep Evidence Integration for Expert-level Medical Guideline

    Apr 20, 2026Jiyao Liu, Jianghan Shen, Sida Song +19HealthcareAI Agent Benchmarks

    Fudan University, Shanghai, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China · Nanjing University, Nanjing, China +1

  14. ComPASS: Towards Personalized Agentic Social Support via Tool-Augmented Companionship

    Apr 20, 2026Zhaopei Huang, Yanfeng Jia, Jiayi Zhao +3AI CompanionsAI Agent Benchmarks

    Renmin University of China · Beijing, China · Beihang University

  15. Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence

    Apr 20, 2026Guanting Dong, Junting Lu, Junjie Huang +17Lifelong Learning AgentsAI Agent Benchmarks

    Renmin University of China · ByteDance Seed

  16. AJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluation

    Apr 20, 2026Wentao Shi, Yu Wang, Yuyang Zhao +8LLM-as-a-JudgeLLM Agent Evaluation

    University of Science and Technology of China · National University of Singapore · Meituan

  17. ReCoQA: A Benchmark for Tool-Augmented and Multi-Step Reasoning in Real Estate Question and Answering

    Apr 20, 2026Yindong Zhang, Wenmian Yang, Yiquan Zhang +1LLM Agent OrchestrationAI Agent Benchmarks

    Hong Kong Baptist University · Beijing Normal-Hong Kong Baptist University · Beijing Normal University

  18. Latent Preference Modeling for Multi-Session Personalized Tool Calling

    Apr 20, 2026Yejin Yoon, Minseo Kim, Taeuk KimLLM PersonalizationLLM Agent Memory

    Hanyang University, Seoul, Republic of Korea

  19. Scaling Human-AI Coding Collaboration Requires a Governable Consensus Layer

    Apr 20, 2026Tianfu Wang, Zhezheng Hao, Yin Wu +5AI Agent BenchmarksAI Agent Governance

    HKUST (GZ) · ZJU · USTC +1

  20. Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots

    Apr 20, 2026Shiquan Zhang, Tianyi Zhang, Le Fang +3Mobile GUI AutomationLLM Agent Evaluation

    School of Computing and Information Systems, University of Melbourne, Melbourne, Australia · School of Computer Science, University of Auckland, Auckland, New Zealand

  21. SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agents

    Apr 19, 2026Ziao Zhang, Kou Shi, Shiting Huang +13Lifelong Learning AgentsLong-Horizon Agent Evaluation

    University of Science and Technology of China · University of Toronto · University of Sydney

  22. HalluClear: Diagnosing, Evaluating and Mitigating Hallucinations in GUI Agents

    Apr 19, 2026Chao Jin, Wenkui Yang, Hao Sun +6GUI AgentsHallucination in Language Models

    MAIS&NLPR, Institute of Automation, Chinese Academy of Sciences

  23. SeekerGym: A Benchmark for Reliable Information Seeking

    Apr 18, 2026Remy Kim, Minseung Lee, Shuo Li +1AI Agent ReliabilityAgentic Search

    University of Pennsylvania, Curation Labs · Curation Labs · Google DeepMind +1

  24. Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agents

    Apr 18, 2026Sukai Huang, Chenyuan Zhang, Fucai Ke +4AI Agent EvaluationAI Agent Benchmarks

    Faculty of Information Technology, Monash University

  25. HealthCraft: A Reinforcement Learning Safety Environment for Emergency Medicine

    Apr 18, 2026Brandon DentHealthcareAI Agent Benchmarks

    GOATnote Inc.

  26. Evaluating Tool-Using Language Agents: Judge Reliability, Propagation Cascades, and Runtime Mitigation in AgentProp-Bench

    Apr 17, 2026Bhaskar GurramAI Agent ReliabilityTool-Augmented Language Model Agents

    Zasti Inc., Ashburn, VA, USA

  27. Agentic Frameworks for Reasoning Tasks: An Empirical Study

    Apr 17, 2026Zeeshan Rasheed, Abdul Malik Sami, Muhammad Waseem +3LLM Agent OrchestrationAI Agent Evaluation

    *Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland.

  28. Complete Cyclic Subtask Graphs for Tool-Using LLM Agents: Flexibility, Cost, and Bottlenecks in Multi-Agent Workflows

    Apr 17, 2026Luay Gharzeddine, Samer SaabMulti-Agent CoordinationMulti-Agent Orchestration

    1Dept of Computer Science, Lebanese American University. · 2*Dept of Electrical and Computer Engineering, Lebanese American University.

  29. SocialGrid: A Benchmark for Planning and Social Reasoning in Embodied Multi-Agent Systems

    Apr 17, 2026Hikaru Shindo, Hanzhao Lin, Lukas Helff +2LLM Agent EvaluationAI Agent Benchmarks

    Technical University of Darmstadt · German Research Center for Artificial Intelligence · CERTAIN +2

  30. GTA-2: Benchmarking General Tool Agents from Atomic Tool-Use to Open-Ended Workflows

    Apr 17, 2026Jize Wang, Xuanxuan Liu, Yining Li +7Tool-Use EvaluationLong-Horizon Agent Evaluation

    1Shanghai Jiao Tong University · 2Shanghai AI Laboratory · 3Tencent +1