Long-Horizon Agent Evaluation

Ask about this topic

Momentum

47 papers in the last four weeks, up 176% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 232

All topics
CardsList

  1. Agentic Coding Needs Proactivity, Not Just Autonomy

    May 7, 2026Nghi D. Q. Bui, Georgios EvangelopoulosAI Coding AgentsCoding Agents

    Google Labs

  2. PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments

    May 4, 2026Ruoqi Liu, Imran Q. Mohiuddin, Austin J. Schoeffler +10HealthcareLong-Horizon Agent Evaluation

    Stanford University

  3. AgentFloor: How Far Up the tool use Ladder Can Small Open-Weight Models Go?

    May 1, 2026Ranit Karmakar, Jayita ChatterjeeComputer-Use Agent BenchmarksLLM Agent Evaluation

    Harvard University, Boston, MA 02115 · Boston, MA 02115

  4. KellyBench: A Benchmark for Long-Horizon Sequential Decision Making

    Apr 30, 2026Thomas Grady, Kip Parker, Iliyan Zarov +3Sequential Decision MakingLong-Horizon Agent Evaluation

    General Reasoning, Inc.

  5. Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks

    Apr 27, 2026Lawrence Keunho Jang, Jing Yu Koh, Daniel Fried +1Computer-Use Agent BenchmarksWeb Agent Benchmarks

    Carnegie Mellon University

  6. ClawMark: A Living-World Benchmark for Multi-Turn, Multi-Day, Multimodal Coworker Agents

    Apr 26, 2026Fanqing Meng, Lingxiao Du, Zijian Wu +46Computer-Use Agent BenchmarksLLM Agent Evaluation

  7. Efficient Agent Evaluation via Diversity-Guided User Simulation

    Apr 23, 2026Itay Nakash, George Kour, Ateret Anaby-TavorAutomated Software TestingLLM Agent Evaluation

    IBM Research

  8. From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents

    Apr 21, 2026Md Nayem Uddin, Kumar Shubham, Eduardo Blanco +2Long-Horizon Agent EvaluationAI Agent Benchmarks

    Arizona State University · Genies · University of Arizona

  9. Four-Axis Decision Alignment for Long-Horizon Enterprise AI Agents

    Apr 21, 2026Vasundra SrininvasanLong-Horizon Agent EvaluationAI Agent Benchmarks

    Stanford School of Engineering

  10. SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agents

    Apr 19, 2026Ziao Zhang, Kou Shi, Shiting Huang +13Lifelong Learning AgentsLong-Horizon Agent Evaluation

    University of Science and Technology of China · University of Toronto · University of Sydney

  11. MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents

    Apr 17, 2026Weiwei Xie, Shaoxiong Guo, Fan Zhang +5Long-Horizon Agent EvaluationAI Agent Security Benchmarks

    Shanghai Jiao Tong University · East China Normal University · Shandong University +1

  12. GTA-2: Benchmarking General Tool Agents from Atomic Tool-Use to Open-Ended Workflows

    Apr 17, 2026Jize Wang, Xuanxuan Liu, Yining Li +7Tool-Use EvaluationLong-Horizon Agent Evaluation

    1Shanghai Jiao Tong University · 2Shanghai AI Laboratory · 3Tencent +1

  13. DR3^{3}-Eval: Towards Realistic and Reproducible Deep Research Evaluation

    Apr 16, 2026Qianqian Xie, Qingheng Xiong, He Zhu +16LLM Agent EvaluationLong-Horizon Agent Evaluation

    Nanjing University · M-A-P · Nanjing University of Science and Technology +2

  14. HINTBench: Horizon-agent Intrinsic Non-attack Trajectory Benchmark

    Apr 15, 2026Jiacheng Wang, Jinchang Hou, Fabian Wang +3AI Agent AuditingLong-Horizon Agent Evaluation

    Baidu Inc., Beijing, China · Beijing Institute of Technology, Beijing, China

  15. RetailBench: Evaluating Long-Horizon Autonomous Decision-Making and Strategy Stability of LLM Agents in Realistic Retail Environments

    Mar 17, 2026Linghua Zhang, Jun Wang, Jingtong Wu +1Long-Horizon Agent EvaluationAI Agent Benchmarks

    Ant Group · City University of Hong Kong

  16. EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agents

    Jan 23, 2026Xinze Li, Ziyue Zhu, Siyuan Liu +4Episodic MemoryLong-Horizon Agent Evaluation

    Nanyang Technological University · Shanghai AI Laboratory · Fudan University

  17. LifeAgentBench: Benchmarking LLMs for Long-Horizon, Cross-Dimensional Lifestyle Health Reasoning

    Jan 20, 2026Ye Tian, Zihao Wang, Onat Gungor +2HealthcareLong-Horizon Agent Evaluation

    University of California San Diego, La Jolla, CA, USA · Google Research, Mountain View, CA, USA

  18. SWITCH: Benchmarking Modeling and Handling of Tangible Interfaces in Long-horizon Embodied Scenarios

    Nov 20, 2025Juntao Cheng, Wanyue Zhang, Zhiwei Yu +7Long-Horizon Agent EvaluationEgocentric Video Understanding

    Beijing Academy of Artificial Intelligence (BAAI) · Shanghai Jiao Tong University · School of Artificial Intelligence, University of Chinese Academy of Sciences +3

  19. Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search

    Oct 21, 2025Howard Yen, Yoonsang Lee, Ashwin Paranjape +5Agentic SearchLong-Horizon Agent Evaluation

    Princeton Language and Intelligence, Princeton University · Work done as an intern at Samaya AI. · Samaya AI

  20. BuilderBench: The Building Blocks of Intelligent Agents

    Oct 7, 2025Raj Ghugare, Roger Creus Castanyer, Catherine Ji +4Long-Horizon Agent EvaluationRobot Manipulation Benchmarks

    Princeton University · Mila – Quebec AI Institute · Université de Montréal

  21. SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents

    Date pendingBingchen Zhao, Dhruv Srikanth, Yuxiang Wu +1Reward HackingAI Coding Agents

    Weco AI

  22. Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agents

    Date pendingMinghao Guo, Meng Cao, Sui Zhao +10Deep Research AgentsLong-Horizon Agent Evaluation

    Mohamed bin Zayed University of Artificial Intelligence · University of Science and Technology of China · Zhejiang University +1