Long-Horizon Agent Evaluation

Ask about this topic

Momentum

47 papers in the last four weeks, up 176% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 232

All topics
CardsList

  1. Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agents

    Aug 30, 2026Zongyue Li, Chengyue Yu, Lei Zang +3Deep Research AgentsLong-Horizon Agent Evaluation

    Zhejiang University · Ant Group

  2. UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City

    Aug 27, 2026Tianjie Ju, Zheng Wu, Yueqing Sun +15Spatial Reasoning BenchmarksRobot Navigation

    Shanghai Jiao Tong University · National University of Singapore · Meituan +3

  3. TraceML: What Auto-Research Agents Miss in Long-Horizon ML Development

    Aug 26, 2026Jiarui Yan, Weiwei Sun, Sijie Li +2Long-Horizon Agent EvaluationAI Agent Benchmarks

    Carnegie Mellon University

  4. PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives

    Aug 13, 2026Kaixin Ding, Xi Chen, Minghong Cai +9Long-Horizon Agent EvaluationWorld Model Evaluation

    The University of Hong Kong · Kling Team, Kuaishou Technology · The Chinese University of Hong Kong +1

  5. Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Development

    Aug 13, 2026Yiwei Li, Wanli Yang, Hexiang Tan +10Long-Horizon Agent EvaluationAgent Harness Optimization

    1Meituan · University of Chinese Academy of Sciences

  6. Beyond Retrieval: Query-Conditioned Reuse of Long-Horizon Agent Trajectories

    Aug 13, 2026Yifei Li, Heng Wang, Lingling Zhang +5Agent MemoryLong-Horizon Agent Evaluation

    School of Computer Science and Technology, Xi’an Jiaotong University · MOE KLNN Lab, Xi’an Jiaotong University

  7. Governed Persistent Memory: Source-Bound State Semantics and Fail-Closed Release for Long-Horizon Agents

    Aug 12, 2026Guodong XuAgent MemoryLong-Horizon Agent Evaluation

    Qingdao Guodongxiansheng Network Technology Co., Ltd. (Guˇodòng Xi¯ansheng)

  8. Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations

    Aug 11, 2026Vasundra SrinivasanAI Agent ReliabilityAI Agent Evaluation

    Independent Researcher, Stanford School of Engineering

  9. VibeLifeBench: Can Your Life Agent Be Proactive and Persistent in a Living World?

    Aug 11, 2026Xiaohongshu IncLong-Horizon Agent EvaluationAI Agent Benchmarks

    Xiaohongshu Dots Studio · Evolvent AI

  10. The Evaluation Protocol Determines the Result: An Independent Reproduction of LeWorldModel on TwoRoom

    Aug 10, 2026Joyjeet SinghWorld Model-Based PlanningLong-Horizon Agent Evaluation

    Independent researcher

  11. Evo-Bench: Can Language Models Improve Agent Harness?

    Aug 10, 2026Lisheng Huang, Chen Yang, Hao Zhou +6AI Agent EvaluationLong-Horizon Agent Evaluation

    1Gaoling School of Artificial Intelligence, Renmin University of China · 2BOSS Zhipin, Beijing, China

  12. Action- and Language-Conditioned Video Assessment for Embodied Control

    Aug 8, 2026Hwanhee Kim, Jaehyun Jang, Seungmin Cha +3Video-Language Model EvaluationLong-Horizon Agent Evaluation

    Robotics Program, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea · School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea

  13. Compiling and Benchmarking Task-State Horizons for Embodied Agents

    Aug 8, 2026Meiqi Wang, Shichao LiLong-Horizon Agent EvaluationRobot Task Planning

    Tsinghua University · Beijing University of Posts and Telecommunications

  14. Long-Horizon Agent Trajectory Attribution: A Unified Benchmark and Fine-Grained Annotation Framework

    Aug 7, 2026Jing Chen, Yang Sun, Li Zhang +2Long-Horizon Agent EvaluationAI Agent Benchmarks

    Huawei Technologies Ltd.

  15. The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents

    Aug 7, 2026Mingguang Chen, Licheng Wang, Bo QuLong-Horizon PlanningLong-Horizon Agent Evaluation

    1DeepGrounding · 2AlphaAvatar

  16. TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories

    Aug 6, 2026Yunjia Qi, Zehua Yin, Xintong Shi +10Agent Failure AnalysisLong-Horizon Agent Evaluation

    Department of Computer Science and Technology, BNRist, Tsinghua University · Tencent Hunyuan · Shenzhen International Graduate School, Tsinghua University

  17. FinEvo-Bench: A Longitudinal Benchmark for Self-Evolving Agents in Professional Financial Workflows

    Aug 6, 2026Bo Deng, Kang Zhou, Lifan Guo +6Long-Horizon Agent EvaluationAI Agent Benchmarks

    Beihang University · Qwen DianJin Team, Alibaba Cloud Computing

  18. Predicting Task Difficulty Without Rollouts

    Aug 6, 2026Stefan Krsteski, Charlotte MeyerLong-Horizon Agent EvaluationAI Agent Benchmarks

    Andromede AI

  19. SkillTV-Bench: Benchmarking How Well Judges Perform on Skill-Augmented Agentic Execution

    Aug 6, 2026Zhi Han, Chenxi Zeng, Liuhaichen Yang +3LLM-as-a-JudgeLong-Horizon Agent Evaluation

    Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · University College London +1

  20. SearchAuditor: Auditing and Attributing Failures in Long-Horizon Search Agents

    Aug 5, 2026Zhixiang Liang, Yifei Liu, Yidan Huang +5Agent Failure AnalysisAI Agent Reliability

    University of Illinois Urbana-Champaign · 2Joy Future Academy, JD

  21. PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agents

    Aug 4, 2026Shuhan Xue, Zixin Ding, Yichen Shen +6LLM Agent MemoryLong-Horizon Agent Evaluation

  22. OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents

    Aug 4, 2026Jingsheng Zheng, Xinyuan Fang, Jintian Zhang +3LLM Agent MemoryLong-Horizon Agent Evaluation

    Zhejiang University · Ant Group · Independent Researcher

  23. The LLM Proposes, the Executive Disposes: A Self-Verifying Agent Instrument that Dissociates Commitment Drift from Binding Drift in Long-Horizon Agents

    Aug 4, 2026Mohsen ArjmandiAgent Failure AnalysisAI Agent Reliability

    Independent researcher

  24. EduClaw-Bench: A Long-Horizon Benchmark for Pedagogical LLM Agents with Simulated Learners

    Aug 4, 2026Unggi Lee, Sookbun Lee, Yeil Jeong +3Intelligent Tutoring SystemsAI in Education

    Korea University Sejong Campus · Opentutorials · Indiana University +2

  25. LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks

    Aug 3, 2026Ziyu Ma, Hailang Huang, Shun Zou +5Long-Horizon Agent EvaluationLong-Horizon LLM Agents

    DreamX Team, Alibaba Group

  26. Diagnosing Search Behavior and Failure Modes in Long-Horizon Search Agents

    Aug 3, 2026Qi Liu, Jiaxin Mao, Fengbin Zhu +1Deep Research AgentsLong-Horizon Agent Evaluation

    Renmin University of China Beijing, China · National University of Singapore Singapore

  27. Long-Horizon Embodied Decision-Making via Multimodal Memory Compression

    Aug 2, 2026Bingxuan Li, Rui Yang, Cheng Qian +6Long-Horizon Agent EvaluationAI Agent Benchmarks

    University of Illinois Urbana-Champaign · Northwestern University

  28. ShiJianBench: From Dialogue to Decision for Long-Horizon Evaluation of Investment Advisors

    Aug 2, 2026Jie Gong, Maowei Jiang, Zhiwei Liu +14Financial ServicesLong-Horizon Agent Evaluation

    School of Artificial Intelligence, Wuhan University · Nanjing Audit University · The University of Manchester +3

  29. OpenART: Scaling Agent Red Teaming via Open-Ended Environment Evolution

    Aug 1, 2026Yunhao Chen, Xin Wang, Yixu Wang +6Adversarial AttacksLong-Horizon Agent Evaluation

    Fudan University · Shanghai Artificial Intelligence Laboratory · Work done during Yunhao Chen’s internship at Shanghai AI Lab. +1

  30. LoopsBench: From Harness Engineering to Loop Engineering in Coding Agent Evaluation

    Jul 31, 2026Han Li, Zhemin Fang, Rili Feng +8AI Coding AgentsSoftware Engineering Benchmarks

    Microsoft · Nanjing University · Shanghai Jiao Tong University +1