Latest papers

CardsList

14 papers4 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. Agent Benchmarks Stop Ranking Before They Run Out of Tasks

    Nov 10, 2026Zihan Dong, Qishi Zhan, Minxuan HuAgent BenchmarksAutomated Agent Evaluation

  2. Benchmarks as Software: Terminal-Bench and the Case for Continuous Benchmarks

    Nov 5, 2026E. Kelly Buchanan, Crystal Zhou, Scott W. Linderman +1Coding Agent BenchmarksBenchmark Validity

  3. Terminal-style Mathematical Modeling Bench: The First Agentic and Verifiable Benchmark for Mathematical Modeling

    Nov 5, 2026Xiaojun Wu, Cehao Yang, Xuhui Jiang +3Mathematical Reasoning BenchmarksLLM Evaluation

  4. Is Your Long-Horizon Benchmark Really Deep? Measuring and Synthesizing Depth in Terminal Tasks

    Nov 1, 2026Yu Jiang, Yue Huang, Hang Hua +6Terminal-Agent BenchmarksLong-Horizon Agent Evaluation

  5. RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents

    Oct 15, 2026Yunqi Liu, Peiyu Wang, Bingli Wang +21Terminal-Agent BenchmarksLLM Agent Evaluation

  6. Long-Horizon-Terminal-Bench 2.0: Automating Diverse Task Construction and Measuring Sustained Agent Progress

    Oct 9, 2026Zongxia Li, Zhongzhi Li, Yucheng Shi +14Process-Based Agent EvaluationTerminal-Agent Benchmarks

  7. Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Grading

    Jul 9, 2026Zongxia Li, Zhongzhi Li, Yucheng Shi +12Terminal-Agent BenchmarksLong-Horizon Agent Evaluation

  8. TUA-Bench: A Benchmark for General-Purpose Terminal-Use Agents

    Jun 26, 2026Shoufa Chen, Luyuan Wang, Xuan Yang +7Computer-Use Agent BenchmarksComputer-Use Agents

  9. TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks

    May 21, 2026Zhaoyang Chu, Jiarui Hu, Xingyu Jiang +8Computer-Use Agent BenchmarksTerminal-Agent Benchmarks

  10. ClawForge: Generating Executable Interactive Benchmarks for Command-Line Agents

    May 13, 2026Yuxiang Lai, Peng Xia, Haonian Ji +8Computer-Use Agent BenchmarksTerminal-Agent Benchmarks

  11. WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation

    May 11, 2026Shuangrui Ding, Xuanlang Dai, Long Xing +14LLM Agent HarnessesAI Agent Benchmarks

  12. Learning CLI Agents with Structured Action Credit under Selective Observation

    May 8, 2026Haoyang Su, Ying WenTerminal-Agent BenchmarksComputer-Use Agents