Latest papers

CardsList

75 papers40 papers in the last four weeks, up 567% on the four weeks before. 0.3% of all new papers.

  1. Termination Lag: Coding Agents Solve Early but Stop Late

    Nov 11, 2026Musa Cim, Burak Topcu, Mahmut Taylan KandemirLLM AgentsLLM Agent Efficiency

  2. XStack: A Benchmark for ML Repo Migration

    Nov 5, 2026Linrong Cai, Taiming Lu, Haozhe Chen +1Coding Agent BenchmarksSoftware Engineering Benchmarks

  3. Benchmarks as Software: Terminal-Bench and the Case for Continuous Benchmarks

    Nov 5, 2026E. Kelly Buchanan, Crystal Zhou, Scott W. Linderman +1Coding Agent BenchmarksBenchmark Validity

  4. Learning the Task or Learning the Verifier? Rethinking Criteria Exposure in Embodied Self-Improvement

    Nov 5, 2026Wenbo Huang, Jianxin Bi, Shunyu Yang +10Self-Improving AgentsBenchmark Contamination

  5. Take It From Here: Evaluating Coding Agents On Project Takeover

    Nov 5, 2026Dingxian Wang, Zhe Fu, Jiaqi Deng +9Coding Agent BenchmarksSoftware Engineering Benchmarks

  6. SeVerus: Context-Aware, Gamified Benchmarking for Rust Verification

    Nov 4, 2026Álvaro F. Silva, Martim Afonso, Nuno Saavedra +3Coding Agent BenchmarksFormal Verification

  7. ServerBench: How can your coding agents design specialized LLM serving systems?

    Nov 4, 2026Xinrui Zhong, Zhiming Wang, Yongqi Liu +5LLM ServingCoding Agent Benchmarks

  8. DARE: Difficulty Analysis for Repair Enhancement

    Nov 4, 2026Jikwang Lee, Seungwook Jung, Jaechang NamAutomated Program RepairAutomated Agent Evaluation

  9. PersonaCodeBench: Evaluating Coding Agents in Persona-driven Human-Interactive Sessions

    Nov 3, 2026Haixin Wang, Jianheng Hou, Hongyu Shen +27Coding AgentsAI Agent Evaluation

  10. VeriHarm-Bench: Measuring Harmful Success in LLM Coding Agents Verifiably

    Nov 2, 2026Wei-Lin Chen, Zhepei Wei, Xinyu Zhu +3AI Agent Safety BenchmarksLLM Agent Safety

  11. DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems?

    Nov 2, 2026Yuxuan Jiang, Chenglin Liu, John Rose +6Coding Agent BenchmarksLLM Agent Evaluation

  12. Harvesting SWE Benchmarks from Wild Vibe Coding Sessions

    Nov 2, 2026Ao Lu, Yuanhao Zeng, Shaocheng Lan +5Coding Agent BenchmarksBenchmark Construction

  13. Switch-SWE: Do Coding Agents Hold Focus When Switching Between Unfinished Tasks?

    Nov 1, 2026Shuochen Chang, Qianli Ma, Yibo Miao +7Coding AgentsCoding Agent Benchmarks

  14. Launder-Bench: Can Repository-Level Agentic Code Laundering Be Detected?

    Nov 1, 2026Yuntong Hu, Hongji Pu, Zimo Li +5Data ProvenanceAuthorship Attribution

  15. Decentralized Multi-Agent Coordination and Communication in Shared Codebases

    Oct 30, 2026Rishabh Mediratta, Lingyun Xiao, Peter Stone +2Multi-Agent CoordinationMulti-Agent Coding

  16. VerusWeave: A Benchmark for Proof Repair in Concurrent Verus Programs

    Oct 30, 2026Pedro Ribeiro, Martim Afonso, André Vasconcelos +1Software Engineering BenchmarksCoding Agent Benchmarks

  17. When Requirements Interact: Scaling Long-Horizon Coding via Interdependent Specifications

    Oct 29, 2026Yishuo Cai, Minzheng Wang, Liang Zhao +5Code GenerationLong-Horizon Agent Tasks

  18. Well-Specified and Well-Tested? Assessing SWE-bench-Style Datasets with a Self-Evolving Agent

    Oct 29, 2026Zhonghao Jiang, Xuyang Zheng, Yanfu Yan +3LLM-Assisted AnnotationSoftware Engineering Benchmarks