Swe-Bench Verified

Ask about this topic

Recent momentum

-50%

3 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in AI Software Engineering

Neighbouring directions

Code GenerationCoding AgentsCode QualitySoftware EngineeringTest GenerationRepositorySoftwareCodebases

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Swe-Bench Verified.

34 papers

Latest in Swe-Bench Verified

Open your feed →
CardsList

  1. SWE-Bench Pro Verified: A Reliable Benchmark for Software Engineering Agents

    Sep 8, 2026Pujun Zheng, Zixin Shang, Shufan Jiang +5Swe-Bench VerifiedRepository-Level Code Understanding

  2. Efficient SWE Agent Benchmarking via Trajectory-Aware Evaluation

    Sep 1, 2026Kefeng Duan, Dewu Zheng, Yanlin Wang +7Swe-Bench VerifiedAgentic Benchmarks

  3. RealSWE: A Compositional Evaluation of Coding Agents under Realistic User Requests

    Aug 28, 2026Gyuhyeong Kim, Hyojung Gwon, Jeonghyeon Kim +2Swe-Bench VerifiedCoding Agents

  4. SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?

    Aug 20, 2026Zhipeng Xu, Jiahao Lu, Yining Zheng +2Swe-Bench VerifiedSoftware Engineering

  5. SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring

    Aug 10, 2026Yuling Shi, Jinghan Xu, Kelin Fu +12Swe-Bench VerifiedCode Refactoring

  6. FailForge: Distilling Procedural Competence from Persistent Failures into Code Agents

    Aug 9, 2026Dongyi Lv, Fushun E, Aichen Cai +8Tool FailuresCoding Agents

  7. CodeGrep: An RL-Trained Retrieval Agent for LLM Coding Agents

    Aug 6, 2026Wuya Chen, Yihao yang, Yang Cao +1Coding AgentsSwe-Bench Verified

  8. Fail-Fast, Restart-Smart: Early Failure Prediction and Restart for SWE Agentic Tasks

    Aug 4, 2026Chenyu Wang, Yunbo Lyu, Junda He +4Early Failure PredictionSwe-Bench Verified

  9. PAIChecker: Uncovering and Checking PR-Issue Misalignment in SWE-Bench-Like Benchmarks

    Jul 30, 2026Manyi Wang, Junjielong Xu, Pinjia HeSwe-Bench VerifiedMisalignment

  10. A Systematic Evaluation of Trajectory Data Curation for LoRA Fine-Tuning of Code Agents

    Jul 19, 2026Yunze HanCoding AgentsInteraction Trajectories

  11. Talaria: Session-Aware Serverless Serving of Hundred-Billion-Parameter LLMs

    Jul 19, 2026Utopia Meng, Unicornt Zhao, Derek Li +2Large Language Model ServingSmall Language Models

  12. How Many Tasks Are Enough for Agent Benchmark Decisions? A Replay Analysis of Public LLM Agent Benchmarks

    Jul 14, 2026Wei-Jung HuangAgentic BenchmarksSwe-Bench Verified

  13. DeepSWE: Measuring Frontier Coding Agents on Original, Long-Horizon Engineering Tasks

    Jul 8, 2026Wenqi Huang, Charley Lee, Leonard Tng +1Swe-Bench VerifiedCoding Agents

  14. Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?

    Jul 1, 2026Zhi Chen, Zhensu Sun, Yuling Shi +2Swe-Bench VerifiedCode Optimization

  15. SWE-Doctor: Guiding Software Engineering Agents with Runtime Diagnosis from Multi-Faceted Bug Reproduction Tests

    Jul 1, 2026Yaoqi Guo, Yang Liu, Jie M. Zhang +3Swe-Bench VerifiedBug

  16. Towards Evaluation of Implicit Software World Models in Coding LLMs

    Jun 25, 2026Egor Bogomolov, Yaroslav ZharovSoftware EngineeringSwe-Bench Verified

  17. Code Isn't Memory: A Structural Codebase Index Inside a Coding Agent

    Jun 21, 2026Ishaan Bhola, Adithyan Krishnan, Sravanth Kurmala +1CodebasesSwe-Bench Verified

  18. Auditing Reward Hackability in Code RL Training Environments

    Jun 14, 2026Shreshth RajanCode QualityHacking

  19. Dialogue SWE-Bench: A Benchmark for Dialogue-Driven Coding Agents

    Jun 12, 2026Brendan King, Jeffrey FlaniganCoding AgentsSwe-Bench Verified

  20. Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks

    Jun 10, 2026Mengyu Zheng, Kai Han, Boxun Li +13Swe-Bench VerifiedCoding Agents

  21. SpecBench: Evaluating Specification-Level Reasoning for Software Engineering LLM Agents

    May 28, 2026Grant Hamblin, Kevin Song, Zhanda Zhu +4Software EngineeringSwe-Bench Verified

  22. Libra: Training the Environment for Agentic Information Retrieval

    May 26, 2026Xuan Zhao, Andy Chiu, Gengyu WangSwe-Bench VerifiedEnvironment

  23. Grimlock: Guarding High-Agency Systems with eBPF and Attested Channels

    May 26, 2026Qiancheng Wu, Wenhui Zhang, Gan Fang +5Canonical Action Verification And AttestationOrchestration

  24. SWE-Mutation: Can LLMs Generate Reliable Test Suites in Software Engineering?

    May 21, 2026Yuxuan Sun, Yuze Zhao, Yufeng Wang +6Test GenerationSwe-Bench Verified

  25. From Patches to Trajectories: Privileged Process Supervision for Software-Engineering Agents

    May 21, 2026Murong Ma, Tianyu Chen, Yun Lin +7Swe-Bench VerifiedSupervised Fine-Tuning

  26. AgentLens: Revealing The Lucky Pass Problem in SWE-Agent Evaluation

    May 13, 2026Priyam Sahoo, Gaurav Mittal, Xiaomin Li +4Swe-Bench VerifiedAgentic Evaluations

  27. Step Rejection Fine-Tuning: A Practical Distillation Recipe

    May 11, 2026Igor Slinko, Ilia Zavidnyi, Egor Bogomolov +1Swe-Bench VerifiedProgressive Distillation

  28. An Executable Benchmarking Suite for Tool-Using Agents

    May 10, 2026Zhiqing Zhong, Zhijing Ye, Jiamin Wang +1Swe-Bench VerifiedRuntime Enforcement

  29. MOTOR-Bench: A Real-world Dataset and Multi-agent Framework for Zero-shot Human Mental State Understanding

    May 10, 2026Xiaoyu Yuan, Niklas Heikkala, Tiina Törmänen +3Theory-Of-Mind ReasoningMulti-Agent Reasoning

  30. SWE Atlas: Benchmarking Coding Agents Beyond Issue Resolution

    May 8, 2026Mohit Raghavendra, Soham Dan, Miguel Romero Calvo +12Swe-Bench VerifiedCoding Agents

  31. SWE-WebDevBench: Evaluating Coding Agent Application Platforms as Virtual Software Agencies

    May 6, 2026Siddhant Saxena, Nilesh Trivedi, Vinayaka JyothiSwe-Bench VerifiedCoding Agents

  32. SWE-Edit: Rethinking Code Editing for Efficient SWE-Agent

    Apr 28, 2026Yikai Zhang, Jiaxin Pei, Kenan Li +9Swe-Bench VerifiedCoding Agents

  33. SWE-Tester: Training Open-Source LLMs for Issue Reproduction in Real-World Repositories

    Jan 20, 2026Aditya Bharat Soni, Rajat Ghosh, Vaishnavi Bhargava +2Test GenerationBug

  34. SWE-fficiency: Can Language Models Optimize Real-World Repositories on Real Workloads?

    Nov 8, 2025Jeffrey Jian Ma, Milad Hashemi, Amir Yazdanbakhsh +5Swe-Bench VerifiedCode Optimization