Automated Code Review

Ask about this topic

Overview

Automated code review studies how software tools can inspect code changes for bugs, security risks, policy violations, and readiness to merge. Systems combine static analysis and tests with large language models that interpret diffs, repository context, and developer intent; some use multiple agents or staged checks to filter findings. Benchmarks based on real pull requests increasingly test not only defect detection but also false positives, security attacks, and how issues change over multiple review rounds. A central challenge is making reviews technically reliable and grounded in evidence while keeping them useful to developers and preserving human oversight.

Latest papers

CardsList

50 papers13 papers in the last four weeks, with none the four weeks before. 0.1% of all new papers.

  1. Philosophical Dispositions as Behavioral Constraints for AI-Assisted Code Review: An Empirical Study

    May 21, 2026Kaushal BansalPersona PromptingAutomated Code Review

    Salesforce, Inc. San Francisco, CA, USA

  2. Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review

    May 17, 2026Hüseyin Özgür Kamalı, Erdem Tuna, Vahid Haratian +1Agentic WorkflowsAutomated Code Review

    Department of Software Engineering Ankara University Ankara, Turkey · Microsoft Ankara, Turkey · Department of Computer Engineering Bilkent University Ankara, Turkey

  3. MathlibPR: Pull Request Merge-Readiness Benchmark for Formal Mathematical Libraries

    May 8, 2026Zixuan Xie, Xinyu Liu, Shangtong ZhangLLM EvaluationLLM Agent Evaluation

    University of Virginia

  4. MOSAIC-Bench: Measuring Compositional Vulnerability Induction in Coding Agents

    May 5, 2026Jonathan Steinberg, Oren GalLanguage Model Safety EvaluationAI Coding Agents

    Swarms & AI Lab (SAIL), University of Haifa

  5. PERSA: Reinforcement Learning for Professor-Style Personalized Feedback with LLMs

    May 1, 2026Ravi Ranjan, Utkarsh Grover, Xiaomin Lin +1Educational Feedback GenerationAutomated Code Review

    Florida International University (FIU), Miami, USA

  6. Understanding the Limits of Automated Evaluation for Code Review Bots in Practice

    Apr 27, 2026Veli Karakaya, Utku Boran Torun, Baykal Mehmet Uçar +1LLM-as-a-JudgeHuman-in-the-Loop Evaluation

    Bilkent University Ankara, Turkey · Beko İstanbul, Turkey

  7. AI-Assisted Code Review as a Scaffold for Code Quality and Self-Regulated Learning: An Experience Report

    Apr 25, 2026Eduardo Oliveira, Michael Fu, Patanamon Thongtanunam +2Self-Regulated LearningGenerative AI in Education

    The University of Melbourne Melbourne, Australia · University of Eastern Finland Joensuu, Finland

  8. Refute-or-Promote: An Adversarial Stage-Gated Multi-Agent Review Methodology for High-Precision LLM-Assisted Defect Discovery

    Apr 21, 2026Abhinav AgarwalSoftware Vulnerability DetectionLLMs for Cybersecurity

  9. The Code Whisperer: LLM and Graph-Based AI for Smell and Vulnerability Resolution

    Apr 12, 2026Mohammad Baqar, Raji Rustamov, Alexander HughesSoftware Vulnerability DetectionStatic Code Analysis

  10. IACDM: Interactive Adversarial Convergence Development Methodology -- A Structured Framework for AI-Assisted Software Development

    Mar 31, 2026Jasmine MoreiraAI-Assisted Software DevelopmentAI Coding Agents

  11. SWE-PRBench: Benchmarking AI Code Review Quality Against Pull Request Feedback

    Mar 27, 2026Deepak KumarAutomated Code Review

    Independent Researcher

  12. Learning From Developers: Towards Reliable Patch Validation at Scale for Linux

    Mar 25, 2026Chih-En Lin, Attreyee Mukherjee, Ajay Rawat +2Automated Code Review

    Purdue University

  13. Code Review Agent Benchmark

    Mar 24, 2026Yuntong Zhang, Zhiyuan Pan, Imam Nur Bani Yusuf +3Automated Code ReviewSoftware Engineering Benchmarks

    National University of Singapore · Zhejiang University · SonarSource

  14. When AI Agrees Too Much: Manipulating Automated Code Review via Bias Injection

    Mar 19, 2026Georgios Alexopoulos, Nikolaos Alexopoulos, Diomidis Spinellis +1Automated Code ReviewAdversarial Attacks on LLMs

    University of Athens · National Infrastructures for Research and Technology · Athens University of Economics and Business +1

  15. RepoReviewer: A Local-First Multi-Agent Architecture for Repository-Level Code Review

    Mar 17, 2026Peng ZhangAutomated Code ReviewSoftware Engineering Agents

  16. CR-Bench: Evaluating the Real-World Utility of AI Code Review Agents

    Mar 10, 2026Kristen Pereira, Neelabh Sinha, Rajat Ghosh +1Automated Code ReviewAI Agent Evaluation

    Nutanix, Inc.

  17. ESAA-Security: An Event-Sourced, Verifiable Architecture for Agent-Assisted Security Audits of AI-Generated Code

    Mar 6, 2026Elzo Brito dos Santos FilhoAI Agent AuditingSoftware Security

  18. ContextCov: Deriving and Enforcing Executable Constraints from Agent Instruction Files

    Feb 28, 2026Reshabh K SharmaRuntime Enforcement for AI AgentsCoding Agents

    University of Washington Seattle, Washington, USA

  19. Are LLMs Reliable Code Reviewers? Systematic Overcorrection in Requirement Conformance Judgement

    Feb 28, 2026Haolin Jin, Huaming ChenAutomated Code ReviewLLM Reliability

    University of Sydney, Sydney, NSW, Australia.

  20. Re4: Scientific Computing Agent with Rewriting, Resolution, Review and Revision

    Aug 28, 2025Ao Cheng, Lei Zhang, Guowei HeScientific Code GenerationExecution-Guided Code Generation

    The State Key Laboratory of Nonlinear Mechanics, Institute of Mechanics, Chinese Academy of Sciences, Beijing 100190, China · School of Engineering Science, University of Chinese Academy of Sciences, Beijing 100049, China