Overview

Automated peer review studies how computational systems can evaluate manuscripts, identify weaknesses, check claims, and assist tasks such as reviewer matching, rebuttal, and meta-review. Common approaches include prompting and fine-tuning language models, retrieval-augmented and multi-agent review, rubric-based scoring, and tool-assisted checks of references, code, or experiments. Evaluation uses conference-paper datasets, expert annotations, outcome prediction, and injected-error or claim-verification benchmarks to test dimensions such as correctness, coverage, calibration, and actionability. Systems can provide useful and sometimes complementary feedback, but unreliable judgments, hallucinations, bias, and vulnerability to strategic rewriting or prompt injection leave human oversight and robust evaluation central concerns.

Latest papers

CardsList

109 papers11 papers in the last four weeks, down 21% on the four weeks before. 0.1% of all new papers.

  1. REM-CTX: Automated Peer Review via Reinforcement Learning with Auxiliary Context

    Mar 31, 2026Pawin Taechoyotin, Daniel E. AcunaAutomated Peer ReviewRL for Language Models

  2. Large language models for post-publication research evaluation: Evidence from expert recommendations and citation indicators

    Mar 27, 2026Mengjia Wu, Yi Zhang, Robin Haunschild +1Automated Peer ReviewScholarly Peer Review

  3. MemoNoveltyAgent: A Historical Research Memory-Aware Agent Workflow for Paper Novelty Assessment

    Mar 21, 2026Jiajun Hou, Hexuan Deng, Wenxiang Jiao +4Agentic RAGMemory-Augmented Agents

  4. From Isolated Scoring to Collaborative Ranking: A Comparison-Native Framework for LLM-Based Paper Evaluation

    Mar 18, 2026Pujun Zheng, Jiacheng Yao, Jinquan Zheng +6Automated Peer ReviewScholarly Peer Review

  5. RbtAct: Rebuttal as Supervision for Actionable Review Feedback Generation

    Mar 10, 2026Sihong Wu, Yiling Ma, Yilun Zhao +4Automated Peer Review

  6. Evaluating LLM-Based Grant Proposal Review via Structured Perturbations

    Mar 9, 2026William Thorne, Joseph James, Yang Wang +2Automated Peer ReviewAutomated Evaluation

  7. Supporting Artifact Evaluation with LLMs: A Study with Published Security Research Papers

    Mar 6, 2026David Heye, Karl Kindermann, Robin Decker +5Scientific ReproducibilityAutomated Evaluation

  8. APRES: An Agentic Paper Revision and Evaluation System

    Mar 3, 2026Bingchen Zhao, Jenny Zhang, Chenxi Whitehouse +8Scientific CommunicationScholarly Peer Review

  9. DeepReviewer 2.0: A Traceable Agentic System for Auditable Scientific Peer Review

    Mar 3, 2026Yixuan Weng, Minjun Zhu, Qiujie Xie +7Automated Peer ReviewScholarly Peer Review

  10. Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge

    Mar 2, 2026Tatiana Chakravorti, Pranav Narayanan Venkit, Sourojit Ghosh +1Scholarly Peer ReviewAI Governance

  11. From Bias to Balance: Fairness-Aware Paper Recommendation for Equitable Peer Review

    Feb 25, 2026Uttamasha Anjally Oyshi, Susan GauchFairness in Recommender SystemsRecommender Systems

  12. FMMD: A multimodal multidisciplinary dataset of open peer reviews from F1000Research

    Feb 15, 2026Zhenzhen Zhuang, Yuqing Fu, Jing Zhu +2Scholarly Peer ReviewAutomated Peer Review

  13. Reviewing the Reviewer: LLM-Assisted Reviewer Feedback Generation for Guideline Compliance

    Jan 17, 2026Sukannya Purkayastha, Qile Wan, Anne Lauscher +2Scholarly Peer ReviewAutomated Peer Review

  14. PaperAudit-Bench: Benchmarking Error Detection in Research Papers for Critical Automated Peer Review

    Jan 7, 2026Songjun Tu, Yiwen Ma, Jiahao Lin +6Language Model Error DetectionAutomated Peer Review

  15. "Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewers

    Nov 3, 2025Qin Zhou, Zhexin Zhang, Zhi Li +1Adversarial Prompt GenerationIndirect Prompt Injection