Scholarly Peer Review

Ask about this topic

Overview

Scholarly peer review examines how researchers assess manuscripts, resolve disagreement, and use reviews, rebuttals, and editorial decisions to shape publication outcomes. Studies draw on open-review and multi-round datasets, statistical models of scores and reviewer effects, and analyses of review quality, bias, and policy. A growing strand develops LLM tools for review drafting, rebuttal support, claim and citation verification, and evidence-grounded meta-review, often combining retrieval, rubrics, agents, and human oversight. The central tension is whether these tools can improve feedback and reduce workload without amplifying bias, unsupported judgments, or strategic gaming; reliable evaluation across disciplines and real review workflows remains difficult.

Latest papers

CardsList

78 papers6 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. Major Revision, Minor Accountability: LLMs as Reviewers of Published Articles in Top-Tier Journals

    Oct 22, 2026Bastien Le Guellec, Su Hwan Kim, Raphael Bentegeac +1Scholarly Peer ReviewAutomated Peer Review

    CHU Lille, Lille, France · Technical University of Munich (TUM), Munich, Germany

  2. Can We Believe AI Peer Review?

    Oct 14, 2026Zongrui Yang, Haoyuan Li, Zhongsheng Wang +2Scholarly Peer ReviewAutomated Peer Review

    University of Auckland Auckland, New Zealand

  3. Who Wrote It Is Not Enough: Detecting Who Contributed the Insight

    Oct 5, 2026Zhuoyang Zou, Abolfazl Ansari, Jiaxi Yang +4Data ProvenanceScholarly Peer Review

    Pennsylvania State University, USA · University of Sheffield, United Kingdom

  4. The Review Lottery: Benchmarking an Observational Estimator of Peer-Review Noise (ICLR 2017-2025)

    Oct 5, 2026Feilian HuangInter-Rater ReliabilityAnnotator Disagreement

    Independent researcher

  5. Science Utopia? Closed-Loop LLM Simulation of Academic Research Ecosystems

    Oct 1, 2026Yiqiao Jin, Yiyang Wang, Lucheng Fu +8Scholarly Peer ReviewComputational Social Science

    Georgia Institute of Technology · University of California, Los Angeles · University of Chicago +1

  6. Policy-Conditioned AI-Use Detection: An Evidentiary Framework for Academic Publishing

    Sep 29, 2026Jairo Diaz-Rodriguez, Mumin JiaAI AccountabilityScholarly Peer Review

    Department of Mathematics and Statistics, York University, Toronto, Ontario M3J 1P3

  7. How Much Were You Told? Measuring External Information in Peer Reviews

    Sep 23, 2026Matthieu Dubois, Pablo Piantanida, François YvonAI-Generated Text DetectionLLM Auditing

    Sorbonne Université, CNRS, ISIR · International Laboratory on Learning Systems (ILLS) Quebec AI Institute (MILA) CNRS, CentraleSupélec, Université Paris-Saclay

  8. When Evidence Conflicts: Reliability-aware Meta-review Generation

    Sep 21, 2026Xinzhe Wang, Fei Tao, Jiang Xie +2Scholarly Peer ReviewEvidence-Grounded Generation

    Chongqing University of Posts and Telecommunications, China · NewsBreak, USA

  9. ReGround: Grounding Reviewer Comments in Multimodal Evidence

    Sep 10, 2026Serwar Basch, Lizhen Qu, Iryna GurevychMultimodal IRScholarly Peer Review

    Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer Science and Hessian Center for AI (hessian.AI), TU Darmstadt · Department of Data Science & AI, Monash University, Australia

  10. Do Reviewers Still Reward Lexical Complexity? A Frozen-Rater Study of Preference Drift in 124K ICLR Reviews

    Sep 8, 2026Jiabin ZhengLLM-as-a-JudgeScholarly Peer Review

    School of Computer Science, Peking University

  11. The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing

    Sep 7, 2026Chenguang Wang, Ming Li, Adebayo Braimah +6AI-Assisted Scientific ResearchScholarly Peer Review

    Virginia Tech · University of Maryland · Stony Brook University +1

  12. Who Pays for Open Review? Visible Author Reputation and Its Effect on Ratings

    Sep 7, 2026Qinghua Zhao, Xinyu Chen, Yanhui Yang +3Scholarly Peer Review

    Hefei University · Pengcheng Laboratory · Lanzhou University

  13. Beyond Final Decisions: A Process-Centric Benchmark for Transparent AI-Assisted Peer Review

    Sep 5, 2026Siming Yuan, Xueyi Zhang, Wangze Ni +7Scholarly Peer ReviewAutomated Peer Review

    Zhejiang University · Nanyang Technological University · School of Business, Sun Yat-sen University +3

  14. More Than Mimicking Reviewers: Evaluating LLMs for Pre-Submission Peer Review

    Sep 5, 2026Pouya Parsa, Amin RezaeiScholarly Peer ReviewAutomated Peer Review

    University of Minnesota · Invariant Tech Inc.

  15. CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Review

    Sep 4, 2026Jicheng Zhou, Kemou Li, Kahim Wong +5Scholarly Peer ReviewAutomated Bidding

    State Key Laboratory of Internet of Things for Smart City, University of Macau · Mila – Québec AI Institute · McGill University +2

  16. More Criticism Does Not Make a Better Review: EquiReview-R

    Sep 3, 2026Zexing Zhang, Jichao Li, Tianyang Lei +2Scholarly Peer ReviewEvidence-Grounded Generation

    College of Systems Engineering, National University of Defense Technology, Changsha 410073, China

  17. HalluPeer: A Taxonomy-driven Benchmark for Detecting Hallucinations in Scientific Peer Reviews

    Sep 3, 2026Tzu-Ling Lin, Dong-Ting Yao, Teng-Fang Hsiao +2Hallucination DetectionScholarly Peer Review

    National Yang Ming Chiao Tung University

  18. Peerify: Benchmarking Peer-Review Claim Verification

    Sep 2, 2026Alireza Daghighfarsoodeh, Sajad Ebrahimi, Ali Ghorbanpour +4Claim VerificationScholarly Peer Review

    Reviewerly · University of Toronto · University of California, Berkeley

  19. Metag: A dataset to build agentic meta-reviewing capabilities

    Aug 20, 2026Anirudh Sundar, Min Chen, Divya Tadimeti +11Scholarly Peer ReviewAutomated Peer Review

    Microsoft · Georgia Institute of Technology

  20. How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review

    Aug 10, 2026Ming Li, Chenguang Wang, Xirui Li +5Reward HackingLLM Evaluation

    University of Maryland · Virginia Tech · University of Waterloo +1

  21. AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Quality

    Aug 4, 2026Alexander M. Fichtl, Lukas Ellinger, Josefin Kelber +2LLM EvaluationScholarly Peer Review

    Social Computing Research Group Technical University of Munich Boltzmannstraße 3, 85748, Garching, Germany

  22. AutoSupervision: Closing the Feedback Loop in Scientific Workflows with Grounded Revision Verification

    Jul 30, 2026Haobo Li, Eunseo Jung, Wenxiao Zhao +8LLM EvaluationScholarly Peer Review

    1Shanghai AI Laboratory · 3The Hong Kong University of Science and Technology · University of California, Los Angeles

  23. SciFigAlign: Scoring Scientific Figures by Fine-tuned Alignment of Visuals with Manuscript Evidence

    Jul 29, 2026Chuanzhi Xu, Zihan Deng, Huiqi Liang +4Scholarly Peer ReviewImage Quality Assessment

    The University of Sydney · The University of Hong Kong · Indiana University +2

  24. Articulate Intuition or Genuine Analysis? Benchmarking Epistemic Reliability in LLM-as-a-Judge Peer Reviews

    Jul 12, 2026Nuo Chen, Qian Wang, Qingyun Zou +1LLM-as-a-JudgeScholarly Peer Review

    National University of Singapore

  25. AAAI-26 Dual Submissions: Novel Challenges

    Jul 7, 2026Kiri L. Wagstaff, Joydeep Biswas, Erich Merrill +4Scholarly Peer Review

    OSU Libraries Oregon State University Corvallis, OR 97330 · Computer Science Department University of Texas at Austin Austin, TX 78712 · Independent Researcher +4

  26. Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferences

    Jul 1, 2026Mark Russinovich, Ram Shankar Siva Kumar, Ahmed SalemHallucination in Language ModelsCitation Verification

    *Microsoft Azure · §Microsoft

  27. LLM-Based Scientific Peer Review: Methods, Benchmarks, and Reliability Challenges

    Jun 23, 2026Thi Huyen Nguyen, Zahra AhmadiScholarly Peer ReviewLLM Security

    L3S Research Center, Leibniz University Hannover Hannover, Germany · Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School Lower Saxony Center for AI and Causal Methods in Medicine (CAIMed) Hannover, Germany

  28. Aspect-Based Sentiment Evolution and its Correlation with Review Rounds in Multi-Round Peer Reviews: A Deep Learning Approach

    Jun 23, 2026Ruxue Hana, Haomin Zhoua, Jiangtao Zhong +1Sentiment AnalysisScholarly Peer Review

    School of Economics and Management, East China Normal University, Shanghai 200062, People’s Republic of China · Department of Information Management, Nanjing University of Science and Technology, Nanjing 210094, People’s Republic of China

  29. Rebuttals Move Peer-Review Scores, but Initial-Review Structure Bounds the Movement

    Jun 20, 2026Mathieu Louis, Tibo Vanleke, Vincent Ginis +1Scholarly Peer Review

    Data Analytics Lab, Vrije Universiteit Brussel, Pleinlaan 5, 1050 Brussel, Belgium · imec-SMIT, Vrije Universiteit Brussel, Pleinlaan 9, 1050 Brussels, Belgium · School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA

  30. Which Review Aspect Has a Greater Impact on the Duration of Open Peer Review in Multiple Rounds? -- Evidence from Nature Communications

    Jun 20, 2026Haomin Zhou, Ruxue Han, Jiangtao Zhong +1Scholarly Peer Review

    Nanjing University of Science and Technology, 200 Xiaolingwei Street, Nanjing, China