cs.CLApr 27, 2026

PeeriScope: A Multi-Faceted Framework for Evaluating Peer Review Quality

Authors: Sajad EbrahimiSoroush SadeghianAli GhorbanpourNegar ArabzadehSara SalamatSeyed Mohammad HosseiniHai Son LeMahdi Bashari+1 more

Organizations: Reviewerly · Reviewerly, UC Berkeley · Reviewerly, University of Toronto

Abstract

The increasing scale and variability of peer review in scholarly venues has created an urgent need for systematic, interpretable, and extensible tools to assess review quality. We present PeeriScope, a modular platform that integrates structured features, rubric-guided large language model assessments, and supervised prediction to evaluate peer review quality along multiple dimensions. Designed for openness and integration, PeeriScope provides both a public interface and a documented API, supporting practical deployment and research extensibility. The demonstration illustrates its use for reviewer self-assessment, editorial triage, and large-scale auditing, and it enables the continued development of quality evaluation methods within scientific peer review. PeeriScope is available both as a live demo at https://app.reviewer.ly/app/peeriscope and via API services at https://github.com/Reviewerly-Inc/Peeriscope.

Explore similar work

CardsList
  1. Peerispect: Claim Verification in Scientific Peer Reviews

    Apr 19, 2026Ali Ghorbanpour, Soroush Sadeghian, Alireza Daghighfarsoodeh +4Peer ReviewNoisy Claim Verification

  2. PRISM: A Multi-Dimensional Benchmark for Evaluating LLM Peer Reviewers

    May 26, 2026Ngoc Phan Phuoc Loc, Toan Huynh La Viet, Thanh Tran Khanh +8Peer ReviewCritique