mlsanityData to 14 Oct 2026

PeeriScope: A Multi-Faceted Framework for Evaluating Peer Review Quality

arXiv 2604.24071 ↗First posted 27 Apr 2026cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

The increasing scale and variability of peer review in scholarly venues has created an urgent need for systematic, interpretable, and extensible tools to assess review quality. We present PeeriScope, a modular platform that integrates structured features, rubric-guided large language model assessments, and supervised prediction to evaluate peer review quality along multiple dimensions. Designed for openness and integration, PeeriScope provides both a public interface and a documented API, supporting practical deployment and research extensibility. The demonstration illustrates its use for reviewer self-assessment, editorial triage, and large-scale auditing, and it enables the continued development of quality evaluation methods within scientific peer review. PeeriScope is available both as a live demo at https://app.reviewer.ly/app/peeriscope and via API services at https://github.com/Reviewerly-Inc/Peeriscope.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 25 references that are in the map. First posted on arXiv 27 Apr 2026.

Builds on

9 of 25 references.

References · 9

  1. 2024A Survey on LLM-as-a-Judgecited by 1,423
  2. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  3. 2024LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewingcited by 62
  4. 2023Summarizing Multiple Documents with Conversational Structure for Meta-Review Generationcited by 27
  5. 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publicationscited by 26
  6. 2025Breaking the Reviewer: Assessing the Vulnerability of Large Language Models in Automated Peer Review Under Textual Adversarial Attackscited by 16
  7. 2025LazyReview A Dataset for Uncovering Lazy Thinking in NLP Peer Reviewscited by 13
  8. 2025exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problemcited by 5
  9. 2025Disparities in Peer Review Tone and the Role of Reviewer Anonymitycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.