mlsanityData to 14 Oct 2026

From peer review nuances to best practices

arXiv 2607.22681 ↗First posted 12 Jul 2026cs.DL cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This report studies three nuances in peer review data: paper version, score version, and input format. We characterize how the variants differ, and measure their impact on downstream tasks. Based on our findings, we offer best practices for both data providers and data users.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 20 references that are in the map. First posted on arXiv 12 Jul 2026.

Builds on

17 of 20 references.

References · 17

  1. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  2. 2018A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applicationscited by 136
  3. 2025DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Processcited by 100
  4. 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
  5. 2024OpenReviewer: A Specialized Large Language Model for Generating Critical Scientific Paper Reviewscited by 65
  6. 2022NLPeer: A Unified Resource for the Computational Study of Peer Reviewcited by 60
  7. 2024Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Reviewcited by 53
  8. 2024Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysiscited by 33
  9. 2022MOPRD: A multidisciplinary open peer review datasetcited by 32
  10. 2025ReviewAgents: Bridging the Gap Between Human and AI-Generated Paper Reviewscited by 32
  11. 2024What Can Natural Language Processing Do for Peer Review?cited by 25
  12. 2025Re2: A Consistency-ensured Dataset for Full-stage Peer Review and Multi-turn Rebuttal Discussionscited by 23
5 more
  1. 2025ReviewRL: Towards Automated Scientific Review with RLcited by 19
  2. 2025ReviewerToo: Should AI Join The Program Committee? A Look At The Future of Peer Reviewcited by 16
  3. 2025Automatic Reviewers Fail to Detect Faulty Reasoning in Research Papers: A New Counterfactual Evaluation Frameworkcited by 11
  4. 2026When AI reviews science: Can we trust the referee?cited by 2
  5. 2026FMMD: A multimodal multidisciplinary dataset of open peer reviews from F1000Researchcited by 1

Built on by

Not cited yet.