mlsanityData to 14 Oct 2026

Examining the Cognitive Gap Between Authors and Peer Reviewers on Academic Paper Novelty

arXiv 2606.13452 ↗First posted 11 Jun 2026cs.DL cs.CL cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Novelty is a crucial metric for assessing the quality of academic papers. Scholars strive to highlight the novel aspects of their work, particularly in the title, abstract, and introduction. Peer review, serving as the gatekeeper of scientific rigor, rigorously evaluates the novelty of papers, yet a cognitive gap may exist between author self-promotion and reviewer evaluation. To investigate this, we analyzed 15,328 academic papers published in Nature Communications from 2016 to 2021, along with their peer-review comments. We found that both reviewers and authors emphasize result-oriented innovation, with reviewers adopting a more comprehensive evaluation perspective. Furthermore, by examining promotional intensity against inherent paper novelty, we found that its effect depends on the paper's actual innovation level. Highly innovative papers benefit from stronger promotional language, receiving more positive evaluations. We also found that promotional language significantly correlates with reviewer disagreement on novelty specifically for papers of moderate innovativeness, whereas it has negligible impact for papers with either very high or very low novelty. This reveals how promotional language operates most prominently in the gray area of academic evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 26 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

7 of 26 references.

References · 7

  1. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  2. 2019On Testing for Biases in Peer Reviewcited by 15
  3. 2025A review on the novelty measurements of academic paperscited by 12
  4. 2024Promotional Language and the Adoption of Innovative Ideas in Sciencecited by 8
  5. 2025SC4ANM: Identifying Optimal Section Combinations for Automated Novelty Prediction in Academic Paperscited by 8
  6. 2019Do we measure novelty when we analyze unusual combinations of cited references? A validation study of bibliometric novelty indicators based on F1000Prime datacited by 7
  7. 2018Examining Scientific Writing Styles from the Perspective of Linguistic Complexitycited by 4

Built on by

Not cited yet.