mlsanityData to 14 Oct 2026

Aspect-Based Sentiment Evolution and its Correlation with Review Rounds in Multi-Round Peer Reviews: A Deep Learning Approach

arXiv 2606.24188 ↗First posted 23 Jun 2026cs.CL cs.DL cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Mining sentiment information from the textual content of peer review comments offers valuable insights into the scientific evaluation process. However, previous studies are often constrained by coarse-grained analysis and the lack of differentiation across review rounds. Notably, the dynamic shifts in reviewers' focus and sentiment tendencies throughout multiple review stages remain underexplored. To address this gap, the present study investigates the distribution and evolution of aspect-level sentiments and examines their correlation with the number of review rounds. We begin by segmenting the multi-round review comments of 11,063 accepted papers from Nature Communications and identifying fine-grained review aspect clusters. A manually annotated corpus of approximately 5,000 review sentences is then constructed. Using this dataset, we train a series of deep learning-based aspect sentiment classification models. Among them, the LCF-BERT-CDM model achieves the best performance, with a Macro-F1 score of 82.65%. Subsequent statistical analysis reveals a consistent trend: as the number of review rounds increases, the proportion of positive sentiments rises, while negative sentiments decline. Correlation analysis further indicates that aspect sentiment scores are negatively associated with the total number of review rounds. Key aspects exhibiting stronger correlations include "experiments", "research significance" and "result analysis".

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 36 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

15 of 36 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  3. 2018A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applicationscited by 136
  4. 2017Interactive Attention Networks for Aspect-Level Sentiment Classificationcited by 91
  5. 2019On Extractive and Abstractive Neural Document Summarization with Transformer Language Modelscited by 83
  6. 2015Effective LSTMs for Target-Dependent Sentiment Classificationcited by 82
  7. 2016Aspect Level Sentiment Classification with Deep Memory Networkcited by 82
  8. 2021Can We Automate Scientific Reviewing?cited by 63
  9. 2021Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTacited by 41
  10. 2019Does My Rebuttal Matter? Insights from a Major NLP Conferencecited by 31
  11. 2018Aspect Level Sentiment Classification with Attention-over-Attention Neural Networkscited by 24
  12. 2020Aspect-based Sentiment Analysis of Scientific Reviewscited by 24
3 more
  1. 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
  2. 2022Which structure of academic articles do referees pay more attention to?: perspective of peer review and full-text of academic articlescited by 5
  3. 2026Which Review Aspect Has a Greater Impact on the Duration of Open Peer Review in Multiple Rounds? -- Evidence from Nature Communicationscited by 1

Built on by

Not cited yet.