mlsanityData to 7 Oct 2026

Bridging Social Psychology and LLM Reasoning: Conflict-Aware Meta-Review Generation via Cognitive Alignment

arXiv 2503.13879 ↗First posted 18 Mar 2025cs.AIcited by 2

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

The rapid growth of scholarly submissions has overwhelmed traditional peer review systems, driving the need for intelligent automation to preserve scientific rigor. While large language models (LLMs) show promise in automating manuscript critiques, their ability to synthesize high-stakes meta-reviews, which require conflict-aware reasoning and consensus derivation, remains underdeveloped. Existing methods fail to effectively handle conflicting viewpoints within differing opinions, and often introduce additional cognitive biases, such as anchoring effects and conformity bias.To overcome these limitations, we propose the Cognitive Alignment Framework (CAF), a dual-process architecture that transforms LLMs into adaptive scientific arbitrators. By operationalizing Kahneman's dual-process theory, CAF introduces a three-step cognitive pipeline: review initialization, incremental integration, and cognitive alignment.Empirical validation shows that CAF outperforms existing LLM-based methods, with sentiment consistency gains reaching up to 19.47% and content consistency improving by as much as 12.95%.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 39 references that are in the map. First posted on arXiv 18 Mar 2025.

Builds on

19 of 39 references.

References · 19

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  5. 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 244
  6. 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 118
  7. 2017The Consciousness Priorcited by 105
  8. 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 92
  9. 2024AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviewscited by 42
  10. 2024Planning Like Human: A Dual-process Framework for Dialogue Planningcited by 32
  11. 2023Summarizing Multiple Documents with Conversational Structure for Meta-Review Generationcited by 27
  12. 2024Is Your Paper Being Reviewed by an LLM? Investigating AI Text Detectability in Peer Reviewcited by 19
7 more
  1. 2024LLMs as Meta-Reviewers' Assistants: A Case Studycited by 15
  2. 2019Deep Reasoning Networks: Thinking Fast and Slowcited by 12
  3. 2017Thinking, Fast and Slow: Combining Vector Spaces and Knowledge Graphscited by 10
  4. 2022A Neural-Symbolic Approach to Natural Language Understandingcited by 8
  5. 2023AcademicGPT: Empowering Academic Researchcited by 6
  6. 2024Let's Be Self-generated via Step by Step: A Curriculum Learning Approach to Automated Reasoning with Large Language Modelscited by 4
  7. 2024SEAGraph: Unveiling the Whole Story of Paper Review Commentscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025MMReview: A Multidisciplinary and Multimodal Benchmark for LLM-Based Peer Review Automation
  2. 2026LLM-Based Scientific Peer Review: Methods, Benchmarks, and Reliability Challenges
  3. 2025From Replication to Redesign: Exploring Pairwise Comparisons for LLM-Based Peer Review
  4. 2025ReviewAgents: Bridging the Gap Between Human and AI-Generated Paper Reviews
  5. 2026PeerCheck: Enhancing LLM-Generated Academic Reviews Towards Human-Level Quality
  6. 2025Beyond "Not Novel Enough": Enriching Scholarly Critique with LLM-Assisted Feedback
  7. 2026ReviewGuard: Aligning LLM-Assisted Peer Review with Long-Term Scientific Impact
  8. 2025Aspect-Guided Multi-Level Perturbation Analysis of Large Language Models in Automated Peer Review