mlsanityData to 7 Oct 2026

Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge

arXiv 2603.20214 ↗First posted 2 Mar 2026cs.CY cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative AI tools are increasingly entering academic peer review workflows, raising questions about fairness, accountability, and the legitimacy of evaluative judgment. While these systems promise efficiency gains amid growing reviewer overload, their use introduces new sociotechnical risks. This paper presents a convergent mixed-method study combining discourse analysis of 448 social media posts with interviews with 14 area chairs and program chairs from leading AI and HCI conferences to examine how GenAI is discussed and experienced in peer review. Across both datasets, we find broad agreement that GenAI may be acceptable for limited supportive tasks, such as improving clarity or structuring feedback, but that core evaluative judgments, assessing novelty, contribution, and acceptance, should remain human responsibilities. At the same time, participants highlight concerns about epistemic harm, over-standardization, unclear responsibility, and adversarial risks such as prompt injection. User interviews reveal how structural strain and institutional policy ambiguity shift interpretive and enforcement burdens onto individual scholars, disproportionately affecting junior authors and reviewers. By triangulating public governance discourse with lived review practices, this work reframes AI mediated peer review as a sociotechnical governance challenge and offers recommendations for preserving accountability, trust, and meaningful human oversight. Overall, we argue that AI-assisted peer review is best governed not by blanket bans or detection alone, but by explicitly reserving evaluative judgment for humans while instituting enforceable, role-specific controls that preserve accountability. We conclude with role specific recommendations that formalize the support judgment boundary.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 88 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

22 of 88 references.

References · 22

  1. 2021The Values Encoded in Machine Learning Researchcited by 172
  2. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
  3. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 142
  4. 2024The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance Ratescited by 66
  5. 2024OpenReviewer: A Specialized Large Language Model for Generating Critical Scientific Paper Reviewscited by 63
  6. 2024LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewingcited by 62
  7. 2025Large language models for automated scholarly paper review: A surveycited by 59
  8. 2020ReviewRobot: Explainable Paper Review Generation based on Knowledge Synthesiscited by 53
  9. 2024Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactionscited by 43
  10. 2023GPT4 is Slightly Helpful for Peer-Review Assistance: A Pilot Studycited by 40
  11. 2025Can LLM feedback enhance review quality? A randomized study of 20K reviews at ICLR 2025cited by 40
  12. 2025ReviewAgents: Bridging the Gap Between Human and AI-Generated Paper Reviewscited by 28
10 more
  1. 2024Is Your Paper Being Reviewed by an LLM? Investigating AI Text Detectability in Peer Reviewcited by 19
  2. 2025ReviewRL: Towards Automated Scientific Review with RLcited by 17
  3. 2024Generative Adversarial Reviews: When LLMs Become the Criticcited by 12
  4. 2022Automatic Analysis of Available Source Code of Top Artificial Intelligence Conference Paperscited by 9
  5. 2024PeerArg: Argumentative Peer Review with LLMscited by 9
  6. 2024Catalyzing Equity in STEM Teams: Harnessing Generative AI for Inclusion and Diversitycited by 6
  7. 2024A Randomized Controlled Trial on Anonymizing Reviewers to Each Other in Peer Review Discussionscited by 6
  8. 2024In which fields can ChatGPT detect journal article quality? An evaluation of REF2021 resultscited by 5
  9. 2025Reviewriter: AI-Generated Instructions For Peer Review Writingcited by 3
  10. 2025Social Scientists on the Role of AI in Researchcited by 1

Built on by

Not cited yet.