mlsanityData to 7 Oct 2026

What happens when reviewers receive AI feedback in their reviews?

arXiv 2602.13817 ↗First posted 14 Feb 2026cs.HC cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

AI is reshaping academic research, yet its role in peer review remains polarising and contentious. Advocates see its potential to reduce reviewer burden and improve quality, while critics warn of risks to fairness, accountability, and trust. At ICLR 2025, an official AI feedback tool was deployed to provide reviewers with post-review suggestions. We studied this deployment through surveys and interviews, investigating how reviewers engaged with the tool and perceived its usability and impact. Our findings surface both opportunities and tensions when AI augments in peer review. This work contributes the first empirical evidence of such an AI tool in a live review process, documenting how reviewers respond to AI-generated feedback in a high-stakes review context. We further offer design implications for AI-assisted reviewing that aim to enhance quality while safeguarding human expertise, agency, and responsibility.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 55 of its 118 references that are in the map. First posted on arXiv 14 Feb 2026.

Builds on

55 of 118 references.

References · 55

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
  3. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
  4. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
  5. 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
  6. 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 118
  7. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
  8. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  9. 2022Evaluating Human-Language Model Interactioncited by 90
  10. 2019Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AIcited by 79
  11. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  12. 2022Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writingcited by 71
38 more
  1. 2023LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysiscited by 70
  2. 2022Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writerscited by 69
  3. 2023LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Codingcited by 64
  4. 2021Can We Automate Scientific Reviewing?cited by 63
  5. 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
  6. 2020ReviewRobot: Explainable Paper Review Generation based on Knowledge Synthesiscited by 53
  7. 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
  8. 2025Can LLM feedback enhance review quality? A randomized study of 20K reviews at ICLR 2025cited by 40
  9. 2024The Value, Benefits, and Concerns of Generative AI-Powered Assistance in Writingcited by 37
  10. 2023Writer-Defined AI Personas for On-Demand Feedback Generationcited by 36
  11. 2021DISAPERE: A Dataset for Discourse Structure in Peer Review Discussionscited by 35
  12. 2025Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewardscited by 34
  13. 2018PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Reviewcited by 30
  14. 2019Paper Matching with Local Fairness Constraintscited by 30
  15. 2023How Knowledge Workers Think Generative AI Will (Not) Transform Their Industriescited by 29
  16. 2021Assessing the Impact of Automated Suggestions on Decision Making: Domain Experts Mediate Model Errors but Take Less Initiativecited by 28
  17. 2022Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writingcited by 27
  18. 2024What Can Natural Language Processing Do for Peer Review?cited by 24
  19. 2023The HaLLMark Effect: Supporting Provenance and Transparent Use of Large Language Models in Writing with Interactive Visualizationcited by 23
  20. 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
  21. 2023Automatic Analysis of Substantiation in Scientific Peer Reviewscited by 19
  22. 2025Detecting LLM-Generated Peer Reviewscited by 18
  23. 2020Gender Gap in Natural Language Processing Research: Disparities in Authorship and Citationscited by 17
  24. 2023The strain on scientific publishingcited by 17
  25. 2023ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Modelscited by 17
  26. 2023"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Modelscited by 15
  27. 2024Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experimentcited by 15
  28. 2023Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluationcited by 14
  29. 2024"I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practicescited by 14
  30. 2024"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Modelscited by 14
  31. 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
  32. 2024ReviewFlow: Intelligent Scaffolding to Support Academic Peer Reviewingcited by 12
  33. 2025Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Reviewcited by 12
  34. 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Makingcited by 9
  35. 2023Better by you, better than me, chatgpt3 as writing assistance in students essayscited by 8
  36. 2025How Scientists Use Large Language Models to Programcited by 8
  37. 2025ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemakingcited by 7
  38. 2024The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writingcited by 6

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1