mlsanityData to 14 Oct 2026

Human-AI Collaboration in Science at Scale: A Global Large-scale Randomized Field Experiment

arXiv 2605.24180 ↗First posted 22 May 2026physics.soc-ph cs.AI cs.DLcited by 0

Not on the map. Why?

Abstract (arXiv)

Collaboration is the defining mode of modern science, yet its core mechanism -- feedback -- remains hard to observe, difficult to scale, and unequally distributed. Here we test whether large language models (LLMs) can contribute to this hidden but vital practice and reallocate scientific feedback, an essential yet scarce resource for knowledge production. In a global large-scale randomized field experiment, we delivered customized LLM-generated feedback for over 31,000 arXiv preprints across 150 fields and more than 45,000 researchers from 133 geographic regions. Relative to controls, authors who received feedback had a significantly higher likelihood of revising their manuscripts, corresponding to a 12.55% relative increase over the baseline revision rate. Exposure to AI feedback also increased authors' subsequent use of LLM tools in their future papers, suggesting longer-run shifts in scientific practice. These effects were strongest among authors from non-English-dominant research regions, manuscripts less embedded in the scholarly literature, and teams with lower h-indexes and earlier career stages, consistent with the idea that AI feedback may provide the greatest benefit where access to timely critique is otherwise limited. Together, these findings provide causal evidence that structured AI-based interventions can transform access to scientific feedback from a largely private advantage into a more widely distributed resource, with broader implications for productivity, equity, and capacity across the global research system.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 47 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

13 of 47 references.

References · 13

  1. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
  2. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
  3. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
  4. 2023GPT detectors are biased against non-native English writerscited by 178
  5. 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
  6. 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 106
  7. 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
  8. 2026Scientific production in the era of Large Language Modelscited by 32
  9. 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Sciencecited by 27
  10. 2025Who is using AI to code? Global diffusion and impact of generative AIcited by 18
  11. 2019Historical comparison of gender inequality in scientific careers across countries and disciplinescited by 14
  12. 2024Where there's a will there's a way: ChatGPT is used more for science in countries where it is prohibitedcited by 6
1 more
  1. 2025Peer Review and the Diffusion of Ideascited by 1

Built on by

Not cited yet.