ScholaWrite: A Dataset of End-to-End Scholarly Writing Process
Not on the map. Why?
Abstract (arXiv)
Writing is a cognitively demanding activity that requires constant decision-making, heavy reliance on working memory, and frequent shifts between tasks of different goals. To build writing assistants that truly align with writers' cognition, we must capture and decode the complete thought process behind how writers transform ideas into final texts. We present ScholaWrite, the first dataset of end-to-end scholarly writing, tracing the multi-month journey from initial drafts to final manuscripts. We contribute three key advances: (1) a Chrome extension that unobtrusively records keystrokes on Overleaf, enabling the collection of realistic, in-situ writing data; (2) a novel corpus of full scholarly manuscripts, enriched with fine-grained annotations of cognitive writing intentions. The dataset includes LaTeX-based edits from five computer science preprints, capturing nearly 62K text changes over four months; and (3) analyses and insights into the micro-dynamics of scholarly writing, highlighting gaps between human writing processes and the current capabilities of large language models (LLMs) in providing meaningful assistance. ScholaWrite underscores the value of capturing end-to-end writing data to develop future writing assistants that support, not replace, the cognitive work of scientists.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 22 of its 69 references that are in the map. First posted on arXiv 5 Feb 2025.
Builds on
22 of 69 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
- 2022Understanding Iterative Revision from Human-Written Textcited by 57
- 2022Read, Revise, Repeat: A System Demonstration for Human-in-the-loop Iterative Text Revisioncited by 46
- 2024Latxa: An Open Language Model and Evaluation Suite for Basquecited by 42
- 2022Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Reviewcited by 37
10 more
- 2023ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviewscited by 34
- 2023Open, Closed, or Small Language Models for Text Classification?cited by 34
- 2022arXivEdits: Understanding the Human Revision Process in Scientific Writingcited by 26
- 2022Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyondcited by 20
- 2022Improving Iterative Text Revision by Learning Where to Edit from Other Revision Taskscited by 20
- 2019Diamonds in the Rough: Generating Fluent Sentences from Early-Stage Drafts for Academic Writing Assistancecited by 16
- 2024CASIMIR: A Corpus of Scientific Articles enhanced with Multiple Author-Integrated Revisionscited by 14
- 2023Text revision in Scientific Writing Assistance: An Overviewcited by 5
- 2023Decoding the End-to-end Writing Trajectory in Scholarly Manuscriptscited by 3
- 2024Assessing Generative Language Models in Classification Tasks: Performance and Self-Evaluation Capabilities in the Environmental and Climate Change Domaincited by 3
Built on by
Citing papers per year: 2025: 5; 2026: 4.
9 papers.
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
- 2025How Problematic Writer-AI Interactions (Rather than Problematic AI) Hinder Writers' Idea Generationcited by 2
- 2025LawFlow: Collecting and Simulating Lawyers' Thought Processes on Business Formation Case Studiescited by 2
- 2026Improving Attributed Long-form Question Answering with Intent Awarenesscited by 2
- 2025Stealing Creator's Workflow: A Creator-Inspired Agentic Framework with Iterative Feedback Loop for Improved Scientific Short-form Generationcited by 1
- 2026Detecting Cognitive Signatures in Typing Behavior for Non-Intrusive Authorship Verificationcited by 1
- 2025"I Wrote, I Paused, I Rewrote" Teaching LLMs to Read Between the Lines of Student Writingcited by 0
- 2026ExPerT: Personalizing LLM Responses to Users' Domain Expertise via Query-Wise Semantic and Keystroke Behavioral Cuescited by 0
- 2026Learning Scientific Exploration from Human Research Decision Trajectoriescited by 0
- 2026Learning Scientific Exploration from Human Research Decision Trajectories5 Oct 2026
- 2026ExPerT: Personalizing LLM Responses to Users' Domain Expertise via Query-Wise Semantic and Keystroke Behavioral Cues4 May 2026
- 2026Improving Attributed Long-form Question Answering with Intent Awareness28 Mar 2026
- 2026Detecting Cognitive Signatures in Typing Behavior for Non-Intrusive Authorship Verification26 Feb 2026
- 2025"I Wrote, I Paused, I Rewrote" Teaching LLMs to Read Between the Lines of Student Writing9 Jun 2025
- 2025LawFlow: Collecting and Simulating Lawyers' Thought Processes on Business Formation Case Studies26 Apr 2025
- 2025Stealing Creator's Workflow: A Creator-Inspired Agentic Framework with Iterative Feedback Loop for Improved Scientific Short-form Generation26 Apr 2025
- 2025How Problematic Writer-AI Interactions (Rather than Problematic AI) Hinder Writers' Idea Generation14 Mar 2025
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems3 Mar 2025