SWIM: Student Writing Simulation via Proficiency-Conditioned Generation
Not on the map. Why?
Abstract (arXiv)
Writing proficiency manifests in how students develop content, organize ideas, choose words, and use language. Despite growing interest in LLM-based student simulation, whether LLMs can reproduce such multidimensional variation in extended writing remains largely unexplored. In this work, we explore if language models can realistically simulate student writing, and introduce SWIM, a task that formulates Student Writing sIMulation as proficiency-conditioned essay generation. We evaluate prompting, supervised fine-tuning (SFT), and reinforcement learning (RL) methods for writing simulation using automated essay scoring as a measure of profile alignment. Extensive experiments reveal that prompting provides limited proficiency control, even for strong proprietary LLMs with rubric-grounded strategies. In particular, while models can adjust content-oriented traits, they struggle to reproduce the lexical, grammatical, and organizational variation in different proficiency levels. SFT substantially improves alignment, while RL with the proposed proficiency-alignment reward yields further gains across all writing traits and essay prompts. Our findings suggest that explicit supervision enables substantially stronger profile alignment than prompting alone, while authentic low-proficiency writing remains challenging to reproduce.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 45 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
19 of 45 references.
References · 19
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023A Long Way to Go: Investigating Length Correlations in RLHFcited by 285
- 2023Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarizationcited by 69
- 2024Generative Students: Using LLM-Simulated Student Profiles to Support Question Item Evaluationcited by 56
- 2022On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representationcited by 46
- 2024Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoringcited by 33
- 2024Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMscited by 22
- 2025SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty Predictioncited by 21
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
7 more
- 2023Leveraging generative artificial intelligence to simulate student learning behaviorcited by 16
- 2024Reinforcement Learning with Token-level Feedback for Controllable Text Generationcited by 16
- 2024Can LLMs Reliably Simulate Human Learner Actions? A Simulation Authoring Framework for Open-Ended Learning Environmentscited by 16
- 2022MACSum: Controllable Summarization with Mixed Attributescited by 13
- 2024Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewardscited by 11
- 2024Standardize: Aligning Language Models with Expert-Defined Standards for Content Generationcited by 7
- 2025Teach-to-Reason with Scoring: Self-Explainable Rationale-Driven Multi-Trait Essay Scoringcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.