"Act Like a 5th Grader" is Not Enough: Bounding Knowledge in LLM-Based User Simulators
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used to simulate human behavior but frequently fail to exhibit realistic cognitive constraints, suffering from a "superhuman bias." Using a dataset of over 71,000 reading comprehension responses from 2,359 primary-school students (grades 4--6), we demonstrate that standard persona prompting yields near-perfect, deterministic performance, failing to capture the natural variance of developing readers. To address this, we introduce the Cognitively Bounded User Simulator (CBUS), an architectural framework that explicitly models the restricted working memory of young readers through an episodic bottleneck. Within this framework, we formalize two distinct test-taking strategies to emulate different reading behaviors. Our evaluation shows that explicitly modeling cognitive bounds significantly narrows the simulation gap across multiple LLM backbones, demonstrating that enforcing architectural constraints is more effective for high-fidelity simulation than simply scaling raw model capabilities.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
21 of 42 references.
References · 21
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
- 2024Generative Students: Using LLM-Simulated Student Profiles to Support Question Item Evaluationcited by 58
- 2025Flipping the Dialogue: Training and Evaluating User Language Modelscited by 58
- 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 54
- 2024Evaluating Large Language Models as Generative User Simulators for Conversational Recommendationcited by 48
- 2024EduAgent: Generative Student Agents in Learningcited by 42
- 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 41
- 2026Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluationscited by 40
- 2025Finetuning LLMs for Human Behavior Prediction in Social Science Experimentscited by 39
- 2026HumanLM: Simulating Users with State Alignment Beats Response Imitationcited by 37
9 more
- 2023User Simulation for Evaluating Information Access Systemscited by 31
- 2023An In-depth Investigation of User Response Simulation for Conversational Searchcited by 20
- 2023In-Context Learning User Simulators for Task-Oriented Dialog Systemscited by 19
- 2025Non-Collaborative User Simulators for Tool Agentscited by 18
- 2023Generating and Evaluating Tests for K-12 Students with Language Model Simulations: A Case Study on Sentence Reading Efficiencycited by 16
- 2024LLM-based Cognitive Models of Students with Misconceptionscited by 16
- 2025Consistent Client Simulation for Motivational Interviewing-based Counselingcited by 14
- 2026ConvApparel: A Benchmark Dataset and Validation Framework for User Simulators in Conversational Recommenderscited by 12
- 2024Multi-trait User Simulation with Adaptive Decoding for Conversational Task Assistantscited by 5
Built on by
Not cited yet.