EduPersona: Benchmarking Subjective Ability Boundaries of Virtual Student Agents
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
As large language models are increasingly integrated into education, virtual student agents are becoming vital for classroom simulation and teacher training. Yet their classroom-oriented subjective abilities remain largely unassessed, limiting understanding of model boundaries and hindering trustworthy deployment. We present EduPersona, a large-scale benchmark spanning two languages, three subjects, and ten persona types based on the Big Five theory. The dataset contains 1,308 authentic classroom dialogue rounds, corresponding to 12,814 teacher-student Q&A turns, and is further expanded through persona stylization into roughly 10 times larger scale (128k turns), providing a solid foundation for evaluation. Building on this resource, we decompose hard-to-quantify subjective performance into three progressive tasks: TASK1 basic coherence (whether behavior, emotion, expression, and voice align with classroom context), TASK2 student realism, and TASK3 long-term persona consistency, thereby establishing an evaluation framework grounded in educational theory and research value. We conduct systematic experiments on three representative LLMs, comparing their original versions with ten persona-fine-tuned variants trained on EduPersona. Results show consistent and significant average improvements across all tasks: TASK1 +33.6%, TASK2 +30.6%, and TASK3 +14.9%. These improvements highlight the dataset's effectiveness and research value, while also revealing the heterogeneous difficulty of persona modeling. In summary, EduPersona delivers the first classroom benchmark centered on subjective abilities, establishes a decoupled and verifiable research paradigm, and we will open-source both the dataset and the framework to support the broader research community in advancing trustworthy and human-like AI for education.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 14 of its 29 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
14 of 29 references.
Closest ancestors · 2
Same direction, newest first
- 2025Investigating Pedagogical Teacher and Student LLM Agents: Genetic Adaptation Meets Retrieval Augmented Generation Across Learning Style25 May
- 2024When LLMs Learn to be Students: The SOEI Framework for Modeling and Evaluating Virtual Student Agents in Educational Interaction21 Oct
Other references · 12
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2024Large Language Models for Education: A Survey and Outlookcited by 185
- 2019Personalized Dialogue Generation with Diversified Traitscited by 73
- 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agents
- 2024The Effects of Embodiment and Personality Expression on Learning in LLM-based Educational Agents
- 2024EduAgent: Generative Student Agents in Learning
- 2025Simulating Students with Large Language Models: A Review of Architecture, Mechanisms, and Role Modelling in Education with Generative AI
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation
- 2025Conversational Education at Scale: A Multi-LLM Agent Workflow for Procedural Learning and Pedagogic Quality Assessment
- 2026Personality-Driven Student Agent-Based Modeling in Mathematics Education: How Well Do Student Agents Align with Human Learners?
- 2026INSIDE the Student's Mind: Jointly Modeling Latent Reasoning and Action in LLM Student Simulators