ConvoLearn: A Learning Sciences Grounded Dataset for Fine-Tuning Dialogic AI Tutors
Not on the map. Why?
Abstract (arXiv)
Despite their growing adoption in education, LLMs remain misaligned with the core principle of effective tutoring: the dialogic construction of knowledge. We introduce ConvoLearn, a dataset of 2,134 semi-synthetic tutor-student dialogues operationalizing six dimensions of dialogic tutoring grounded in knowledge-building theory, situated in a middle school Earth Science curriculum. We show that dimension-labeled dialogic training data captures meaningful pedagogical signal that generalizes beyond its semi-synthetic domain: scores from a classifier trained on ConvoLearn correlate significantly with expert-coded instructional quality in authentic classrooms across multiple subscales. As a proof of concept, we fine-tune Mistral-7B on ConvoLearn and show that dimension-level fine-tuning can steer a 7B open-weight model toward dialogic tutoring behavior that credentialed teachers rate as competitive with a strong proprietary baseline. With this work, we support the development of AI tutors capable of more dialogic interactions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 47 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
11 of 47 references.
References · 11
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017Mixed Precision Trainingcited by 1,135
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 128
- 2022The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialoguescited by 78
- 2024Unifying AI Tutor Evaluation: An Evaluation Taxonomy for Pedagogical Ability Assessment of LLM-Powered AI Tutorscited by 60
- 2024Towards Responsible Development of Generative AI for Education: An Evaluation-Driven Approachcited by 53
- 2022The NCTE Transcripts: A Dataset of Elementary Math Classroom Transcriptscited by 43
- 2023Opportunities and Challenges in Neural Dialog Tutoringcited by 33
- 2024Enhancing Critical Thinking in Education by means of a Socratic Chatbotcited by 21
- 2025Findings of the BEA 2025 Shared Task on Pedagogical Ability Assessment of AI-powered Tutorscited by 16
Built on by
Citing papers per year: 2026: 1.
1 paper.