The NCTE Transcripts: A Dataset of Elementary Math Classroom Transcripts
Not on the map. Why?
Abstract (arXiv)
Classroom discourse is a core medium of instruction - analyzing it can provide a window into teaching and learning as well as driving the development of new tools for improving instruction. We introduce the largest dataset of mathematics classroom transcripts available to researchers, and demonstrate how this data can help improve instruction. The dataset consists of 1,660 45-60 minute long 4th and 5th grade elementary mathematics observations collected by the National Center for Teacher Effectiveness (NCTE) between 2010-2013. The anonymized transcripts represent data from 317 teachers across 4 school districts that serve largely historically marginalized students. The transcripts come with rich metadata, including turn-level annotations for dialogic discourse moves, classroom observation scores, demographic information, survey responses and student test scores. We demonstrate that our natural language processing model, trained on our turn-level annotations, can learn to identify dialogic discourse moves and these moves are correlated with better classroom observation scores and learning outcomes. This dataset opens up several possibilities for researchers, educators and policymakers to learn about and improve K-12 instruction. The dataset can be found at https://github.com/ddemszky/classroom-transcript-analysis.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 7 of its 45 references that are in the map. First posted on arXiv 21 Nov 2022.
Builds on
7 of 45 references.
References · 7
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2021Measuring Conversational Uptake: A Case Study on Student-Teacher Interactionscited by 44
- 2022The TalkMoves Dataset: K-12 Mathematics Lesson Transcripts Annotated for Teacher and Student Discursive Movescited by 38
- 2022Computationally Identifying Funneling and Focusing Questions in Classroom Discoursecited by 15
- 2021Beyond "Fairness:" Structural (In)justice Lenses on AI for Educationcited by 12
Built on by
Citing papers per year: 2023: 3; 2024: 14; 2025: 14; 2026: 12.
43 papers.
Sort:
By area:
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 128
- 2025MathTutorBench: A Benchmark for Measuring Open-ended Pedagogical Capabilities of LLM Tutorscited by 47
- 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 44
- 2023Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instructioncited by 37
- 2024Book2Dial: Generating Teacher-Student Interactions from Textbooks for Cost-Effective Development of Educational Chatbotscited by 25
- 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutorscited by 17
- 2024Boosting Large Language Models with Socratic Method for Conversational Mathematics Teachingcited by 14
- 2024Edu-ConvoKit: An Open-Source Library for Education Conversation Datacited by 11
- 2024Personality-aware Student Simulation for Conversational Intelligent Tutoring Systemscited by 11
- 2024Instruct, Not Assist: LLM-based Multi-Turn Planning and Hierarchical Questioning for Socratic Code Debuggingcited by 11
- 2024The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Educationcited by 9
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environmentscited by 7
31 more
- 2025The StudyChat Dataset: Analyzing Student Dialogues With ChatGPT in an Artificial Intelligence Coursecited by 7
- 2025Opportunities and Challenges of LLMs in Education: An NLP Perspectivecited by 6
- 2024Developing a Tutoring Dialog Dataset to Optimize LLMs for Educational Usecited by 5
- 2024Continued Pretraining for Domain Adaptation of Wav2vec2.0 in Automatic Speech Recognition for Elementary Math Classroom Settingscited by 4
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systemscited by 4
- 2025SEFL: A Framework for Generating Synthetic Educational Assignment Feedback with LLM Agentscited by 3
- 2025Exploring LLMs for Predicting Tutor Strategy and Student Outcomes in Dialoguescited by 3
- 2023"Mistakes Help Us Grow": Facilitating and Evaluating Growth Mindset Supportive Language in Classroomscited by 2
- 2025Towards Actionable Pedagogical Feedback: A Multi-Perspective Analysis of Mathematics Teaching and Tutoring Dialoguecited by 2
- 2025SingaKids: A Multilingual Multimodal Dialogic Tutor for Language Learningcited by 2
- 2026Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impactcited by 2
- 2026HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agentscited by 2
- 2024SpMis: An Investigation of Synthetic Spoken Misinformation Detectioncited by 1
- 2024Enhancing Talk Moves Analysis in Mathematics Tutoring through Classroom Teaching Discoursecited by 1
- 2025SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Researchcited by 1
- 2025Exploring Automated Recognition of Instructional Activity and Discourse from Multimodal Classroom Datacited by 1
- 2026ConvoLearn: A Learning Sciences Grounded Dataset for Fine-Tuning Dialogic AI Tutorscited by 1
- 2024Project MOSLA: Recording Every Moment of Second Language Acquisitioncited by 0
- 2024Towards an optimised evaluation of teachers' discourse: The case of engaging messagescited by 0
- 2025From Weak Labels to Strong Results: Utilizing 5,000 Hours of Noisy Classroom Transcripts with Minimal Accurate Datacited by 0
- 2025EduCoder: An Open-Source Annotation System for Education Transcript Datacited by 0
- 2025RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Enginescited by 0
- 2026When AI Meets Early Childhood Education: Large Language Models as Assessment Teammates in Chinese Preschoolscited by 0
- 2026Mitigating LLM biases toward spurious social contexts using direct preference optimizationcited by 0
- 2026TeachObs: A Human-Validated Benchmark for Multimodal Teaching Observation and Model Evaluationcited by 0
- 2026Conditional Hypothesis Generation for LLM-Based Text Analysis with Researcher-Specified Covariatescited by 0
- 2026From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessmentcited by 0
- 2026GeoDial: A Multimodal Conversational Tutoring Dataset for Geometry Problem-Solving with Visual Tutor Turnscited by 0
- 2026PeerMathDial: A Middle School Dialogue Dataset for Student Collaborative Math Problem Solvingcited by 0
- 2026When Youth Enter The Chat: An Epistemic Shift in the Validation of LLM-Based Measures of Student Talkcited by 0
- 2026EduBehaviors: Assertion-based Schemas for Auditable Coding of Educational Dialoguescited by 0
- 2026EduBehaviors: Assertion-based Schemas for Auditable Coding of Educational Dialogues22 Sep 2026
- 2026When Youth Enter The Chat: An Epistemic Shift in the Validation of LLM-Based Measures of Student Talk24 Aug 2026
- 2026PeerMathDial: A Middle School Dialogue Dataset for Student Collaborative Math Problem Solving19 Jun 2026
- 2026Conditional Hypothesis Generation for LLM-Based Text Analysis with Researcher-Specified Covariates2 Jun 2026
- 2026TeachObs: A Human-Validated Benchmark for Multimodal Teaching Observation and Model Evaluation29 May 2026
- 2026GeoDial: A Multimodal Conversational Tutoring Dataset for Geometry Problem-Solving with Visual Tutor Turns8 May 2026
- 2026From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment18 Apr 2026
- 2026Mitigating LLM biases toward spurious social contexts using direct preference optimization2 Apr 2026
- 2026When AI Meets Early Childhood Education: Large Language Models as Assessment Teammates in Chinese Preschools25 Mar 2026
- 2026HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agents5 Mar 2026
- 2026Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impact1 Mar 2026
- 2026ConvoLearn: A Learning Sciences Grounded Dataset for Fine-Tuning Dialogic AI Tutors13 Jan 2026
31 more
- 2025Exploring Automated Recognition of Instructional Activity and Discourse from Multimodal Classroom Data26 Nov 2025
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systems26 Oct 2025
- 2025RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Engines1 Oct 2025
- 2025Opportunities and Challenges of LLMs in Education: An NLP Perspective30 Jul 2025
- 2025Exploring LLMs for Predicting Tutor Strategy and Student Outcomes in Dialogues9 Jul 2025
- 2025EduCoder: An Open-Source Annotation System for Education Transcript Data7 Jul 2025
- 2025SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Research10 Jun 2025
- 2025SingaKids: A Multilingual Multimodal Dialogic Tutor for Language Learning3 Jun 2025
- 2025From Weak Labels to Strong Results: Utilizing 5,000 Hours of Noisy Classroom Transcripts with Minimal Accurate Data20 May 2025
- 2025Towards Actionable Pedagogical Feedback: A Multi-Perspective Analysis of Mathematics Teaching and Tutoring Dialogue12 May 2025
- 2025The StudyChat Dataset: Analyzing Student Dialogues With ChatGPT in an Artificial Intelligence Course11 Mar 2025
- 2025MathTutorBench: A Benchmark for Measuring Open-ended Pedagogical Capabilities of LLM Tutors26 Feb 2025
- 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors18 Feb 2025
- 2025SEFL: A Framework for Generating Synthetic Educational Assignment Feedback with LLM Agents18 Feb 2025
- 2024Towards an optimised evaluation of teachers' discourse: The case of engaging messages18 Dec 2024
- 2024Enhancing Talk Moves Analysis in Mathematics Tutoring through Classroom Teaching Discourse18 Dec 2024
- 2024Developing a Tutoring Dialog Dataset to Optimize LLMs for Educational Use25 Oct 2024
- 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs24 Sep 2024
- 2024SpMis: An Investigation of Synthetic Spoken Misinformation Detection17 Sep 2024
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environments13 Sep 2024
- 2024Boosting Large Language Models with Socratic Method for Conversational Mathematics Teaching24 Jul 2024
- 2024Instruct, Not Assist: LLM-based Multi-Turn Planning and Hierarchical Questioning for Socratic Code Debugging17 Jun 2024
- 2024Continued Pretraining for Domain Adaptation of Wav2vec2.0 in Automatic Speech Recognition for Elementary Math Classroom Settings15 May 2024
- 2024Personality-aware Student Simulation for Conversational Intelligent Tutoring Systems10 Apr 2024
- 2024The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Education3 Apr 2024
- 2024Project MOSLA: Recording Every Moment of Second Language Acquisition26 Mar 2024
- 2024Book2Dial: Generating Teacher-Student Interactions from Textbooks for Cost-Effective Development of Educational Chatbots5 Mar 2024
- 2024Edu-ConvoKit: An Open-Source Library for Education Conversation Data7 Feb 2024
- 2023"Mistakes Help Us Grow": Facilitating and Evaluating Growth Mindset Supportive Language in Classrooms16 Oct 2023
- 2023Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction5 Jun 2023
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems23 May 2023
- 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutorscited by 17
- 2025SEFL: A Framework for Generating Synthetic Educational Assignment Feedback with LLM Agentscited by 3
- 2026HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agentscited by 2
- 2026HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agents5 Mar 2026
- 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors18 Feb 2025
- 2025SEFL: A Framework for Generating Synthetic Educational Assignment Feedback with LLM Agents18 Feb 2025
- 2025MathTutorBench: A Benchmark for Measuring Open-ended Pedagogical Capabilities of LLM Tutorscited by 47
- 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 44
- 2023Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instructioncited by 37
- 2024Book2Dial: Generating Teacher-Student Interactions from Textbooks for Cost-Effective Development of Educational Chatbotscited by 25
- 2024Edu-ConvoKit: An Open-Source Library for Education Conversation Datacited by 11
- 2024Personality-aware Student Simulation for Conversational Intelligent Tutoring Systemscited by 11
- 2024Instruct, Not Assist: LLM-based Multi-Turn Planning and Hierarchical Questioning for Socratic Code Debuggingcited by 11
- 2024The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Educationcited by 9
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environmentscited by 7
- 2025The StudyChat Dataset: Analyzing Student Dialogues With ChatGPT in an Artificial Intelligence Coursecited by 7
- 2025Opportunities and Challenges of LLMs in Education: An NLP Perspectivecited by 6
- 2024Developing a Tutoring Dialog Dataset to Optimize LLMs for Educational Usecited by 5
12 most cited of 36 All 36 (JSON)
- 2026EduBehaviors: Assertion-based Schemas for Auditable Coding of Educational Dialogues22 Sep 2026
- 2026When Youth Enter The Chat: An Epistemic Shift in the Validation of LLM-Based Measures of Student Talk24 Aug 2026
- 2026PeerMathDial: A Middle School Dialogue Dataset for Student Collaborative Math Problem Solving19 Jun 2026
- 2026Conditional Hypothesis Generation for LLM-Based Text Analysis with Researcher-Specified Covariates2 Jun 2026
- 2026TeachObs: A Human-Validated Benchmark for Multimodal Teaching Observation and Model Evaluation29 May 2026
- 2026GeoDial: A Multimodal Conversational Tutoring Dataset for Geometry Problem-Solving with Visual Tutor Turns8 May 2026
- 2026From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment18 Apr 2026
- 2026When AI Meets Early Childhood Education: Large Language Models as Assessment Teammates in Chinese Preschools25 Mar 2026
- 2026Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impact1 Mar 2026
- 2026ConvoLearn: A Learning Sciences Grounded Dataset for Fine-Tuning Dialogic AI Tutors13 Jan 2026
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systems26 Oct 2025
- 2025RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Engines1 Oct 2025
12 newest of 36 All 36 (JSON)