# GPT-4 as a Homework Tutor can Improve Student Engagement and Learning Outcomes

arXiv: https://arxiv.org/abs/2409.15981 · HTML: https://mlsanity.com/paper/2409.15981/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Sep 2024.

## Built on by (most cited first, 9 of 9)

- [TutorBench: A Benchmark To Assess Tutoring Capabilities Of Large Language Models](https://mlsanity.com/paper/2510.02663/) (2025)
- [A Meta-Analysis of LLM Effects on Students across Qualification, Socialisation, and Subjectification](https://mlsanity.com/paper/2509.22725/) (2025)
- [Small, Private Language Models as Teammates for Educational Assessment Design](https://mlsanity.com/paper/2605.15015/) (2026)
- [Superstudent intelligence in thermodynamics](https://mlsanity.com/paper/2506.09822/) (2025)
- [Latency and Cost of Multi-Agent Intelligent Tutoring at Scale](https://mlsanity.com/paper/2604.24110/) (2026)
- [ITAS: A Multi-Agent Architecture for LLM-Based Intelligent Tutoring](https://mlsanity.com/paper/2604.24808/) (2026)
- [Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks](https://mlsanity.com/paper/2605.14604/) (2026)
- [Reflective Dialogue or Prompt Refinement? Effects of Tutor Scaffolding on Students' Independent LLM Use for Programming](https://mlsanity.com/paper/2607.03303/) (2026)
- [ConnectED: A Curriculum-Aligned AI System for Vietnamese Instructional Lesson Planning and Student Learning](https://mlsanity.com/paper/2607.28647/) (2026)

## Abstract (arXiv)

This work contributes to the scarce empirical literature on LLM-based interactive homework in real-world educational settings and offers a practical, scalable solution for improving homework in schools. Homework is an important part of education in schools across the world, but in order to maximize benefit, it needs to be accompanied with feedback and followup questions. We developed a prompting strategy that enables GPT-4 to conduct interactive homework sessions for high-school students learning English as a second language. Our strategy requires minimal efforts in content preparation, one of the key challenges of alternatives like home tutors or ITSs. We carried out a Randomized Controlled Trial (RCT) in four high-school classes, replacing traditional homework with GPT-4 homework sessions for the treatment group. We observed significant improvements in learning outcomes, specifically a greater gain in grammar, and student engagement. In addition, students reported high levels of satisfaction with the system and wanted to continue using it after the end of the RCT.