# LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction

arXiv: https://arxiv.org/abs/2310.05191 · HTML: https://mlsanity.com/paper/2310.05191/

## Key facts

- Cited by 29 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 28 references that are in the map.
- First posted on arXiv 8 Oct 2023.

## Builds on (most cited first, 5 of 5)

- [Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena](https://mlsanity.com/paper/2306.05685/) (2023)
- [A Computational Approach to Politeness with Application to Social Factors](https://mlsanity.com/paper/1306.6078/) (2013)
- [Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs](https://mlsanity.com/paper/2305.11792/) (2023)
- [Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction](https://mlsanity.com/paper/2306.03090/) (2023)
- [RECIPE: How to Integrate ChatGPT into EFL Writing Education](https://mlsanity.com/paper/2305.11583/) (2023)

## Built on by (most cited first, 29 of 29)

- [Training LLM-based Tutors to Improve Student Learning Outcomes in Dialogues](https://mlsanity.com/paper/2503.06424/) (2025)
- [TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoring](https://mlsanity.com/paper/2505.14577/) (2025)
- [Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedback](https://mlsanity.com/paper/2507.16007/) (2025)
- [LLMs can Perform Multi-Dimensional Analytic Writing Assessments: A Case Study of L2 Graduate-Level Academic English Writing](https://mlsanity.com/paper/2502.11368/) (2025)
- [Multilingual Performance Biases of Large Language Models in Education](https://mlsanity.com/paper/2504.17720/) (2025)
- [Breaking Bad Tokens: Detoxification of LLMs Using Sparse Autoencoders](https://mlsanity.com/paper/2505.14536/) (2025)
- [Large Language Models for Security Operations Centers: A Comprehensive Survey](https://mlsanity.com/paper/2509.10858/) (2025)
- [RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education](https://mlsanity.com/paper/2403.08272/) (2024)
- [Position: LLMs Can be Good Tutors in English Education](https://mlsanity.com/paper/2502.05467/) (2025)
- [STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond](https://mlsanity.com/paper/2409.05367/) (2024)
- [Exploring the Potential of Large Multimodal Models as Effective Alternatives for Pronunciation Assessment](https://mlsanity.com/paper/2503.11229/) (2025)
- [When Models Know More Than They Can Explain: Quantifying Knowledge Transfer in Human-AI Collaboration](https://mlsanity.com/paper/2506.05579/) (2025)
- [Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theory](https://mlsanity.com/paper/2507.19980/) (2025)
- [Linguistics and Human Brain: A Perspective of Computational Neuroscience](https://mlsanity.com/paper/2602.08275/) (2026)
- [Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student Revisions](https://mlsanity.com/paper/2410.08058/) (2024)
- [Comparing human and LLM proofreading in L2 writing: Impact on lexical and syntactic features](https://mlsanity.com/paper/2506.09021/) (2025)
- [MAGIC: Multi-Agent Argumentation and Grammar Integrated Critiquer](https://mlsanity.com/paper/2506.13037/) (2025)
- [LLMs Do Not Grade Essays Like Humans](https://mlsanity.com/paper/2603.23714/) (2026)
- [Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biases](https://mlsanity.com/paper/2502.14507/) (2025)
- [Free Lunch for User Experience: Crowdsourcing Agents for Scalable User Studies](https://mlsanity.com/paper/2505.22981/) (2025)
- [Could Large Language Models work as Post-hoc Explainability Tools in Credit Risk Models?](https://mlsanity.com/paper/2602.18895/) (2026)
- [PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleaf](https://mlsanity.com/paper/2606.08857/) (2026)
- [DIY-MKG: An LLM-Based Polyglot Language Learning System](https://mlsanity.com/paper/2507.01872/) (2025)
- [Feed-O-Meter: Investigating AI-Generated Mentee Personas as Interactive Agents for Scaffolding Design Feedback Practice](https://mlsanity.com/paper/2509.07424/) (2025)
- [FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writing](https://mlsanity.com/paper/2511.22883/) (2025)
- [Never say never: Exploring the effects of available knowledge on agent persuasiveness in controlled physiotherapy motivation dialogues](https://mlsanity.com/paper/2602.12924/) (2026)
- [The Crutch or the Ceiling? How Different Generations of LLMs Shape EFL Student Writings](https://mlsanity.com/paper/2604.15460/) (2026)
- [From Texts to Scores: Tracing the Emergence of Essay Quality Representations in Large Language Models](https://mlsanity.com/paper/2606.20152/) (2026)
- [Do LLM Tutors Actually Teach? A Process-Centered Synthesis of the Tutoring Loop](https://mlsanity.com/paper/2610.15692/) (2026)

## Abstract (arXiv)

In the context of English as a Foreign Language (EFL) writing education, LLM-as-a-tutor can assist students by providing real-time feedback on their essays. However, challenges arise in assessing LLM-as-a-tutor due to differing standards between educational and general use cases. To bridge this gap, we integrate pedagogical principles to assess student-LLM interaction. First, we explore how LLMs can function as English tutors, providing effective essay feedback tailored to students. Second, we propose three metrics to evaluate LLM-as-a-tutor specifically designed for EFL writing education, emphasizing pedagogical aspects. In this process, EFL experts evaluate the feedback from LLM-as-a-tutor regarding quality and characteristics. On the other hand, EFL learners assess their learning outcomes from interaction with LLM-as-a-tutor. This approach lays the groundwork for developing LLMs-as-a-tutor tailored to the needs of EFL learners, advancing the effectiveness of writing education in this context.