LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction
Not on the map. Why?
Abstract (arXiv)
In the context of English as a Foreign Language (EFL) writing education, LLM-as-a-tutor can assist students by providing real-time feedback on their essays. However, challenges arise in assessing LLM-as-a-tutor due to differing standards between educational and general use cases. To bridge this gap, we integrate pedagogical principles to assess student-LLM interaction. First, we explore how LLMs can function as English tutors, providing effective essay feedback tailored to students. Second, we propose three metrics to evaluate LLM-as-a-tutor specifically designed for EFL writing education, emphasizing pedagogical aspects. In this process, EFL experts evaluate the feedback from LLM-as-a-tutor regarding quality and characteristics. On the other hand, EFL learners assess their learning outcomes from interaction with LLM-as-a-tutor. This approach lays the groundwork for developing LLMs-as-a-tutor tailored to the needs of EFL learners, advancing the effectiveness of writing education in this context.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 5 of its 28 references that are in the map. First posted on arXiv 8 Oct 2023.
Builds on
5 of 28 references.
References · 5
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2013A Computational Approach to Politeness with Application to Social Factorscited by 104
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
- 2023Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instructioncited by 37
- 2023RECIPE: How to Integrate ChatGPT into EFL Writing Educationcited by 17
Built on by
Citing papers per year: 2024: 3; 2025: 18; 2026: 7.
28 papers.
Sort:
By area:
- 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 40
- 2025TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoringcited by 12
- 2025LLMs can Perform Multi-Dimensional Analytic Writing Assessments: A Case Study of L2 Graduate-Level Academic English Writingcited by 10
- 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedbackcited by 10
- 2025Multilingual Performance Biases of Large Language Models in Educationcited by 9
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2025Breaking Bad Tokens: Detoxification of LLMs Using Sparse Autoencoderscited by 8
- 2024RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Educationcited by 7
- 2025Position: LLMs Can be Good Tutors in English Educationcited by 6
- 2024STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyondcited by 5
- 2025Exploring the Potential of Large Multimodal Models as Effective Alternatives for Pronunciation Assessmentcited by 4
- 2025When Models Know More Than They Can Explain: Quantifying Knowledge Transfer in Human-AI Collaborationcited by 4
16 more
- 2025Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theorycited by 3
- 2026Linguistics and Human Brain: A Perspective of Computational Neurosciencecited by 3
- 2025Comparing human and LLM proofreading in L2 writing: Impact on lexical and syntactic featurescited by 2
- 2025MAGIC: Multi-Agent Argumentation and Grammar Integrated Critiquercited by 2
- 2026LLMs Do Not Grade Essays Like Humanscited by 2
- 2024Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student Revisionscited by 1
- 2025Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biasescited by 1
- 2025Free Lunch for User Experience: Crowdsourcing Agents for Scalable User Studiescited by 1
- 2026Could Large Language Models work as Post-hoc Explainability Tools in Credit Risk Models?cited by 1
- 2025DIY-MKG: An LLM-Based Polyglot Language Learning Systemcited by 0
- 2025Feed-O-Meter: Investigating AI-Generated Mentee Personas as Interactive Agents for Scaffolding Design Feedback Practicecited by 0
- 2025FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writingcited by 0
- 2026Never say never: Exploring the effects of available knowledge on agent persuasiveness in controlled physiotherapy motivation dialoguescited by 0
- 2026The Crutch or the Ceiling? How Different Generations of LLMs Shape EFL Student Writingscited by 0
- 2026PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleafcited by 0
- 2026From Texts to Scores: Tracing the Emergence of Essay Quality Representations in Large Language Modelscited by 0
- 2026From Texts to Scores: Tracing the Emergence of Essay Quality Representations in Large Language Models18 Jun 2026
- 2026PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleaf7 Jun 2026
- 2026The Crutch or the Ceiling? How Different Generations of LLMs Shape EFL Student Writings16 Apr 2026
- 2026LLMs Do Not Grade Essays Like Humans24 Mar 2026
- 2026Could Large Language Models work as Post-hoc Explainability Tools in Credit Risk Models?21 Feb 2026
- 2026Never say never: Exploring the effects of available knowledge on agent persuasiveness in controlled physiotherapy motivation dialogues13 Feb 2026
- 2026Linguistics and Human Brain: A Perspective of Computational Neuroscience9 Feb 2026
- 2025FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writing28 Nov 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025Feed-O-Meter: Investigating AI-Generated Mentee Personas as Interactive Agents for Scaffolding Design Feedback Practice9 Sep 2025
- 2025Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theory26 Jul 2025
- 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedback21 Jul 2025
16 more
- 2025DIY-MKG: An LLM-Based Polyglot Language Learning System2 Jul 2025
- 2025MAGIC: Multi-Agent Argumentation and Grammar Integrated Critiquer16 Jun 2025
- 2025Comparing human and LLM proofreading in L2 writing: Impact on lexical and syntactic features10 Jun 2025
- 2025When Models Know More Than They Can Explain: Quantifying Knowledge Transfer in Human-AI Collaboration5 Jun 2025
- 2025Free Lunch for User Experience: Crowdsourcing Agents for Scalable User Studies29 May 2025
- 2025TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoring20 May 2025
- 2025Breaking Bad Tokens: Detoxification of LLMs Using Sparse Autoencoders20 May 2025
- 2025Multilingual Performance Biases of Large Language Models in Education24 Apr 2025
- 2025Exploring the Potential of Large Multimodal Models as Effective Alternatives for Pronunciation Assessment14 Mar 2025
- 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialogues9 Mar 2025
- 2025Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biases20 Feb 2025
- 2025LLMs can Perform Multi-Dimensional Analytic Writing Assessments: A Case Study of L2 Graduate-Level Academic English Writing17 Feb 2025
- 2025Position: LLMs Can be Good Tutors in English Education8 Feb 2025
- 2024Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student Revisions10 Oct 2024
- 2024STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond9 Sep 2024
- 2024RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education13 Mar 2024
- 2025MAGIC: Multi-Agent Argumentation and Grammar Integrated Critiquercited by 2
- 2025Free Lunch for User Experience: Crowdsourcing Agents for Scalable User Studiescited by 1
- 2025Feed-O-Meter: Investigating AI-Generated Mentee Personas as Interactive Agents for Scaffolding Design Feedback Practicecited by 0
- 2026Never say never: Exploring the effects of available knowledge on agent persuasiveness in controlled physiotherapy motivation dialoguescited by 0
- 2026PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleafcited by 0
- 2026PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleaf7 Jun 2026
- 2026Never say never: Exploring the effects of available knowledge on agent persuasiveness in controlled physiotherapy motivation dialogues13 Feb 2026
- 2025Feed-O-Meter: Investigating AI-Generated Mentee Personas as Interactive Agents for Scaffolding Design Feedback Practice9 Sep 2025
- 2025MAGIC: Multi-Agent Argumentation and Grammar Integrated Critiquer16 Jun 2025
- 2025Free Lunch for User Experience: Crowdsourcing Agents for Scalable User Studies29 May 2025
- 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 40
- 2025TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoringcited by 12
- 2025LLMs can Perform Multi-Dimensional Analytic Writing Assessments: A Case Study of L2 Graduate-Level Academic English Writingcited by 10
- 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedbackcited by 10
- 2025Multilingual Performance Biases of Large Language Models in Educationcited by 9
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2025Breaking Bad Tokens: Detoxification of LLMs Using Sparse Autoencoderscited by 8
- 2024RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Educationcited by 7
- 2025Position: LLMs Can be Good Tutors in English Educationcited by 6
- 2025When Models Know More Than They Can Explain: Quantifying Knowledge Transfer in Human-AI Collaborationcited by 4
- 2025Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theorycited by 3
- 2026Linguistics and Human Brain: A Perspective of Computational Neurosciencecited by 3
12 most cited of 20 All 20 (JSON)
- 2026From Texts to Scores: Tracing the Emergence of Essay Quality Representations in Large Language Models18 Jun 2026
- 2026The Crutch or the Ceiling? How Different Generations of LLMs Shape EFL Student Writings16 Apr 2026
- 2026LLMs Do Not Grade Essays Like Humans24 Mar 2026
- 2026Could Large Language Models work as Post-hoc Explainability Tools in Credit Risk Models?21 Feb 2026
- 2026Linguistics and Human Brain: A Perspective of Computational Neuroscience9 Feb 2026
- 2025FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writing28 Nov 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theory26 Jul 2025
- 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedback21 Jul 2025
- 2025DIY-MKG: An LLM-Based Polyglot Language Learning System2 Jul 2025
- 2025When Models Know More Than They Can Explain: Quantifying Knowledge Transfer in Human-AI Collaboration5 Jun 2025
- 2025TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoring20 May 2025
12 newest of 20 All 20 (JSON)