Large Language Models for Education: A Survey
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) has a profound impact on traditional education. In recent years, large language models (LLMs) have been increasingly used in various applications such as natural language processing, computer vision, speech recognition, and autonomous driving. LLMs have also been applied in many fields, including recommendation, finance, government, education, legal affairs, and finance. As powerful auxiliary tools, LLMs incorporate various technologies such as deep learning, pre-training, fine-tuning, and reinforcement learning. The use of LLMs for smart education (LLMEdu) has been a significant strategic direction for countries worldwide. While LLMs have shown great promise in improving teaching quality, changing education models, and modifying teacher roles, the technologies are still facing several challenges. In this paper, we conduct a systematic review of LLMEdu, focusing on current technologies, challenges, and future developments. We first summarize the current state of LLMEdu and then introduce the characteristics of LLMs and education, as well as the benefits of integrating LLMs into education. We also review the process of integrating LLMs into the education industry, as well as the introduction of related technologies. Finally, we discuss the challenges and problems faced by LLMEdu, as well as prospects for future optimization of LLMEdu.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 57 of its 129 references that are in the map. First posted on arXiv 12 May 2024.
Builds on
57 of 129 references.
References · 57
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
38 more
- 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 632
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2022Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Modelscited by 220
- 2020UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Trainingcited by 204
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
- 2023Multimodal Large Language Models: A Surveycited by 195
- 2022Fine-tuning language models to find agreement among humans with diverse preferencescited by 189
- 2023ImageBind-LLM: Multi-modality Instruction Tuningcited by 142
- 2023Large Language Models for Robotics: A Surveycited by 133
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 132
- 2023Large Language Models in Law: A Surveycited by 128
- 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
- 2023AI-Generated Content (AIGC): A Surveycited by 59
- 2023Pairwise Proximal Policy Optimization: Harnessing Relative Feedback for LLM Alignmentcited by 57
- 2023Large Language Models in Education: Vision and Opportunitiescited by 54
- 2023Enhancing Recommender Systems with Large Language Model Reasoning Graphscited by 52
- 2023SuperCLUE: A Comprehensive Chinese Large Language Model Benchmarkcited by 50
- 2020Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Modelscited by 49
- 2023Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPTcited by 41
- 2023Can Language Models Learn to Listen?cited by 40
- 2021Pre-trained Language Model based Ranking in Baidu Searchcited by 34
- 2023Large Language Models (GPT) for automating feedback on programming assignmentscited by 32
- 2021M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretrainingcited by 31
- 2020A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Modelscited by 30
- 2018A Survey of Utility-Oriented Pattern Miningcited by 27
- 2023LMEye: An Interactive Perception Network for Large Language Modelscited by 27
- 2023Measuring Massive Multitask Chinese Understandingcited by 25
- 2023Model-as-a-Service (MaaS): A Surveycited by 25
- 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
- 2023No Train Still Gain. Unleash Mathematical Reasoning of Large Language Models with Monte Carlo Tree Search Guided by Energy Functioncited by 20
- 2022Universal Spam Detection using Transfer Learning of BERT Modelcited by 13
- 2023CLEVA: Chinese Language Models EVAluation Platformcited by 13
- 2023Tree-Based Representation and Generation of Natural and Mathematical Languagecited by 12
- 2023Web 3.0: The Future of Internetcited by 11
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 17; 2026: 13.
34 papers.
Sort:
By area:
- 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challengescited by 55
- 2024Watermarking Techniques for Large Language Models: A Surveycited by 23
- 2024Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Coursecited by 19
- 2025Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agentscited by 19
- 2026A Survey on LLM-based Conversational User Simulationcited by 18
- 2025From Superficial Outputs to Superficial Learning: Risks of Large Language Models in Educationcited by 9
- 2025DCAD-2000: A Multilingual Dataset across 2000+ Languages with Data Cleaning as Anomaly Detectioncited by 5
- 2024Assessing Personalized AI Mentoring with Large Language Models in the Computing Fieldcited by 2
- 2025The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Owncited by 2
- 2025Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitionscited by 2
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessmentcited by 2
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Educationcited by 2
22 more
- 2026LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Publiccited by 2
- 2025CyberMentor: AI Powered Learning Tool Platform to Address Diverse Student Needs in Cybersecurity Educationcited by 1
- 2025Deploying AI for Signal Processing education: Selected challenges and intriguing opportunitiescited by 1
- 2026Evaluating adaptive and generative AI-based feedback and recommendations in a knowledge-graph-integrated programming learning systemcited by 1
- 2026AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Modelscited by 1
- 2026A Dialogue-Based Framework for Correcting Multimodal Errors in AI-Assisted STEM Educationcited by 1
- 2026Polar: A Benchmark for Evaluating Political Bias in LLMscited by 1
- 2026MarkSec: Capability-Aware Evaluation of Adversarial Attacks Against LLM Watermarkscited by 1
- 2025SAGE: Steering Dialog Generation with Future-Aware State-Action Augmentationcited by 0
- 2025ZPD-SCA: Unveiling the Blind Spots of LLMs in Assessing Students' Cognitive Abilitiescited by 0
- 2025Audited Reasoning Refinement: Fine-Tuning Language Models via LLM-Guided Step-Wise Evaluation and Correctioncited by 0
- 2025Small Language Models for Curriculum-based Guidancecited by 0
- 2025FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writingcited by 0
- 2025From Pilots to Practices: A Scoping Review of GenAI-Enabled Personalization in Computer Science Educationcited by 0
- 2025Human-AI Interaction Alignment: Designing, Evaluating, and Evolving Value-Centered AI For Reciprocal Human-AI Futurescited by 0
- 2025BitFlipScope: Scalable Fault Localization and Recovery for Bit-Flip Corruptions in LLMscited by 0
- 2026BRIDGE the Gap: Mitigating Bias Amplification in Automated Scoring of English Language Learners via Inter-group Data Augmentationcited by 0
- 2026StreamWise: Serving Multi-Modal Generation in Real-Time at Scalecited by 0
- 2026Do Emotions in Prompts Matter? Effects of Emotional Framing on Large Language Modelscited by 0
- 2026Bridging Textual Profiles and Latent User Embeddings for Personalizationcited by 0
- 2026ELEVATE: Designing Human-Centered GenAI Virtual Tutors for Scalable and Inclusive Educationcited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topicscited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topics25 Sep 2026
- 2026MarkSec: Capability-Aware Evaluation of Adversarial Attacks Against LLM Watermarks15 Sep 2026
- 2026ELEVATE: Designing Human-Centered GenAI Virtual Tutors for Scalable and Inclusive Education17 Jun 2026
- 2026Polar: A Benchmark for Evaluating Political Bias in LLMs11 Jun 2026
- 2026Bridging Textual Profiles and Latent User Embeddings for Personalization7 May 2026
- 2026A Dialogue-Based Framework for Correcting Multimodal Errors in AI-Assisted STEM Education5 May 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2026AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Models22 Apr 2026
- 2026Do Emotions in Prompts Matter? Effects of Emotional Framing on Large Language Models2 Apr 2026
- 2026Evaluating adaptive and generative AI-based feedback and recommendations in a knowledge-graph-integrated programming learning system26 Mar 2026
- 2026StreamWise: Serving Multi-Modal Generation in Real-Time at Scale6 Mar 2026
- 2026BRIDGE the Gap: Mitigating Bias Amplification in Automated Scoring of English Language Learners via Inter-group Data Augmentation27 Feb 2026
22 more
- 2026LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Public9 Jan 2026
- 2025Human-AI Interaction Alignment: Designing, Evaluating, and Evolving Value-Centered AI For Reciprocal Human-AI Futures25 Dec 2025
- 2025From Pilots to Practices: A Scoping Review of GenAI-Enabled Personalization in Computer Science Education23 Dec 2025
- 2025BitFlipScope: Scalable Fault Localization and Recovery for Bit-Flip Corruptions in LLMs18 Dec 2025
- 2025FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writing28 Nov 2025
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Education12 Nov 2025
- 2025Small Language Models for Curriculum-based Guidance27 Sep 2025
- 2025From Superficial Outputs to Superficial Learning: Risks of Large Language Models in Education26 Sep 2025
- 2025Audited Reasoning Refinement: Fine-Tuning Language Models via LLM-Guided Step-Wise Evaluation and Correction15 Sep 2025
- 2025Deploying AI for Signal Processing education: Selected challenges and intriguing opportunities10 Sep 2025
- 2025ZPD-SCA: Unveiling the Blind Spots of LLMs in Assessing Students' Cognitive Abilities20 Aug 2025
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment12 Aug 2025
- 2025Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitions16 Jul 2025
- 2025Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents26 May 2025
- 2025SAGE: Steering Dialog Generation with Future-Aware State-Action Augmentation4 Mar 2025
- 2025The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own23 Feb 2025
- 2025DCAD-2000: A Multilingual Dataset across 2000+ Languages with Data Cleaning as Anomaly Detection17 Feb 2025
- 2025CyberMentor: AI Powered Learning Tool Platform to Address Diverse Student Needs in Cybersecurity Education16 Jan 2025
- 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges16 Dec 2024
- 2024Assessing Personalized AI Mentoring with Large Language Models in the Computing Field11 Dec 2024
- 2024Watermarking Techniques for Large Language Models: A Survey26 Aug 2024
- 2024Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course7 Jul 2024
- 2024Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Coursecited by 19
- 2026A Survey on LLM-based Conversational User Simulationcited by 18
- 2025From Superficial Outputs to Superficial Learning: Risks of Large Language Models in Educationcited by 9
- 2025DCAD-2000: A Multilingual Dataset across 2000+ Languages with Data Cleaning as Anomaly Detectioncited by 5
- 2024Assessing Personalized AI Mentoring with Large Language Models in the Computing Fieldcited by 2
- 2025The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Owncited by 2
- 2025Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitionscited by 2
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Educationcited by 2
- 2026LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Publiccited by 2
- 2025CyberMentor: AI Powered Learning Tool Platform to Address Diverse Student Needs in Cybersecurity Educationcited by 1
- 2025Deploying AI for Signal Processing education: Selected challenges and intriguing opportunitiescited by 1
- 2026A Dialogue-Based Framework for Correcting Multimodal Errors in AI-Assisted STEM Educationcited by 1
12 most cited of 25 All 25 (JSON)
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topics25 Sep 2026
- 2026ELEVATE: Designing Human-Centered GenAI Virtual Tutors for Scalable and Inclusive Education17 Jun 2026
- 2026Polar: A Benchmark for Evaluating Political Bias in LLMs11 Jun 2026
- 2026Bridging Textual Profiles and Latent User Embeddings for Personalization7 May 2026
- 2026A Dialogue-Based Framework for Correcting Multimodal Errors in AI-Assisted STEM Education5 May 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2026Do Emotions in Prompts Matter? Effects of Emotional Framing on Large Language Models2 Apr 2026
- 2026StreamWise: Serving Multi-Modal Generation in Real-Time at Scale6 Mar 2026
- 2026BRIDGE the Gap: Mitigating Bias Amplification in Automated Scoring of English Language Learners via Inter-group Data Augmentation27 Feb 2026
- 2026LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Public9 Jan 2026
- 2025From Pilots to Practices: A Scoping Review of GenAI-Enabled Personalization in Computer Science Education23 Dec 2025
- 2025BitFlipScope: Scalable Fault Localization and Recovery for Bit-Flip Corruptions in LLMs18 Dec 2025
12 newest of 25 All 25 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Spoken Language Intelligence of Large Language Models for Language Learning
- 2025LLM Agents for Education: Advances and Applications
- 2026Large Language Models in Teaching and Learning: Reflections on Implementing an AI Chatbot in Higher Education ↗
- 2025From Struggle (06-2024) to Mastery (02-2025) LLMs Conquer Advanced Algorithm Exams and Pave the Way for Editorial Generation
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications
- 2026A Scoping Review of Large Language Model-Based Pedagogical Agents
- 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Course
- 2024Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges