mlsanityData to 14 Oct 2026

Large Language Models for Education: A Survey

arXiv 2405.13001 ↗First posted 12 May 2024cs.CL cs.AI cs.CYcited by 34

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence (AI) has a profound impact on traditional education. In recent years, large language models (LLMs) have been increasingly used in various applications such as natural language processing, computer vision, speech recognition, and autonomous driving. LLMs have also been applied in many fields, including recommendation, finance, government, education, legal affairs, and finance. As powerful auxiliary tools, LLMs incorporate various technologies such as deep learning, pre-training, fine-tuning, and reinforcement learning. The use of LLMs for smart education (LLMEdu) has been a significant strategic direction for countries worldwide. While LLMs have shown great promise in improving teaching quality, changing education models, and modifying teacher roles, the technologies are still facing several challenges. In this paper, we conduct a systematic review of LLMEdu, focusing on current technologies, challenges, and future developments. We first summarize the current state of LLMEdu and then introduce the characteristics of LLMs and education, as well as the benefits of integrating LLMs into education. We also review the process of integrating LLMs into the education industry, as well as the introduction of related technologies. Finally, we discuss the challenges and problems faced by LLMEdu, as well as prospects for future optimization of LLMEdu.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 57 of its 129 references that are in the map. First posted on arXiv 12 May 2024.

Builds on

57 of 129 references.

References · 57

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  5. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  6. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  7. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  8. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  9. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  10. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  11. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
  12. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
38 more
  1. 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 632
  2. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  3. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
  4. 2020Deep Learning Enabled Semantic Communication Systemscited by 292
  5. 2022Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Modelscited by 220
  6. 2020UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Trainingcited by 204
  7. 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
  8. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
  9. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
  10. 2023Multimodal Large Language Models: A Surveycited by 195
  11. 2022Fine-tuning language models to find agreement among humans with diverse preferencescited by 189
  12. 2023ImageBind-LLM: Multi-modality Instruction Tuningcited by 142
  13. 2023Large Language Models for Robotics: A Surveycited by 133
  14. 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 132
  15. 2023Large Language Models in Law: A Surveycited by 128
  16. 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
  17. 2023AI-Generated Content (AIGC): A Surveycited by 59
  18. 2023Pairwise Proximal Policy Optimization: Harnessing Relative Feedback for LLM Alignmentcited by 57
  19. 2023Large Language Models in Education: Vision and Opportunitiescited by 54
  20. 2023Enhancing Recommender Systems with Large Language Model Reasoning Graphscited by 52
  21. 2023SuperCLUE: A Comprehensive Chinese Large Language Model Benchmarkcited by 50
  22. 2020Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Modelscited by 49
  23. 2023Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPTcited by 41
  24. 2023Can Language Models Learn to Listen?cited by 40
  25. 2021Pre-trained Language Model based Ranking in Baidu Searchcited by 34
  26. 2023Large Language Models (GPT) for automating feedback on programming assignmentscited by 32
  27. 2021M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretrainingcited by 31
  28. 2020A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Modelscited by 30
  29. 2018A Survey of Utility-Oriented Pattern Miningcited by 27
  30. 2023LMEye: An Interactive Perception Network for Large Language Modelscited by 27
  31. 2023Measuring Massive Multitask Chinese Understandingcited by 25
  32. 2023Model-as-a-Service (MaaS): A Surveycited by 25
  33. 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
  34. 2023No Train Still Gain. Unleash Mathematical Reasoning of Large Language Models with Monte Carlo Tree Search Guided by Energy Functioncited by 20
  35. 2022Universal Spam Detection using Transfer Learning of BERT Modelcited by 13
  36. 2023CLEVA: Chinese Language Models EVAluation Platformcited by 13
  37. 2023Tree-Based Representation and Generation of Natural and Mathematical Languagecited by 12
  38. 2023Web 3.0: The Future of Internetcited by 11

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 17; 2026: 13.

34 papers.

Sort:

By area:

  1. 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challengescited by 55
  2. 2024Watermarking Techniques for Large Language Models: A Surveycited by 23
  3. 2024Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Coursecited by 19
  4. 2025Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agentscited by 19
  5. 2026A Survey on LLM-based Conversational User Simulationcited by 18
  6. 2025From Superficial Outputs to Superficial Learning: Risks of Large Language Models in Educationcited by 9
  7. 2025DCAD-2000: A Multilingual Dataset across 2000+ Languages with Data Cleaning as Anomaly Detectioncited by 5
  8. 2024Assessing Personalized AI Mentoring with Large Language Models in the Computing Fieldcited by 2
  9. 2025The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Owncited by 2
  10. 2025Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitionscited by 2
  11. 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessmentcited by 2
  12. 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Educationcited by 2
22 more
  1. 2026LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Publiccited by 2
  2. 2025CyberMentor: AI Powered Learning Tool Platform to Address Diverse Student Needs in Cybersecurity Educationcited by 1
  3. 2025Deploying AI for Signal Processing education: Selected challenges and intriguing opportunitiescited by 1
  4. 2026Evaluating adaptive and generative AI-based feedback and recommendations in a knowledge-graph-integrated programming learning systemcited by 1
  5. 2026AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Modelscited by 1
  6. 2026A Dialogue-Based Framework for Correcting Multimodal Errors in AI-Assisted STEM Educationcited by 1
  7. 2026Polar: A Benchmark for Evaluating Political Bias in LLMscited by 1
  8. 2026MarkSec: Capability-Aware Evaluation of Adversarial Attacks Against LLM Watermarkscited by 1
  9. 2025SAGE: Steering Dialog Generation with Future-Aware State-Action Augmentationcited by 0
  10. 2025ZPD-SCA: Unveiling the Blind Spots of LLMs in Assessing Students' Cognitive Abilitiescited by 0
  11. 2025Audited Reasoning Refinement: Fine-Tuning Language Models via LLM-Guided Step-Wise Evaluation and Correctioncited by 0
  12. 2025Small Language Models for Curriculum-based Guidancecited by 0
  13. 2025FEANEL: A Benchmark for Fine-Grained Error Analysis in K-12 English Writingcited by 0
  14. 2025From Pilots to Practices: A Scoping Review of GenAI-Enabled Personalization in Computer Science Educationcited by 0
  15. 2025Human-AI Interaction Alignment: Designing, Evaluating, and Evolving Value-Centered AI For Reciprocal Human-AI Futurescited by 0
  16. 2025BitFlipScope: Scalable Fault Localization and Recovery for Bit-Flip Corruptions in LLMscited by 0
  17. 2026BRIDGE the Gap: Mitigating Bias Amplification in Automated Scoring of English Language Learners via Inter-group Data Augmentationcited by 0
  18. 2026StreamWise: Serving Multi-Modal Generation in Real-Time at Scalecited by 0
  19. 2026Do Emotions in Prompts Matter? Effects of Emotional Framing on Large Language Modelscited by 0
  20. 2026Bridging Textual Profiles and Latent User Embeddings for Personalizationcited by 0
  21. 2026ELEVATE: Designing Human-Centered GenAI Virtual Tutors for Scalable and Inclusive Educationcited by 0
  22. 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topicscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Spoken Language Intelligence of Large Language Models for Language Learning
  2. 2025LLM Agents for Education: Advances and Applications
  3. 2026Large Language Models in Teaching and Learning: Reflections on Implementing an AI Chatbot in Higher Education ↗
  4. 2025From Struggle (06-2024) to Mastery (02-2025) LLMs Conquer Advanced Algorithm Exams and Pave the Way for Editorial Generation
  5. 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications
  6. 2026A Scoping Review of Large Language Model-Based Pedagogical Agents
  7. 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Course
  8. 2024Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges