mlsanityData to 7 Oct 2026

Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends

arXiv 2401.07518 ↗First posted 15 Jan 2024cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Natural Language Processing (NLP) aims to analyze text or speech via techniques in the computer science field. It serves applications in the domains of healthcare, commerce, education, and so on. Particularly, NLP has been widely applied to the education domain and its applications have enormous potential to help teaching and learning. In this survey, we review recent advances in NLP with a focus on solving problems relevant to the education domain. In detail, we begin with introducing the related background and the real-world scenarios in education to which NLP techniques could contribute. Then, we present a taxonomy of NLP in the education domain and highlight typical NLP applications including question answering, question construction, automated assessment, and error correction. Next, we illustrate the task definition, challenges, and corresponding cutting-edge techniques based on the above taxonomy. In particular, LLM-involved methods are included for discussion due to the wide usage of LLMs in diverse NLP applications. After that, we showcase some off-the-shelf demonstrations in this domain, which are designed for educators or researchers. At last, we conclude with five promising directions for future research, including generalization over subjects and languages, deployed LLM-based systems for education, adaptive learning for teaching and learning, interpretability for education, and ethical consideration of NLP techniques. We organize all relevant datasets and papers in the open-available Github Link for better review https://github.com/LiXinyuan1015/NLP-for-Education.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 156 of its 336 references that are in the map. First posted on arXiv 15 Jan 2024.

Builds on

156 of 336 references.

References · 156

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  9. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  10. 2015VQA: Visual Question Answeringcited by 2,489
  11. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  12. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
38 more
  1. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  2. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  3. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  4. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  5. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  6. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  8. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  9. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  10. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  11. 2016A Diagram Is Worth A Dozen Imagescited by 793
  12. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  13. 2017Crowdsourcing Multiple Choice Science Questionscited by 742
  14. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  15. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  16. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
  17. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  18. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  19. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  20. 2021Unified Pre-training for Program Understanding and Generationcited by 361
  21. 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 355
  22. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
  23. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
  24. 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 338
  25. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 314
  26. 2016Hierarchical Question-Image Co-Attention for Visual Question Answeringcited by 278
  27. 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 276
  28. 2015Stacked Attention Networks for Image Question Answeringcited by 273
  29. 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 262
  30. 2018code2vec: Learning Distributed Representations of Codecited by 249
  31. 2016Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Groundingcited by 243
  32. 2016Enhanced LSTM for Natural Language Inferencecited by 199
  33. 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 195
  34. 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 189
  35. 2017Learning to Ask: Neural Question Generation for Reading Comprehensioncited by 186
  36. 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
  37. 2023Progressive-Hint Prompting Improves Reasoning in Large Language Modelscited by 147
  38. 2022Practical Program Repair in the Era of Large Pre-trained Language Modelscited by 133

50 most cited of 156 All 156 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.