mlsanityData to 14 Oct 2026

Towards Applying Powerful Large AI Models in Classroom Teaching: Opportunities, Challenges and Prospects

arXiv 2305.03433 ↗First posted 5 May 2023cs.AI cs.CYcited by 6

On the map: Knowledge distillation → Knowledge distillation for LLMs

Abstract (arXiv)

This perspective paper proposes a series of interactive scenarios that utilize Artificial Intelligence (AI) to enhance classroom teaching, such as dialogue auto-completion, knowledge and style transfer, and assessment of AI-generated content. By leveraging recent developments in Large Language Models (LLMs), we explore the potential of AI to augment and enrich teacher-student dialogues and improve the quality of teaching. Our goal is to produce innovative and meaningful conversations between teachers and students, create standards for evaluation, and improve the efficacy of AI-for-Education initiatives. In Section 3, we discuss the challenges of utilizing existing LLMs to effectively complete the educated tasks and present a unified framework for addressing diverse education dataset, processing lengthy conversations, and condensing information to better accomplish more downstream tasks. In Section 4, we summarize the pivoting tasks including Teacher-Student Dialogue Auto-Completion, Expert Teaching Knowledge and Style Transfer, and Assessment of AI-Generated Content (AIGC), providing a clear path for future research. In Section 5, we also explore the use of external and adjustable LLMs to improve the generated content through human-in-the-loop supervision and reinforcement learning. Ultimately, this paper seeks to highlight the potential for AI to aid the field of education and promote its further exploration.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Knowledge distillation for LLMs, one of 12 directions in Knowledge distillation. Builds on 33 of its 57 references that are in the map. First posted on arXiv 5 May 2023.

Builds on

33 of 57 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2022Training language models to follow instructions with human feedbackcited by 15,971
  8. 2017Proximal Policy Optimization Algorithmscited by 15,215
  9. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  10. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  11. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  12. 2023Segment Anythingcited by 8,234
21 more
  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  7. 2017Deep reinforcement learning from human preferencescited by 3,912
  8. 2016Deep Learning with Differential Privacycited by 2,728
  9. 2023A Survey of Large Language Modelscited by 2,576
  10. 2018Deep contextualized word representationscited by 2,290
  11. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  12. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  13. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  14. 2023BloombergGPT: A Large Language Model for Financecited by 939
  15. 2022Galactica: A Large Language Model for Sciencecited by 744
  16. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
  17. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  18. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
  19. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
  20. 2021Conversational Question Answering: A Surveycited by 31
  21. 2023Federated Prompting and Chain-of-Thought Reasoning for Improving LLMs Answeringcited by 14

Built on by

Cited by year

Citing papers per year: 2023: 4; 2024: 0; 2025: 2.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhanced Classroom Dialogue Sequences Analysis with a Hybrid AI Agent: Merging Expert Rule-Base with Large Language Models
  2. 2026Large Language Models in Teaching and Learning: Reflections on Implementing an AI Chatbot in Higher Education ↗
  3. 2025EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue Framework
  4. 2025Simulating Students with Large Language Models: A Review of Architecture, Mechanisms, and Role Modelling in Education with Generative AI
  5. 2025Dialogic Pedagogy for Large Language Models: Aligning Conversational AI with Proven Theories of Learning
  6. 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications
  7. 2026Teacher-Authored Prompts for Configuring Student-AI Dialogue: K-12 Classroom Implementation
  8. 2024Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring System