Towards Applying Powerful Large AI Models in Classroom Teaching: Opportunities, Challenges and Prospects
On the map: Knowledge distillation → Knowledge distillation for LLMs
Abstract (arXiv)
This perspective paper proposes a series of interactive scenarios that utilize Artificial Intelligence (AI) to enhance classroom teaching, such as dialogue auto-completion, knowledge and style transfer, and assessment of AI-generated content. By leveraging recent developments in Large Language Models (LLMs), we explore the potential of AI to augment and enrich teacher-student dialogues and improve the quality of teaching. Our goal is to produce innovative and meaningful conversations between teachers and students, create standards for evaluation, and improve the efficacy of AI-for-Education initiatives. In Section 3, we discuss the challenges of utilizing existing LLMs to effectively complete the educated tasks and present a unified framework for addressing diverse education dataset, processing lengthy conversations, and condensing information to better accomplish more downstream tasks. In Section 4, we summarize the pivoting tasks including Teacher-Student Dialogue Auto-Completion, Expert Teaching Knowledge and Style Transfer, and Assessment of AI-Generated Content (AIGC), providing a clear path for future research. In Section 5, we also explore the use of external and adjustable LLMs to improve the generated content through human-in-the-loop supervision and reinforcement learning. Ultimately, this paper seeks to highlight the potential for AI to aid the field of education and promote its further exploration.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Knowledge distillation for LLMs, one of 12 directions in Knowledge distillation. Builds on 33 of its 57 references that are in the map. First posted on arXiv 5 May 2023.
Builds on
33 of 57 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Segment Anythingcited by 8,234
21 more
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2016Deep Learning with Differential Privacycited by 2,728
- 2023A Survey of Large Language Modelscited by 2,576
- 2018Deep contextualized word representationscited by 2,290
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2021Conversational Question Answering: A Surveycited by 31
- 2023Federated Prompting and Chain-of-Thought Reasoning for Improving LLMs Answeringcited by 14
Built on by
Citing papers per year: 2023: 4; 2024: 0; 2025: 2.
6 papers.
- 2023Integration of Large Language Models and Federated Learningcited by 31
- 2023Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectivescited by 16
- 2023The Importance of Prompt Tuning for Automated Neuron Explanationscited by 12
- 2023A New Dialogue Response Generation Agent for Large Language Models by Asking Questions to Detect User's Intentionscited by 6
- 2025Student Perspectives on the Benefits and Risks of AI in Educationcited by 6
- 2025Bridging LMS and generative AI: dynamic course content integration (DCCI) for enhancing student satisfaction and engagement via the ask ME assistantcited by 0
- 2025Student Perspectives on the Benefits and Risks of AI in Education4 May 2025
- 2025Bridging LMS and generative AI: dynamic course content integration (DCCI) for enhancing student satisfaction and engagement via the ask ME assistant4 Apr 2025
- 2023The Importance of Prompt Tuning for Automated Neuron Explanations9 Oct 2023
- 2023A New Dialogue Response Generation Agent for Large Language Models by Asking Questions to Detect User's Intentions5 Oct 2023
- 2023Integration of Large Language Models and Federated Learning18 Jul 2023
- 2023Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives30 Jun 2023
Similar, not cited
Close in wording, no citation either way
- 2024Enhanced Classroom Dialogue Sequences Analysis with a Hybrid AI Agent: Merging Expert Rule-Base with Large Language Models
- 2026Large Language Models in Teaching and Learning: Reflections on Implementing an AI Chatbot in Higher Education ↗
- 2025EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue Framework
- 2025Simulating Students with Large Language Models: A Review of Architecture, Mechanisms, and Role Modelling in Education with Generative AI
- 2025Dialogic Pedagogy for Large Language Models: Aligning Conversational AI with Proven Theories of Learning
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications
- 2026Teacher-Authored Prompts for Configuring Student-AI Dialogue: K-12 Classroom Implementation
- 2024Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring System