mlsanityData to 14 Oct 2026

Teaching at Scale: Leveraging AI to Evaluate and Elevate Engineering Education

arXiv 2508.02731 ↗First posted 1 Aug 2025cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Evaluating teaching effectiveness at scale remains a persistent challenge for large universities, particularly within engineering programs that enroll tens of thousands of students. Traditional methods, such as manual review of student evaluations, are often impractical, leading to overlooked insights and inconsistent data use. This article presents a scalable, AI-supported framework for synthesizing qualitative student feedback using large language models. The system employs hierarchical summarization, anonymization, and exception handling to extract actionable themes from open-ended comments while upholding ethical safeguards. Visual analytics contextualize numeric scores through percentile-based comparisons, historical trends, and instructional load. The approach supports meaningful evaluation and aligns with best practices in qualitative analysis and educational assessment, incorporating student, peer, and self-reflective inputs without automating personnel decisions. We report on its successful deployment across a large college of engineering. Preliminary validation through comparisons with human reviewers, faculty feedback, and longitudinal analysis suggests that LLM-generated summaries can reliably support formative evaluation and professional development. This work demonstrates how AI systems, when designed with transparency and shared governance, can promote teaching excellence and continuous improvement at scale within academic institutions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 54 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

9 of 54 references.

References · 9

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  5. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  6. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  7. 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 195
  8. 2023Redefining Qualitative Analysis in the AI Era: Utilizing ChatGPT for Efficient Thematic Analysiscited by 16
  9. 2024Using Generative Text Models to Create Qualitative Codebooks for Student Evaluations of Teachingcited by 4

Built on by

Not cited yet.