mlsanityData to 14 Oct 2026

Pedagogical Promise and Peril of AI: A Text Mining Analysis of ChatGPT Research Discussions in Programming Education

arXiv 2605.00361 ↗First posted 1 May 2026cs.CY cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

GenAI systems such as ChatGPT are increasingly discussed in programming education, but the ways in which the research literature conceptualizes and frames their role remain unclear. This chapter applies text mining to publications indexed in a leading academic database to map scholarly discourse on ChatGPT in programming education. Term frequency analysis, phrase pattern extraction, and topic modeling reveal four dominant themes: pedagogical implementation, student-centered learning and engagement, AI infrastructure and human-AI collaboration, and assessment, prompting, and model evaluation. The literature prioritizes classroom practice and learner interaction, with comparatively limited attention to assessment design and institutional governance. Across studies, ChatGPT is positioned both as a learning aid that supports explanation, feedback, and efficiency and as a pedagogical risk linked to overreliance, unreliable outputs, and academic integrity concerns. These findings support responsible integration and highlight the need for stronger assessment and governance mechanisms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 61 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

8 of 61 references.

References · 8

  1. 2023Generative AIcited by 120
  2. 2023Comparing Code Explanations Created by Students and Large Language Modelscited by 64
  3. 2023Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutorscited by 39
  4. 2023Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validationcited by 29
  5. 2024Assessing AI Detectors in Identifying AI-Generated Code: Implications for Educationcited by 18
  6. 2024AI-Tutoring in Software Engineering Educationcited by 11
  7. 2023Kattis vs. ChatGPT: Assessment and Evaluation of Programming Tasks in the Age of Artificial Intelligencecited by 4
  8. 2025A Review of Generative AI in Computer Science Education: Challenges and Opportunities in Accuracy, Authenticity, and Assessmentcited by 1

Built on by

Not cited yet.