mlsanityData to 14 Oct 2026

AI-Assisted Code Review as a Scaffold for Code Quality and Self-Regulated Learning: An Experience Report

arXiv 2604.23251 ↗First posted 25 Apr 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Code review is central to software engineering education but hard to scale in capstone projects due to tight deadlines, uneven peer feedback, and limited prior experience. We investigate an LLM-as-reviewer integrated directly into GitHub pull requests (human-in-the-loop) across two cohorts (more than 100 students, 2023--2024). Using a mixed-methods design -- GitHub data, reflective reports, and a targeted survey -- we examine engagement and responsiveness as behavioral indicators of self-regulated learning processes. Quantitatively, the 2024 cohort produced more iterative activity (1176 vs. 581 PRs), while technical issues observed in 2023 (227 failed AI attempts) dropped to zero after tool and instructional refinements. Despite different adoption levels (93% vs. 50% of teams using the tool), responsiveness was stable: 32% (2023) and 33% (2024) of successfully AI-reviewed PRs were followed by subsequent commits on the same PR. Qualitatively, students used the LLM's structured comments to focus reviews and discuss code quality, while guidance reduced over-reliance. We contribute: (i) an in-workflow design for an AI reviewer that scaffolds learning while mitigating cognitive offloading; (ii) a repeated cross sectional comparison across two cohorts in authentic settings; (iii) a mixed-methods analysis combining objective GitHub metrics with student self-reports; and (iv) evidence-based pedagogical recommendations for responsible, student-led AI-assisted review.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 34 references that are in the map. First posted on arXiv 25 Apr 2026.

Builds on

2 of 34 references.

References · 2

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2024The Interplay of Learning, Analytics, and Artificial Intelligence in Education: A Vision for Hybrid Intelligencecited by 9

Built on by

Not cited yet.