mlsanityData to 7 Oct 2026

Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding

arXiv 2602.23905 ↗First posted 27 Feb 2026cs.SEcited by 3

Not on the map. Why?

Abstract (arXiv)

AI coding agents allow software developers to generate code quickly, which raises a practical question for project managers and open source maintainers: can vibe coders with less development experience substitute for expert developers? To explore whether developer experience still matters in AI-assisted development, we study 22,953 Pull Requests (PRs) from 1,719 vibe coders in the GitHub repositories of the AIDev dataset. We split vibe coders into lower experience vibe coders (mathitExpLow) and higher experience vibe coders (mathitExpHigh) and compare contribution magnitude and PR acceptance rates across PR categories. We find that mathitExpLow submits PRs with larger volume (2.15× more commits and 1.47× more files changed) than mathitExpHigh. Moreover, mathitExpLow PRs, when compared to mathitExpHigh, receive 4.52× more review comments, and have 31% lower acceptance rates, and remain open 5.16× longer before resolution. Our results indicate that low-experienced vibe coders focus on generating more code while shifting verification burden onto reviewers. For practice, project managers may not be able to safely replace experienced developers with low-experience vibe coders without increasing review capacity. Development teams should therefore combine targeted training for novices with adaptive PR review cycles.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Feb 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026On Autopilot? An Empirical Study of Human-AI Teaming and Review Practices in Open Source
  2. 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
  3. 2026Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time
  4. 2026More Code, Less Reuse: Investigating Code Quality and Reviewer Sentiment towards AI-generated Pull Requests
  5. 2026AI IDEs or Autonomous Agents? Measuring the Impact of Coding Agents on Software Development
  6. 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub
  7. 2026Comparing AI Coding Agents: A Task-Stratified Analysis of Pull Request Acceptance
  8. 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents