mlsanityData to 7 Oct 2026

Habituation at the Gate: Rising Approval and Declining Scrutiny in Human Review of AI Agent Code

arXiv 2606.22721 ↗First posted 21 Jun 2026cs.SEcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

As AI coding agents (e.g., GitHub Copilot, Devin, OpenAI Codex, Cursor) submit pull requests to open-source repositories at scale, a key question arises: do human reviewers gradually lower their scrutiny for AI-generated code over time? We conduct a longitudinal within-reviewer analysis using the AIDev dataset, studying 400 repeat reviewers who collectively submitted 11,429 reviews over a seven-month observation period. Comparing each reviewer's early and late review episodes, we observe a population-level shift in approval rate from 30.1% to 36.8% (Wilcoxon signed-rank p < 10^{-6} on paired shifts). Pooled by within-reviewer experience decile, the cumulative gap reaches +14.5 pp from first to tenth decile. This shift is experience-driven (persists after controlling for calendar time), agent-specific (human PR approval rates decline over the same period), and not explained by PR difficulty (median PR size is flat). However, review latency increases rather than decreases (+3.5x), while inline comment volume decreases (-22%, p=0.0014), suggesting reviewers spend more time in queue but less time actively inspecting code. The combination of rising approval, declining comment effort, and increasing queue time is most consistent with reflexive habituation under growing workload rather than rational trust calibration alone.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. First posted on arXiv 21 Jun 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Human-Centric to Agentic Code Review: The Impact of Different Generations of Generative AI Technology on Review Quality
  2. 2026Beyond Lexical Metrics: Sentence-Embedding Detection of Reviewer Habituation in AI Code Review ↗
  3. 2026These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requests
  4. 2026How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses
  5. 20263100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discourse
  6. 2026Human-AI Synergy in Agentic Code Review
  7. 2026On the Footprints of Reviewer Bots Feedback on Agentic Pull Requests in OSS GitHub Repositories
  8. 2026Early-Stage Prediction of Review Effort in AI-Generated Pull Requests