mlsanityData to 14 Oct 2026

Engineering Signals of Human-AI Collaboration in the Agentic Coding Era: A Longitudinal Analysis of 33,228 Pull Requests from vLLM and SGLang with Implications for Biomedical AI Agents and Bioinformatics Pipeline Developmen

arXiv 2608.13884 ↗First posted 14 Aug 2026cs.SE cs.AI cs.ETcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

The rapid adoption of AI coding assistants and autonomous agentic development systems has coincided with major changes in the pace and structure of open-source software engineering. Yet empirical longitudinal evidence of these changes at the team level remains limited. We present a descriptive longitudinal analysis of seven engineering metrics: pull request (PR) throughput, cycle time, contributor diversity, PR comment density, merge rate, new-author participation, and PR size. Metrics were computed from all merged PRs in two high-velocity AI infrastructure repositories, vLLM (February 2023-June 2026; 18,290 PRs) and SGLang (January 2024-June 2026; 14,938 PRs). We segment development into four eras aligned with major changes in AI-assisted software development and examine human- and bot-authored activities. Both projects show substantial increases in development velocity and AI-developer collaboration signals. PR throughput increased 21x in vLLM and 17.9x in SGLang, while bot-authored PRs accounted for less than 0.2% of this growth, indicating that the increase was overwhelmingly human-driven. In the latest era, median cycle time was 1.04 days for vLLM and 0.62 days for SGLang, while P90 cycle times reached 16.8 and 14.3 days, respectively. Monthly unique authors increased steadily in both projects, suggesting broader contributor participation. PR comment density increased 4.2x in vLLM and 3.8x in SGLang, with bot comments contributing an estimated 15-20% of the increase. In contrast, PR size remained relatively stable across eras. Overall, AI-assisted development is associated with higher throughput, broader contributor participation, and increased AI-developer collaboration signals in high-velocity open-source software development.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 24 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

13 of 24 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Agentic AI in the Software Development Lifecycle: Architecture, Empirical Evidence, and the Reshaping of Software Engineering29 Apr
  2. 2026Security in the Age of AI Teammates: An Empirical Study of Agentic Pull Requests on GitHub1 Jan
  3. 2025Agentic Software Engineering: Foundational Pillars and a Research Roadmap7 Sep
  4. 2025A Survey on Code Generation with LLM-based Agents31 Jul
  5. 2024Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios16 Oct

Other references · 8

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  2. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
  3. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 149
  4. 2023Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPTcited by 71
  5. 2025Professional Software Developers Don't Vibe, They Control: AI Agent Use for Coding in 2025cited by 20
  6. 2024Collaborative human-AI trust (CHAI-T): A process framework for active management of trust in human-AI collaborationcited by 9
  7. 2025Intuition to Evidence: Measuring AI's True Impact on Developer Productivitycited by 5
  8. 2026EngThrive: Make It Fast and Easy to Do Great Workcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time
  2. 2026Augmentation with Dilution: A Large-Scale Empirical Study of Human Contributor Ecosystems After AI Coding Agent Adoption
  3. 2026On Autopilot? An Empirical Study of Human-AI Teaming and Review Practices in Open Source
  4. 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
  5. 2026Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice
  6. 2025The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering
  7. 2026Human-AI Collaboration and the Transformation of Software Engineering Work
  8. 2026AI IDEs or Autonomous Agents? Measuring the Impact of Coding Agents on Software Development