mlsanityData to 7 Oct 2026

Agentic Coding in the Wild: Characterizing GitHub Copilot Traces at Production Scale

arXiv 2608.00101 ↗First posted 30 Jul 2026cs.AI cs.LGcited by 9

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

AI coding agents like GitHub Copilot, Claude Code, and Codex interleave multi-step LLM inference with tool execution, creating a workload different from chatbots. We present the first production-scale characterization of this workload using sampled GitHub Copilot traces from June 2026, comprising 3.2M users, 13M sessions, 761M LLM calls, and 95T tokens. Our analysis reveals distinctive workload properties with important systems implications. For example, agentic coding sessions consist of sparse user-initiated turns, each unfolding into an autonomous agent loop of LLM calls almost always coupled with tool execution. This structure yields KV cache hit rates averaging 90% within a turn, but falling to 55% across turn boundaries and drastically invalidated after events like model switches or context compaction. Diverse workflows and user behaviors are observed with variable and long-tailed token consumption, time span, and tool calls. We highlight the difference between quick agentic turnaround times and the minutes-long user idle periods at turn boundaries, and design a lightweight idle-time predictor that captures 86-90% of total idle time, enabling proactive decisions for efficient resource orchestration. These findings challenge assumptions underlying current LLM-serving systems and provide an empirical foundation for agent-native infrastructure.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 37 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

19 of 37 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026TraceLab: Characterizing Coding Agent Workloads for LLM Serving29 Jun
  2. 2026SAGA: Workflow-Atomic Scheduling for AI Agent Inference on GPU Clusters1 May
  3. 2026Pythia: Exploiting Workflow Predictability for Efficient Agent-Native LLM Serving28 Apr
  4. 2025Sherlock: Reliable and Efficient Agentic Workflow Execution1 Nov
  5. 2025Murakkab: Resource-Efficient Agentic Workflow Orchestration in Cloud Platforms22 Aug
  6. 2025Autellix: An Efficient Serving Engine for LLM Agents as General Programs19 Feb

Other references · 13

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  3. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
  4. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
  5. 2025LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inferencecited by 119
  6. 2024Parrot: Efficient Serving of LLM-based Applications with Semantic Variablecited by 96
  7. 2019Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloadscited by 79
  8. 2020Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Providercited by 65
  9. 2021Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenterscited by 31
  10. 2025ModServe: Modality- and Stage-Aware Resource Disaggregation for Scalable Multimodal Model Servingcited by 18
  11. 2025JITServe: SLO-aware LLM Serving with Imprecise Request Informationcited by 17
  12. 2024Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Executioncited by 16
1 more
  1. 2025Compass: SLO-aware Query Planner for Compound AI Serving at Scalecited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentic AI Workload Characteristics
  2. 2026AgentPerfBench: A Benchmarking and Evaluation Suite for Inference Performance of Agentic LLMs
  3. 2026SWE-chat: Coding Agent Interactions From Real Users in the Wild
  4. 2026On the Impact of AGENTS.md Files on the Efficiency of AI Coding Agents
  5. 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks
  6. 2026CacheWise: Understanding Workloads and Optimizing KVCache Management for Efficiently Serving LLM Coding Agents
  7. 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agents
  8. 2026CodeComp: Structural KV Cache Compression for Agentic Coding