Agentic Coding in the Wild: Characterizing GitHub Copilot Traces at Production Scale
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
AI coding agents like GitHub Copilot, Claude Code, and Codex interleave multi-step LLM inference with tool execution, creating a workload different from chatbots. We present the first production-scale characterization of this workload using sampled GitHub Copilot traces from June 2026, comprising 3.2M users, 13M sessions, 761M LLM calls, and 95T tokens. Our analysis reveals distinctive workload properties with important systems implications. For example, agentic coding sessions consist of sparse user-initiated turns, each unfolding into an autonomous agent loop of LLM calls almost always coupled with tool execution. This structure yields KV cache hit rates averaging 90% within a turn, but falling to 55% across turn boundaries and drastically invalidated after events like model switches or context compaction. Diverse workflows and user behaviors are observed with variable and long-tailed token consumption, time span, and tool calls. We highlight the difference between quick agentic turnaround times and the minutes-long user idle periods at turn boundaries, and design a lightweight idle-time predictor that captures 86-90% of total idle time, enabling proactive decisions for efficient resource orchestration. These findings challenge assumptions underlying current LLM-serving systems and provide an empirical foundation for agent-native infrastructure.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 37 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
19 of 37 references.
Closest ancestors · 6
Same direction, newest first
- 2026TraceLab: Characterizing Coding Agent Workloads for LLM Serving29 Jun
- 2026SAGA: Workflow-Atomic Scheduling for AI Agent Inference on GPU Clusters1 May
- 2026Pythia: Exploiting Workflow Predictability for Efficient Agent-Native LLM Serving28 Apr
- 2025Sherlock: Reliable and Efficient Agentic Workflow Execution1 Nov
- 2025Murakkab: Resource-Efficient Agentic Workflow Orchestration in Cloud Platforms22 Aug
- 2025Autellix: An Efficient Serving Engine for LLM Agents as General Programs19 Feb
Other references · 13
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
- 2025LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inferencecited by 119
- 2024Parrot: Efficient Serving of LLM-based Applications with Semantic Variablecited by 96
- 2019Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloadscited by 79
- 2020Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Providercited by 65
- 2021Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenterscited by 31
- 2025ModServe: Modality- and Stage-Aware Resource Disaggregation for Scalable Multimodal Model Servingcited by 18
- 2025JITServe: SLO-aware LLM Serving with Imprecise Request Informationcited by 17
- 2024Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Executioncited by 16
1 more
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Modelcited by 1
- 2026OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetchingcited by 0
- 2026A Contract-Centered Architecture for Scalable and Manageable Agentic Runtimescited by 0
- 2026Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read Itcited by 0
- 2026Analytical Power-Aware Provisioning for Prefill-Decode Disaggregated AI Inferencecited by 0
- 2026When Fancy Eviction Fails: Rethinking Cache Replacement For LLM Prefix Reusecited by 0
- 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agentscited by 0
- 2026ParallelPilot: Supporting Coordination and Monitoring in Parallel AI Codingcited by 0
- 2026Beyond Energy: When Sustainability Dimensions Reshape LLM Serving Decisionscited by 0
- 2026Beyond Energy: When Sustainability Dimensions Reshape LLM Serving Decisions28 Sep 2026
- 2026ParallelPilot: Supporting Coordination and Monitoring in Parallel AI Coding27 Sep 2026
- 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents26 Sep 2026
- 2026When Fancy Eviction Fails: Rethinking Cache Replacement For LLM Prefix Reuse24 Sep 2026
- 2026Analytical Power-Aware Provisioning for Prefill-Decode Disaggregated AI Inference21 Sep 2026
- 2026Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read It16 Sep 2026
- 2026A Contract-Centered Architecture for Scalable and Manageable Agentic Runtimes27 Aug 2026
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Model14 Aug 2026
- 2026OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching8 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Agentic AI Workload Characteristics
- 2026AgentPerfBench: A Benchmarking and Evaluation Suite for Inference Performance of Agentic LLMs
- 2026SWE-chat: Coding Agent Interactions From Real Users in the Wild
- 2026On the Impact of AGENTS.md Files on the Efficiency of AI Coding Agents
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks
- 2026CacheWise: Understanding Workloads and Optimizing KVCache Management for Efficiently Serving LLM Coding Agents
- 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agents
- 2026CodeComp: Structural KV Cache Compression for Agentic Coding