Tokenomics: Quantifying Where Tokens Are Used in Agentic Software Engineering
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
LLM-based Multi-Agent (LLM-MA) systems are increasingly applied to automate complex software engineering tasks such as requirements engineering, code generation, and testing. However, their operational efficiency and resource consumption remain poorly understood, hindering practical adoption due to unpredictable costs and environmental impact. To address this, we conduct an analysis of token consumption patterns in an LLM-MA system within the Software Development Life Cycle (SDLC), aiming to understand where tokens are consumed across distinct software engineering activities. We analyze execution traces from 30 software development tasks performed by the ChatDev framework using a GPT-5 reasoning model, mapping its internal phases to distinct development stages (Design, Coding, Code Completion, Code Review, Testing, and Documentation) to create a standardized evaluation framework. We then quantify and compare token distribution (input, output, reasoning) across these stages. Our preliminary findings show that the iterative Code Review stage accounts for the majority of token consumption for an average of 59.4% of tokens. Furthermore, we observe that input tokens consistently constitute the largest share of consumption for an average of 53.9%, providing empirical evidence for potentially significant inefficiencies in agentic collaboration. Our results suggest that the primary cost of agentic software engineering lies not in initial code generation but in automated refinement and verification. Our novel methodology can help practitioners predict expenses and optimize workflows, and it directs future research toward developing more token-efficient agent collaboration protocols.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 21 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
6 of 21 references.
Closest ancestors · 1
Same direction, newest first
Other references · 5
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Taskscited by 20
- 2025Rethinking Autonomy: Preventing Failures in AI-Driven Software Engineeringcited by 4
- 2025Co-Saving: Resource Aware Multi-Agent Collaboration for Software Developmentcited by 3
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Taskscited by 33
- 2026Token Economics for LLM Agents: A Dual-View Study from Computing and Economicscited by 6
- 2026From Logic Monopoly to Social Contract: Separation of Power and the Institutional Foundations for Autonomous Agent Economiescited by 3
- 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluationcited by 2
- 2026AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflowscited by 2
- 2026CAM: A Causality-based Analysis Framework for Multi-Agent Code Generation Systemscited by 1
- 2026Does Code Cleanliness Affect Coding Agents? A Controlled Minimal-Pair Studycited by 1
- 2026The Best Programming Language for Tokenmaxxing: An Investigation of Coding Agent Behavior Across Programming Languagescited by 1
- 2026CodeJeNN: A simple C++ neural network generator for physics applicationscited by 0
- 2026AgentDecarbonizer: Carbon-Aware Execution for AI Agentscited by 0
- 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agentscited by 0
- 2026TokenCast: Forecasting Token Consumption During LLM Agent Executioncited by 0
- 2026TokenCast: Forecasting Token Consumption During LLM Agent Execution28 Sep 2026
- 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents25 Sep 2026
- 2026AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflows19 Sep 2026
- 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluation25 Aug 2026
- 2026AgentDecarbonizer: Carbon-Aware Execution for AI Agents20 Aug 2026
- 2026The Best Programming Language for Tokenmaxxing: An Investigation of Coding Agent Behavior Across Programming Languages24 Jul 2026
- 2026CodeJeNN: A simple C++ neural network generator for physics applications2 Jul 2026
- 2026Does Code Cleanliness Affect Coding Agents? A Controlled Minimal-Pair Study19 May 2026
- 2026Token Economics for LLM Agents: A Dual-View Study from Computing and Economics9 May 2026
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks24 Apr 2026
- 2026From Logic Monopoly to Social Contract: Separation of Power and the Institutional Foundations for Autonomous Agent Economies26 Mar 2026
- 2026CAM: A Causality-based Analysis Framework for Multi-Agent Code Generation Systems2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026LLM-Based Agentic Systems for Software Engineering: Challenges and Opportunities
- 2025Designing LLM-based Multi-Agent Systems for Software Engineering Tasks: Quality Attributes, Design Patterns and Rationale
- 2026Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas
- 2026Code Health in LLM-Based Test Generation: Effectiveness and Token Efficiency
- 2025LoCoBench-Agent: An Interactive Benchmark for LLM Agents in Long-Context Software Engineering
- 2026TraceLab: Characterizing Coding Agent Workloads for LLM Serving
- 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories
- 2026Evaluating LLM Agents on Automated Software Analysis Tasks