Energy per Successful Goal: Goal-Level Energy Accounting for Agentic AI Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Current AI energy benchmarks measure consumption at the granularity of a single model invocation or training run. For classical single-turn workloads this unit remains coherent. For agentic systems - where a single user goal may trigger multi-step orchestration, tool calls, retries, and failure-recovery cycles - the invocation count is an implementation artifact rather than a task property, and inference-level normalization misrepresents the energy cost of goal completion. We present A-LEMS (Agentic LLM Energy Measurement System), a cross-layer measurement framework that redefines the unit of AI energy accounting from energy per inference to Energy per Successful Goal (EpG). EpG aggregates total workflow energy across all execution attempts, including failures and retries, normalized by successfully completed goals. A-LEMS formalizes energy attribution through a temporal boundary model, a five-layer observation pipeline mapping RAPL signals to workflow-level energy, and a reproducibility protocol binding every measurement to hardware and runtime configuration. Building on EpG, we define the Orchestration Overhead Index (OOI), isolating the energy cost of orchestration relative to linear execution under identical task criteria. Across five reasoning and three tool-augmented task families, agentic workflows consume 4.33x higher mean energy per successful goal than linear baselines (888.1 J vs 205.3 J). This overhead is driven by orchestration structure, not inference compute. For tool-augmented tasks, OOI inverts below 1.0x: agentic execution is cheaper than linear, confirming the metric captures orchestration structure rather than a fixed upward bias. These findings establish that energy-per-inference is insufficient for agentic AI. EpG and OOI provide the measurement foundation for accurate benchmarking, where orchestration structure is the primary determinant of energy cost.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 15 of its 40 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
15 of 40 references.
References · 15
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 318
- 2019MLPerf Training Benchmarkcited by 114
- 2025How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencecited by 73
- 2025The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimizationcited by 31
- 2024MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AIcited by 15
- 2025Energy Use of AI Inference, Efficiency Pathways, and Test-Time Scalingcited by 12
- 2025BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesiscited by 6
- 2025Towards Understanding, Analyzing, and Optimizing Agentic AI Execution: A CPU-Centric Perspectivecited by 3
- 2022Understanding Power and Energy Utilization in Large Scale Production Physics Simulation Codescited by 1
3 more
- 2023SPEChpc 2021 Benchmarks on Ice Lake and Sapphire Rapids Infiniband Clusters: A Performance and Energy Case Studycited by 1
- 2025Strategies to Measure Energy Consumption Using RAPL During Workflow Execution on Commodity Clusterscited by 1
- 2025Harvesting energy consumption on European HPC systems: Sharing Experience from the CEEC projectcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Where Should Agents Live? Energy-Memory Characterization of Agentic AI for the Edge-Cloud Continuum
- 2026Watts and Debts of Agentic Frameworks: An Empirical Study (Registered Report)
- 2026Where Does the Energy Go? Profiling LLM Agent Inference on Blackwell GPUs ↗
- 2025How Do Agentic AI Systems Deal With Software Energy Concerns? A Pull Request-Based Study
- 2026From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systems
- 2025Beyond Accuracy: A Multi-Dimensional Framework for Evaluating Enterprise Agentic AI Systems
- 2026Networking-Aware Energy Efficiency in Agentic AI Inference: A Survey
- 2026AgentSLABench: Evaluating and Benchmarking Agentic Systems Under Resource Constraints