mlsanityData to 14 Oct 2026

Where Should Agents Live? Energy-Memory Characterization of Agentic AI for the Edge-Cloud Continuum

arXiv 2609.18283 ↗First posted 16 Sep 2026cs.AI cs.LG cs.MAcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

As telecommunication networks evolve toward autonomous 5G-Advanced and 6G operations, agentic artificial intelligence (AI) workflows, where large language models (LLMs) execute multi-step reasoning, invoke diagnostic tools, retrieve domain knowledge, and coordinate across agent teams, are increasingly embedded across the edge-cloud continuum. While the biological brain accomplishes complex cognition on an exceptionally modest metabolic power budget of approximately 20W contemporary LLMs are profoundly energy- and memory-intensive, making sustainable lifecycle orchestration a critical operational priority. However, existing AI lifecycle metrics evaluate only isolated, single-model inferences or overlook multi-agent execution graphs entirely. Consequently, network operators lack foundational models to determine whether distributed agent communication incurs meaningful energy costs and where across edge-cloud tiers agent teams should physically reside. To address this gap, we introduce agentic-eCAL, generalizing the Energy Cost of AI Lifecycle (eCAL) metric to directed multi-agent workflows by coupling a closed-form two-rate single-call energy model (compute-bound prefill and memory-bound decode) with 7-layer OSI data transport. Grounded in hundreds of GPU benchmark configurations on NVIDIA A100 and H100, 16 open-weight models and 8 orchestration topologies, we validate components of the metric and study workflow placement implications. Our findings demonstrate that inter-agent text transport incurs 0.25% of workflow energy across 5G RAN, metro, and optical links. Therefore in edge-cloud agent placement the dominant energy cost of distribution is often not the transmission of inter-agent text itself, but the additional inference and context processing induced by that communication.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 36 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

20 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025S2-MAD: Breaking the Token Barrier to Enhance Multi-Agent Debate Efficiency7 Feb

Other references · 19

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  4. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
  5. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 191
  6. 2025Multi-agent Architecture Search via Agentic Supernetcited by 179
  7. 2023From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inferencecited by 170
  8. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systemscited by 88
  9. 2017Mobile Edge Computing: A Survey on Architecture and Computation Offloadingcited by 53
  10. 2021Brain-inspired computing: We need a master plancited by 51
  11. 2025The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimizationcited by 33
  12. 2025TokenPowerBench: Benchmarking the Power Consumption of LLM Inferencecited by 22
7 more
  1. 2025Characterizing LLM Inference Energy-Performance Tradeoffs across Workloads and GPU Scalingcited by 19
  2. 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergencecited by 17
  3. 2025Energy Use of AI Inference, Efficiency Pathways, and Test-Time Scalingcited by 13
  4. 2026Where Do the Joules Go? Diagnosing Inference Energy Consumptioncited by 10
  5. 2026SweetSpot: An Analytical Model for Predicting Energy Efficiency of LLM Inferencecited by 6
  6. 2024The Energy Cost of Artificial Intelligence Lifecycle in Communication Networkscited by 4
  7. 2026On the Effectiveness of Proposed Techniques to Reduce Energy Consumption in RAG Systems: A Controlled Experimentcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Networking-Aware Energy Efficiency in Agentic AI Inference: A Survey
  2. 2026Agentic Performance at the Edge: Insights from Benchmarking
  3. 2026Heterogeneous Computing: The Key to Powering the Future of AI Agent Inference
  4. 2026Energy per Successful Goal: Goal-Level Energy Accounting for Agentic AI Systems
  5. 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems
  6. 2025A Tutorial on Cognitive Biases in Agentic AI-Driven 6G Autonomous Networks
  7. 2026LIFE -- an energy efficient advanced continual learning agentic AI framework for frontier systems
  8. 2026CoMIC: Collaborative Memory and Insights Circulation for Long-Horizon LLM Agents in Cloud-Edge Systems