The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inference
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly deployed in multilingual settings, yet the energy costs of serving these models across different languages remain poorly understood. We present a systematic study of inference energy consumption across languages with ML.Energy framework (Chung et al., 2026). We find striking disparities: energy consumption per output token varies by up to 8.3 times across languages, while total energy for a fixed set of requests varies by up to 179 times between the cheapest (English, 17.6 kJ) and the most expensive (Pashto, 3,147 kJ) languages. Our analysis shows that this disparity is driven by two compounding factors: (1) higher per-token energy costs for languages using complex or rare scripts, and (2) more tokens generated for low-resource languages. Moreover, we find a double cost + performance penalty: languages with the highest energy footprints also tend to achieve the lowest task accuracy. We reveal that the energy divide persists across models, hardware, and tasks, suggesting a systemic energy inequity in multilingual LLM deployment. Finally, we recommend that the community treat energy as a first-class evaluation axis, extend reporting checklists and model cards to include it, and adopt deployment-side mitigations for better energy efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 68 references that are in the map. First posted on arXiv 20 Jun 2026.
Builds on
44 of 68 references.
References · 44
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
- 2019Green AIcited by 627
32 more
- 2024DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Servingcited by 617
- 2024Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Servecited by 526
- 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
- 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
- 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
- 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 192
- 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 191
- 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 184
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 171
- 2024NanoFlow: Towards Optimal Large Language Model Serving Throughputcited by 90
- 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 86
- 2022Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Trainingcited by 79
- 2022Impact of Tokenization on Language Models: An Analysis for Turkishcited by 62
- 2019Positional Encoding to Control Output Sequence Lengthcited by 56
- 2021Are Multilingual Models Effective in Code-Switching?cited by 56
- 2020Consistency of a Recurrent Language Model With Respect to Incomplete Decodingcited by 54
- 2021Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLPcited by 47
- 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 43
- 2025The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimizationcited by 33
- 2024Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Modelscited by 31
- 2020Revisiting Round-Trip Translation for Quality Estimationcited by 24
- 2024GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levelscited by 21
- 2024Egalitarian Language Representation in Language Models: It All Begins with Tokenizerscited by 20
- 2020Verified Instruction-Level Energy Consumption Measurement for NVIDIA GPUscited by 10
- 2026Where Do the Joules Go? Diagnosing Inference Energy Consumptioncited by 10
- 2023Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotationcited by 7
- 2025The AI Language Proficiency Monitor -- Tracking the Progress of LLMs on Multilingual Benchmarkscited by 7
- 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languagescited by 5
- 2025Cornfigurator: Automated Planning for Any-to-Any Multimodal Model Servingcited by 4
- 2026ESTAR: Early-Stopping Token-Aware Reasoning For Efficient Inferencecited by 3
Built on by
Not cited yet.