mlsanityData to 14 Oct 2026

The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inference

arXiv 2606.21869 ↗First posted 20 Jun 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed in multilingual settings, yet the energy costs of serving these models across different languages remain poorly understood. We present a systematic study of inference energy consumption across languages with ML.Energy framework (Chung et al., 2026). We find striking disparities: energy consumption per output token varies by up to 8.3 times across languages, while total energy for a fixed set of requests varies by up to 179 times between the cheapest (English, 17.6 kJ) and the most expensive (Pashto, 3,147 kJ) languages. Our analysis shows that this disparity is driven by two compounding factors: (1) higher per-token energy costs for languages using complex or rare scripts, and (2) more tokens generated for low-resource languages. Moreover, we find a double cost + performance penalty: languages with the highest energy footprints also tend to achieve the lowest task accuracy. We reveal that the energy divide persists across models, hardware, and tasks, suggesting a systemic energy inequity in multilingual LLM deployment. Finally, we recommend that the community treat energy as a first-class evaluation axis, extend reporting checklists and model cards to include it, and adopt deployment-side mitigations for better energy efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 68 references that are in the map. First posted on arXiv 20 Jun 2026.

Builds on

44 of 68 references.

References · 44

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  6. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  7. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  8. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  9. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  10. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
  11. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  12. 2019Green AIcited by 627
32 more
  1. 2024DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Servingcited by 617
  2. 2024Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Servecited by 526
  3. 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
  4. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
  5. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
  6. 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
  7. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 192
  8. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 191
  9. 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 184
  10. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
  11. 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 171
  12. 2024NanoFlow: Towards Optimal Large Language Model Serving Throughputcited by 90
  13. 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 86
  14. 2022Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Trainingcited by 79
  15. 2022Impact of Tokenization on Language Models: An Analysis for Turkishcited by 62
  16. 2019Positional Encoding to Control Output Sequence Lengthcited by 56
  17. 2021Are Multilingual Models Effective in Code-Switching?cited by 56
  18. 2020Consistency of a Recurrent Language Model With Respect to Incomplete Decodingcited by 54
  19. 2021Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLPcited by 47
  20. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 43
  21. 2025The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimizationcited by 33
  22. 2024Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Modelscited by 31
  23. 2020Revisiting Round-Trip Translation for Quality Estimationcited by 24
  24. 2024GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levelscited by 21
  25. 2024Egalitarian Language Representation in Language Models: It All Begins with Tokenizerscited by 20
  26. 2020Verified Instruction-Level Energy Consumption Measurement for NVIDIA GPUscited by 10
  27. 2026Where Do the Joules Go? Diagnosing Inference Energy Consumptioncited by 10
  28. 2023Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotationcited by 7
  29. 2025The AI Language Proficiency Monitor -- Tracking the Progress of LLMs on Multilingual Benchmarkscited by 7
  30. 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languagescited by 5
  31. 2025Cornfigurator: Automated Planning for Any-to-Any Multimodal Model Servingcited by 4
  32. 2026ESTAR: Early-Stopping Token-Aware Reasoning For Efficient Inferencecited by 3

Built on by

Not cited yet.