mlsanityData to 14 Oct 2026

The Carbon Cost of Conversation, Sustainability in the Age of Language Models

arXiv 2507.20018 ↗First posted 26 Jul 2025cs.CY cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) like GPT-3 and BERT have revolutionized natural language processing (NLP), yet their environmental costs remain dangerously overlooked. This article critiques the sustainability of LLMs, quantifying their carbon footprint, water usage, and contribution to e-waste through case studies of models such as GPT-4 and energy-efficient alternatives like Mistral 7B. Training a single LLM can emit carbon dioxide equivalent to hundreds of cars driven annually, while data centre cooling exacerbates water scarcity in vulnerable regions. Systemic challenges corporate greenwashing, redundant model development, and regulatory voids perpetuate harm, disproportionately burdening marginalized communities in the Global South. However, pathways exist for sustainable NLP: technical innovations (e.g., model pruning, quantum computing), policy reforms (carbon taxes, mandatory emissions reporting), and cultural shifts prioritizing necessity over novelty. By analysing industry leaders (Google, Microsoft) and laggards (Amazon), this work underscores the urgency of ethical accountability and global cooperation. Without immediate action, AIs ecological toll risks outpacing its societal benefits. The article concludes with a call to align technological progress with planetary boundaries, advocating for equitable, transparent, and regenerative AI systems that prioritize both human and environmental well-being.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 62 references that are in the map. First posted on arXiv 26 Jul 2025.

Builds on

21 of 62 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  6. 2023Mistral 7Bcited by 3,164
  7. 2019Advances and Open Problems in Federated Learningcited by 3,046
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  9. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
  10. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  11. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  12. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
9 more
  1. 2019Green AIcited by 627
  2. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 618
  3. 2021Carbon Emissions and Large Neural Network Trainingcited by 567
  4. 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 559
  5. 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
  6. 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 434
  7. 2020Movement Pruning: Adaptive Sparsity by Fine-Tuningcited by 403
  8. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
  9. 2020Chasing Carbon: The Elusive Environmental Footprint of Computingcited by 72

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.