Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) is currently spearheaded by machine learning (ML) methods such as deep learning which have accelerated progress on many tasks thought to be out of reach of AI. These recent ML methods are often compute hungry, energy intensive, and result in significant green house gas emissions, a known driver of anthropogenic climate change. Additionally, the platforms on which ML systems run are associated with environmental impacts that go beyond the energy consumption driven carbon emissions. The primary solution lionized by both industry and the ML community to improve the environmental sustainability of ML is to increase the compute and energy efficiency with which ML systems operate. In this perspective, we argue that it is time to look beyond efficiency in order to make ML more environmentally sustainable. We present three high-level discrepancies between the many variables that influence the efficiency of ML and the environmental sustainability of ML. Firstly, we discuss how compute efficiency does not imply energy efficiency or carbon efficiency. Second, we present the unexpected effects of efficiency on operational emissions throughout the ML model life cycle. And, finally, we explore the broader environmental impacts that are not accounted by efficiency. These discrepancies show as to why efficiency alone is not enough to remedy the adverse environmental impacts of ML. Instead, we argue for systems thinking as the next step towards holistically improving the environmental sustainability of ML.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 45 of its 104 references that are in the map. First posted on arXiv 5 Sep 2023.
Builds on
45 of 104 references.
References · 45
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2017Mixed Precision Trainingcited by 1,135
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 610
- 2021Carbon Emissions and Large Neural Network Trainingcited by 561
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
33 more
- 2015Deep Learning with Limited Numerical Precisioncited by 368
- 2019Tackling Climate Change with Machine Learningcited by 264
- 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 264
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 253
- 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 246
- 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
- 2020The Computational Limits of Deep Learningcited by 188
- 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 183
- 2019The Evolved Transformercited by 180
- 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 168
- 2022Compute Trends Across Three Eras of Machine Learningcited by 161
- 2016Designing Energy-Efficient Convolutional Neural Networks using Energy-Aware Pruningcited by 133
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
- 2023Dataset Distillation: A Comprehensive Reviewcited by 126
- 2022Measuring the Carbon Intensity of AI in Cloud Instancescited by 110
- 2023A Systematic Review of Green AIcited by 77
- 2020Chasing Carbon: The Elusive Environmental Footprint of Computingcited by 71
- 2021Compute and Energy Consumption Trends in Deep Learning Inferencecited by 61
- 2022Eco2AI: carbon emissions tracking of machine learning models as the first step towards sustainable AIcited by 58
- 2020Measuring the Algorithmic Efficiency of Neural Networkscited by 51
- 2023Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learningcited by 42
- 2022Compute-Efficient Deep Learning: Algorithmic Trends and Opportunitiescited by 38
- 2021Unraveling the Hidden Environmental Impacts of AI Solutions for Environmentcited by 32
- 2018Constructing Fast Network through Deconstruction of Convolutioncited by 24
- 2022Towards Climate Awareness in NLP Researchcited by 19
- 2023Uncovering Energy-Efficient Practices in Deep Learning Training: Preliminary Steps Towards Green AIcited by 16
- 2022Exploring Extreme Parameter Compression for Pre-trained Language Modelscited by 15
- 2022EC-NAS: Energy Consumption Aware Tabular Benchmarks for Neural Architecture Searchcited by 11
- 2023Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluationcited by 7
- 2018Diagonalwise Refactorization: An Efficient Training Method for Depthwise Convolutionscited by 6
- 2022Trends in Energy Estimates for Computing in AI/Machine Learning Accelerators, Supercomputers, and Compute-Intensive Applicationscited by 5
- 2023Broadening the perspective for sustainable AI: Comprehensive sustainability criteria and indicators for AI systemscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 5; 2026: 3.
12 papers.
- 2025Greening AI-enabled Systems with Software Engineering: A Research Agenda for Environmentally Sustainable AI Practicescited by 8
- 2023Activation Compression of Graph Neural Networks using Block-wise Quantization with Improved Variance Minimizationcited by 4
- 2024PePR: Performance Per Resource Unit as a Metric to Promote Small-Scale Deep Learning in Medical Image Analysiscited by 4
- 2024BMRS: Bayesian Model Reduction for Structured Pruningcited by 2
- 2025Position: Neglecting the Sustainability of AI is Fuelling a Global AI Arms Racecited by 2
- 2024Is Adversarial Training with Compressed Datasets Effective?cited by 1
- 2025Can We Make Code Green? Understanding Trade-Offs in LLMs vs. Human Code Optimizationscited by 1
- 2026How Hyper-Datafication Impacts the Sustainability Costs in Frontier AIcited by 1
- 2025The HCI GenAI CO2ST Calculator: A Tool for Calculating the Carbon Footprint of Generative AI Use in Human-Computer Interaction Researchcited by 0
- 2025Green AI: A systematic review and meta-analysis of its definitions, lifecycle models, hardware and measurement attemptscited by 0
- 2026Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AIcited by 0
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centeredcited by 0
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centered9 Jun 2026
- 2026Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AI23 Feb 2026
- 2026How Hyper-Datafication Impacts the Sustainability Costs in Frontier AI20 Jan 2026
- 2025Green AI: A systematic review and meta-analysis of its definitions, lifecycle models, hardware and measurement attempts10 Nov 2025
- 2025Greening AI-enabled Systems with Software Engineering: A Research Agenda for Environmentally Sustainable AI Practices2 Jun 2025
- 2025The HCI GenAI CO2ST Calculator: A Tool for Calculating the Carbon Footprint of Generative AI Use in Human-Computer Interaction Research1 Apr 2025
- 2025Can We Make Code Green? Understanding Trade-Offs in LLMs vs. Human Code Optimizations26 Mar 2025
- 2025Position: Neglecting the Sustainability of AI is Fuelling a Global AI Arms Race27 Feb 2025
- 2024BMRS: Bayesian Model Reduction for Structured Pruning3 Jun 2024
- 2024PePR: Performance Per Resource Unit as a Metric to Promote Small-Scale Deep Learning in Medical Image Analysis19 Mar 2024
- 2024Is Adversarial Training with Compressed Datasets Effective?8 Feb 2024
- 2023Activation Compression of Graph Neural Networks using Block-wise Quantization with Improved Variance Minimization21 Sep 2023