mlsanityData to 7 Oct 2026

Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI

arXiv 2309.02065 ↗First posted 5 Sep 2023cs.LG cs.CY stat.MLcited by 12

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence (AI) is currently spearheaded by machine learning (ML) methods such as deep learning which have accelerated progress on many tasks thought to be out of reach of AI. These recent ML methods are often compute hungry, energy intensive, and result in significant green house gas emissions, a known driver of anthropogenic climate change. Additionally, the platforms on which ML systems run are associated with environmental impacts that go beyond the energy consumption driven carbon emissions. The primary solution lionized by both industry and the ML community to improve the environmental sustainability of ML is to increase the compute and energy efficiency with which ML systems operate. In this perspective, we argue that it is time to look beyond efficiency in order to make ML more environmentally sustainable. We present three high-level discrepancies between the many variables that influence the efficiency of ML and the environmental sustainability of ML. Firstly, we discuss how compute efficiency does not imply energy efficiency or carbon efficiency. Second, we present the unexpected effects of efficiency on operational emissions throughout the ML model life cycle. And, finally, we explore the broader environmental impacts that are not accounted by efficiency. These discrepancies show as to why efficiency alone is not enough to remedy the adverse environmental impacts of ML. Instead, we argue for systems thinking as the next step towards holistically improving the environmental sustainability of ML.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 45 of its 104 references that are in the map. First posted on arXiv 5 Sep 2023.

Builds on

45 of 104 references.

References · 45

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Knowledge Distillation: A Surveycited by 1,578
  4. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  5. 2017Mixed Precision Trainingcited by 1,135
  6. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  7. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
  8. 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
  9. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  10. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 610
  11. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  12. 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
33 more
  1. 2015Deep Learning with Limited Numerical Precisioncited by 368
  2. 2019Tackling Climate Change with Machine Learningcited by 264
  3. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 264
  4. 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
  5. 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 253
  6. 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 246
  7. 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
  8. 2020The Computational Limits of Deep Learningcited by 188
  9. 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 183
  10. 2019The Evolved Transformercited by 180
  11. 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 168
  12. 2022Compute Trends Across Three Eras of Machine Learningcited by 161
  13. 2016Designing Energy-Efficient Convolutional Neural Networks using Energy-Aware Pruningcited by 133
  14. 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
  15. 2023Dataset Distillation: A Comprehensive Reviewcited by 126
  16. 2022Measuring the Carbon Intensity of AI in Cloud Instancescited by 110
  17. 2023A Systematic Review of Green AIcited by 77
  18. 2020Chasing Carbon: The Elusive Environmental Footprint of Computingcited by 71
  19. 2021Compute and Energy Consumption Trends in Deep Learning Inferencecited by 61
  20. 2022Eco2AI: carbon emissions tracking of machine learning models as the first step towards sustainable AIcited by 58
  21. 2020Measuring the Algorithmic Efficiency of Neural Networkscited by 51
  22. 2023Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learningcited by 42
  23. 2022Compute-Efficient Deep Learning: Algorithmic Trends and Opportunitiescited by 38
  24. 2021Unraveling the Hidden Environmental Impacts of AI Solutions for Environmentcited by 32
  25. 2018Constructing Fast Network through Deconstruction of Convolutioncited by 24
  26. 2022Towards Climate Awareness in NLP Researchcited by 19
  27. 2023Uncovering Energy-Efficient Practices in Deep Learning Training: Preliminary Steps Towards Green AIcited by 16
  28. 2022Exploring Extreme Parameter Compression for Pre-trained Language Modelscited by 15
  29. 2022EC-NAS: Energy Consumption Aware Tabular Benchmarks for Neural Architecture Searchcited by 11
  30. 2023Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluationcited by 7
  31. 2018Diagonalwise Refactorization: An Efficient Training Method for Depthwise Convolutionscited by 6
  32. 2022Trends in Energy Estimates for Computing in AI/Machine Learning Accelerators, Supercomputers, and Compute-Intensive Applicationscited by 5
  33. 2023Broadening the perspective for sustainable AI: Comprehensive sustainability criteria and indicators for AI systemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 5; 2026: 3.

12 papers.