mlsanityData to 14 Oct 2026

Evaluation of ML Resource Utilization Requires Model Life Cycle Assessment

arXiv 2606.07632 ↗First posted 31 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Proper accounting of the energy requirements and environmental impact of artificial intelligence (AI) systems is necessary for researchers, developers, policy makers, and users to assess the barriers to building systems at scale. With the growing complexity of pipelines and underlying infrastructure needed to develop and deploy AI systems, previous approaches for evaluating AI efficiency which focus on the costs of a single training run or an individual inference prediction are no longer sufficient. In this position paper, we enunciate the need for applying life cycle assessment to evaluate the costs of the machine learning model development and deployment pipeline to properly account for the required resources and downstream impact. Life cycle assessments enable the incorporation of costs across the full life cycle of an AI system and its underlying infrastructure, from the embodied costs associated with the physical computing hardware through the operational costs in training and inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 92 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

50 of 92 references.

References · 50

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  4. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  5. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  6. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  7. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  8. 2018Model Cards for Model Reportingcited by 1,080
  9. 2020Efficient Transformers: A Surveycited by 790
  10. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 618
  11. 2021Carbon Emissions and Large Neural Network Trainingcited by 567
  12. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
38 more
  1. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
  2. 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
  3. 2019MLPerf Inference Benchmarkcited by 199
  4. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 191
  5. 2023Efficient Large Language Models: A Surveycited by 186
  6. 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 184
  7. 2021Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Bettercited by 154
  8. 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
  9. 2019MLPerf Training Benchmarkcited by 115
  10. 2024DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiencycited by 112
  11. 2022Measuring the Carbon Intensity of AI in Cloud Instancescited by 111
  12. 2021The Efficiency Misnomercited by 98
  13. 2022Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Trainingcited by 79
  14. 2022Efficient Methods for Natural Language Processing: A Surveycited by 78
  15. 2023A Systematic Review of Green AIcited by 77
  16. 2020Chasing Carbon: The Elusive Environmental Footprint of Computingcited by 72
  17. 2024Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inferencecited by 61
  18. 2025Energy Considerations of Large Language Model Inference and Efficiency Optimizationscited by 55
  19. 2023Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Modelscited by 44
  20. 2025Measuring the environmental impact of delivering AI at Google Scalecited by 32
  21. 2025Holistically Evaluating the Environmental Impact of Creating Language Modelscited by 26
  22. 2021Towards Green Automated Machine Learning: Status Quo and Future Directionscited by 25
  23. 2025From Efficiency Gains to Rebound Effects: The Problem of Jevons' Paradox in AI's Polarized Environmental Debatecited by 23
  24. 2023Reducing Energy Bloat in Large Model Trainingcited by 22
  25. 2025EcoServe: Designing Carbon-Aware AI Inference Systemscited by 19
  26. 2024MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AIcited by 16
  27. 2023MAD Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systemscited by 14
  28. 2024Foundation Model Transparency Reportscited by 14
  29. 2025Energy Use of AI Inference, Efficiency Pathways, and Test-Time Scalingcited by 13
  30. 2024Towards Sustainable Large Language Model Servingcited by 12
  31. 2023The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deploymentcited by 11
  32. 2025Unveiling Environmental Impacts of Large Language Model Serving: A Functional Unit Viewcited by 11
  33. 2024GreenLLM: Disaggregating Large Language Model Serving on Heterogeneous GPUs for Lower Carbon Emissionscited by 10
  34. 2025Life-Cycle Emissions of AI Hardware: A Cradle-To-Grave Approach and Generational Trendscited by 10
  35. 2025CATransformers: Carbon Aware Transformers Through Joint Model-Hardware Optimizationcited by 7
  36. 2023Carbon Responder: Coordinating Demand Response for the Datacenter Fleetcited by 5
  37. 2024Estimating Environmental Cost Throughout Model's Adaptive Life Cyclecited by 2
  38. 2025Modeling PFAS in Semiconductor Manufacturing to Quantify Trade-offs in Energy Efficiency and Environmental Impact of Computing Systemscited by 1

Built on by

Not cited yet.