mlsanityData to 7 Oct 2026

How Hyper-Datafication Impacts the Sustainability Costs in Frontier AI

arXiv 2602.00056 ↗First posted 20 Jan 2026cs.CY cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Large-scale data has fuelled the success of frontier artificial intelligence (AI) models over the past decade. This expansion has relied on sustained efforts by large technology corporations to aggregate and curate internet-scale datasets. In this work, we examine the environmental, social, and economic costs of large-scale data in AI through a sustainability lens. We argue that the field is shifting from building models from data to actively creating data for building models. We characterise this transition as hyper-datafication, which marks a critical juncture for the future of frontier AI and its societal impacts. To quantify and contextualise data-related costs, we analyse approximately 550,000 datasets from the Hugging Face Hub, focusing on dataset growth, storage-related energy consumption and carbon footprint, and societal representation using language data. We complement this analysis with qualitative responses from data workers in Kenya to examine the labour involved, including direct employment by big tech corporations and exposure to graphic content. We further draw on external data sources to substantiate our findings by illustrating the global disparity in data centre infrastructure. Our analyses reveal that hyper-datafication drives substantial and growing environmental costs while systematically redistributing labour risks and representational harms toward the Global South. Thus, we propose Data PROOFS recommendations spanning provenance, resource awareness, ownership, openness, frugality, and standards to mitigate these costs. Our work aims to make visible the often-overlooked costs of data that underpin frontier AI and to stimulate broader debate within the research community and beyond.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 117 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

38 of 117 references.

References · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2020Scaling Laws for Neural Language Modelscited by 6,411
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  6. 2016Deep Learning with Differential Privacycited by 2,682
  7. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  8. 2018Datasheets for Datasetscited by 1,371
  9. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
  10. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  11. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  12. 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 519
26 more
  1. 2023Scaling Data-Constrained Language Modelscited by 391
  2. 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 381
  3. 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 323
  4. 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 269
  5. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 264
  6. 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 246
  7. 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
  8. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 186
  9. 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 168
  10. 2022Compute Trends Across Three Eras of Machine Learningcited by 161
  11. 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
  12. 2020The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Researchcited by 67
  13. 2023Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Modelscited by 44
  14. 2023Using Sequences of Life-events to Predict Human Livescited by 27
  15. 2024Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on Hugging Facecited by 27
  16. 2022Whose AI Dream? In search of the aspiration in data annotationcited by 24
  17. 2023Analyzing the Evolution and Maintenance of ML Models on Hugging Facecited by 22
  18. 2022Personalized visual encoding model construction with small datacited by 12
  19. 2023Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AIcited by 12
  20. 2022EC-NAS: Energy Consumption Aware Tabular Benchmarks for Neural Architecture Searchcited by 11
  21. 2025More than Carbon: Cradle-to-Grave environmental impacts of GenAI training on the Nvidia A100 GPUcited by 10
  22. 2024Environmental Burden of United States Data Centers in the Artificial Intelligence Eracited by 5
  23. 2024Automated categorization of pre-trained models for software engineering: A case study with a Hugging Face datasetcited by 3
  24. 2026A Sustainable AI Economy Needs Data Deals That Work for Generatorscited by 3
  25. 2023Making Data Work Countcited by 2
  26. 2025Position: Neglecting the Sustainability of AI is Fuelling a Global AI Arms Racecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.