mlsanityData to 14 Oct 2026

The AI Community Building the Future? A Quantitative Analysis of Development Activity on Hugging Face Hub

arXiv 2405.13058 ↗First posted 20 May 2024cs.SE cs.AI cs.CYcited by 18

Not on the map. Why?

Abstract (arXiv)

Open model developers have emerged as key actors in the political economy of artificial intelligence (AI), but we still have a limited understanding of collaborative practices in the open AI ecosystem. This paper responds to this gap with a three-part quantitative analysis of development activity on the Hugging Face (HF) Hub, a popular platform for building, sharing, and demonstrating models. First, various types of activity across 348,181 model, 65,761 dataset, and 156,642 space repositories exhibit right-skewed distributions. Activity is extremely imbalanced between repositories; for example, over 70% of models have 0 downloads, while 1% account for 99% of downloads. Furthermore, licenses matter: there are statistically significant differences in collaboration patterns in model repositories with permissive, restrictive, and no licenses. Second, we analyse a snapshot of the social network structure of collaboration in model repositories, finding that the community has a core-periphery structure, with a core of prolific developers and a majority of isolate developers (89%). Upon removing the isolate developers from the network, collaboration is characterised by high reciprocity regardless of developers' network positions. Third, we examine model adoption through the lens of model usage in spaces, finding that a minority of models, developed by a handful of companies, are widely used on the HF Hub. Overall, activity on the HF Hub is characterised by Pareto distributions, congruent with OSS development patterns on platforms like GitHub. We conclude with recommendations for researchers, companies, and policymakers to advance our understanding of open AI development.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 25 of its 146 references that are in the map. First posted on arXiv 20 May 2024.

Builds on

25 of 146 references.

References · 25

  1. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  2. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
  3. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  4. 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 158
  5. 2019Deep Learning for Deepfakes Creation and Detection: A Surveycited by 102
  6. 2024On the Societal Impact of Open Foundation Modelscited by 65
  7. 2023The Gradient of Generative AI Release: Methods and Considerationscited by 63
  8. 2023Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generatorscited by 56
  9. 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectivescited by 31
  10. 2023Typhoon: Thai Large Language Modelscited by 30
  11. 2023Democratising AI: Multiple Meanings, Goals, and Methodscited by 29
  12. 2023Exploring the Carbon Footprint of Hugging Face's ML Models: A Repository Mining Studycited by 23
13 more
  1. 2023Analyzing the Evolution and Maintenance of ML Models on Hugging Facecited by 22
  2. 2023A Cost Analysis of Generative Language Models and Influence Operationscited by 17
  3. 2024Risks and Opportunities of Open-Source Generative AIcited by 13
  4. 2022BigScience: A Case Study in the Social Construction of a Multilingual Large Language Modelcited by 11
  5. 2023Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediariescited by 9
  6. 2023On the Suitability of Hugging Face Hub for Empirical Studiescited by 8
  7. 2023Towards Openness Beyond Open Access: User Journeys through 3 Open AI Collaborativescited by 7
  8. 2024Public-private funding models in open source software development: A case study on scikit-learncited by 5
  9. 2018Do software firms collaborate or compete? A model of coopetition in community-initiated OSS projectscited by 4
  10. 2023To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processingcited by 4
  11. 2014Collaboration in the open-source arena: The WebKit casecited by 3
  12. 2022How Firms Adapt and Interact in Open Source Ecosystems: Analyzing Stakeholder Influence and Collaboration Patternscited by 3
  13. 2023The Cybersecurity Crisis of Artificial Intelligence: Unrestrained Adoption and Natural Language-Based Attackscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 6; 2025: 8; 2026: 4.

18 papers.

Sort:

By area:

  1. 2025OptunaHub: A Platform for Black-Box Optimizationcited by 14
  2. 2024The Future of Open Human Feedbackcited by 10
  3. 2025Atlas: A Framework for ML Lifecycle Provenance & Transparencycited by 8
  4. 2025HuggingGraph: Understanding the Supply Chain of LLM Ecosystemcited by 8
  5. 2024Why Companies "Democratise" Artificial Intelligence: The Case of Open Source Software Donationscited by 4
  6. 2024Compliance Cards: Automated EU AI Act Compliance Analyses amidst a Complex AI Supply Chaincited by 3
  7. 2024Characterising Open Source Co-opetition in Company-hosted Open Source Software Projects: The Cases of PyTorch, TensorFlow, and Transformerscited by 3
  8. 2025FIGhost: Fluorescent Ink-based Stealthy and Flexible Backdoor Attacks on Physical Traffic Sign Recognitioncited by 1
  9. 2025A Cartography of Open Collaboration in Open Source AI: Mapping Practices, Motivations, and Governance in 14 Open Large Language Model Projectscited by 1
  10. 2026Computational Compliance for AI Regulation: Blueprint for a New Research Domaincited by 1
  11. 2026Discovering Hidden Gems in Model Repositoriescited by 1
  12. 2026The Shrinking Lifespan of LLMs in Sciencecited by 1
6 more
  1. 2024Responsible AI in Open Ecosystems: Reconciling Innovation with Risk Assessment and Disclosurecited by 0
  2. 2024A Practical Approach to Underwater Depth and Surface Normals Estimationcited by 0
  3. 2025Beyond Trusting Trust: Multi-Model Validation for Robust Code Generationcited by 0
  4. 2025Opening the Scope of Openness in AIcited by 0
  5. 2025MixtureKit: A General Framework for Composing, Training, and Visualizing Mixture-of-Experts Modelscited by 0
  6. 2026Critically Engaged Pragmatism: Scientific Norm and Social, Pragmatist Epistemology for AI Science Evaluation Toolscited by 0