mlsanityData to 7 Oct 2026

Industry Classification of GitHub Repositories Using the North American Industry Classification System (NAICS)

arXiv 2607.06505 ↗First posted 7 Jul 2026cs.SE cs.AI cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

GitHub hosts hundreds of millions of public repositories, but the platform exposes no native mapping from repositories to standardized industry sectors. This gap limits empirical work on the geography of innovation, the industrial composition of open-source production, and the diffusion of new technologies across economic sectors. We present NAICS-GH, a publicly released corpus of 6,588 GitHub repositories drawn from source pools covering the United States, the European Union, and Australia, each labeled with a 2-digit sector from the North American Industry Classification System (NAICS 2022). Labels are produced by a retrieve-and-verify pipeline that combines BAAI/bge-large-en embeddings, FAISS retrieval, and GPT-4.1 rubric scoring. The pipeline narrows about 1.37 million source repositories to 31,178 candidate repository-sector pairs and retains 6,588 high-confidence labels with score at least 8. Re-running the retrieval pipeline end to end reproduces the candidate set to within 0.03 percent. On a 2,421-repository human-validated random sample, the released labels attain 96.98 percent precision, with Wilson 95 percent confidence interval [96.23, 97.59]. We benchmark six pretrained encoders on the released corpus; RoBERTa-large reaches 86.45 percent F1 and 86.35 percent accuracy on a held-out 20 percent test set. The dataset, Croissant metadata, pipeline code, prompts, and fine-tuned checkpoint are released under CC-BY-4.0 and MIT licenses.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 38 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

14 of 38 references.

References · 14

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2017Billion-scale similarity search with GPUscited by 2,477
  3. 2018Datasheets for Datasetscited by 1,371
  4. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  5. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  6. 2016Data Programming: Creating Large Training Sets, Quicklycited by 246
  7. 2020Topic Recommendation for Software Repositories using Multi-label Classification Algorithmscited by 20
  8. 2025Cost-aware LLM-based Online Dataset Annotationcited by 4
  9. 2025FORGE: An LLM-driven Framework for Large-Scale Smart Contract Vulnerability Dataset Constructioncited by 4
  10. 2022GitRanking: A Ranking of GitHub Topics for Software Classification using Active Samplingcited by 3
  11. 2022Automatically Categorising GitHub Repositories by Application Domaincited by 2
  12. 2025LLM-based Content Classification Approach for GitHub Repositories by the README Filescited by 1
2 more
  1. 2026DRAGON: Robust Classification for Very Large Collections of Software Repositoriescited by 1
  2. 2026From Threads to Trajectories: A Multi-LLM Pipeline for Community Knowledge Extraction from GitHub Issue Discussionscited by 1

Built on by

Not cited yet.