mlsanityData to 7 Oct 2026

Data Governance in the Age of Large-Scale Data-Driven Language Technology

arXiv 2206.03216 ↗First posted 4 May 2022cs.CY cs.AI cs.CLcited by 32

Not on the map. Why?

Abstract (arXiv)

The recent emergence and adoption of Machine Learning technology, and specifically of Large Language Models, has drawn attention to the need for systematic and transparent management of language data. This work proposes an approach to global language data governance that attempts to organize data management amongst stakeholders, values, and rights. Our proposal is informed by prior work on distributed governance that accounts for human values and grounded by an international research collaboration that brings together researchers and practitioners from 60 countries. The framework we present is a multi-party international governance structure focused on language data, and incorporating technical and organizational tools needed to support its work.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 49 of its 158 references that are in the map. First posted on arXiv 4 May 2022.

Builds on

49 of 158 references.

References · 49

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  6. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  7. 2018Deep contextualized word representationscited by 2,285
  8. 2020Extracting Training Data from Large Language Modelscited by 2,144
  9. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  10. 2018Datasheets for Datasetscited by 1,371
  11. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  12. 2018Model Cards for Model Reportingcited by 1,068
37 more
  1. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  2. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  3. 2021Datasets: A Community Library for Natural Language Processingcited by 526
  4. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
  5. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  6. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 326
  7. 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 318
  8. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
  9. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
  10. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  11. 2020Large image datasets: A pyrrhic win for computer vision?cited by 237
  12. 2021Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Modelscited by 227
  13. 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 208
  14. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
  15. 2021The Values Encoded in Machine Learning Researchcited by 172
  16. 2019Show Your Work: Improved Reporting of Experimental Resultscited by 164
  17. 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
  18. 2021Systematic Inequalities in Language Technology Performance across the World's Languagescited by 118
  19. 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
  20. 2021Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Developmentcited by 85
  21. 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpuscited by 79
  22. 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
  23. 2020It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbationscited by 64
  24. 2021Changing the World by Changing the Datacited by 51
  25. 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
  26. 2020Masakhane -- Machine Translation For Africacited by 48
  27. 2021Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLPcited by 47
  28. 2021Addressing "Documentation Debt" in Machine Learning Research: A Retrospective Datasheet for BookCorpuscited by 46
  29. 2022Datasheet for the Pilecited by 41
  30. 2021Disembodied Machine Learning: On the Illusion of Objectivity in NLPcited by 37
  31. 2021Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cardscited by 24
  32. 2019Towards Standardization of Data Licenses: The Montreal Data Licensecited by 19
  33. 2017An Army of Me: Sockpuppets in Online Discussion Communitiescited by 18
  34. 2019ORES: Lowering Barriers with Participatory Machine Learning in Wikipediacited by 16
  35. 2020Affirmative Algorithms: The Legal Grounds for Fairness as Awarenesscited by 15
  36. 2021No Intruder, no Validity: Evaluation Criteria for Privacy-Preserving Text Anonymizationcited by 13
  37. 2022Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resourcescited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 15; 2024: 8; 2025: 1; 2026: 2.

32 papers.

Sort:

By area:

  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  2. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
  3. 2023BloombergGPT: A Large Language Model for Financecited by 923
  4. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  5. 2022The Stack: 3 TB of permissively licensed source codecited by 354
  6. 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
  7. 2023Auditing large language models: a three-layered approachcited by 135
  8. 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
  9. 2022Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Datasetcited by 113
  10. 2023Foundation Models and Fair Usecited by 112
  11. 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 91
  12. 2023The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AIcited by 73
20 more
  1. 2023Large Language Models as Superpositions of Cultural Perspectivescited by 48
  2. 2024Consent in Crisis: The Rapid Decline of the AI Data Commonscited by 45
  3. 2022BigBIO: A Framework for Data-Centric Biomedical Natural Language Processingcited by 36
  4. 2023The ROOTS Search Tool: Data Transparency for LLMscited by 30
  5. 2024Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them?cited by 15
  6. 2023Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societiescited by 11
  7. 2024The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resourcescited by 11
  8. 2023GAIA Search: Hugging Face and Pyserini Interoperability for NLP Training Data Explorationcited by 8
  9. 2022Trustworthy Social Bias Measurementcited by 7
  10. 2024Copycats: the many lives of a publicly available medical imaging datasetcited by 5
  11. 2023AfroDigits: A Community-Driven Spoken Digit Dataset for African Languagescited by 4
  12. 2024PharmaGPT: Domain-Specific Large Language Models for Bio-Pharmaceutical and Chemistrycited by 4
  13. 2024Governance of Generative Artificial Intelligence for Companiescited by 2
  14. 2023The Extractive-Abstractive Axis: Measuring Content "Borrowing" in Generative Language Modelscited by 1
  15. 2024Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Modelscited by 1
  16. 2025Beyond Release: Access Considerations for Generative AI Systemscited by 1
  17. 2026SAFARI: A Community-Engaged Approach and Dataset of Stereotype Resources in the Sub-Saharan African Contextcited by 1
  18. 2022NaturalAdversaries: Can Naturalistic Adversaries Be as Effective as Artificial Adversaries?cited by 0
  19. 2024Data Processing for the OpenGPT-X Model Familycited by 0
  20. 2026Open but Incompatible: A License Compatibility Analysis of Corpora for Low-Resource African Languagescited by 0