mlsanityData to 7 Oct 2026

Datasets: A Community Library for Natural Language Processing

arXiv 2109.02846 ↗First posted 7 Sep 2021cs.CLcited by 526

Not on the map. Why?

Abstract (arXiv)

The scale, variety, and quantity of publicly-available NLP datasets has grown rapidly as researchers propose new tasks, larger models, and novel benchmarks. Datasets is a community library for contemporary NLP designed to support this ecosystem. Datasets aims to standardize end-user interfaces, versioning, and documentation, while providing a lightweight front-end that behaves similarly for small datasets as for internet-scale corpora. The design of the library incorporates a distributed, community-driven approach to adding datasets and documenting usage. After a year of development, the library now includes more than 650 unique datasets, has more than 250 contributors, and has helped support a variety of novel cross-dataset research projects and shared tasks. The library is available at https://github.com/huggingface/datasets.

Key facts. Cited by 526 papers in the map (data through 7 Oct 2026). Builds on 24 of its 37 references that are in the map. First posted on arXiv 7 Sep 2021.

Builds on

24 of 37 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  7. 2017Billion-scale similarity search with GPUscited by 2,477
  8. 2018Deep contextualized word representationscited by 2,285
  9. 2018Datasheets for Datasetscited by 1,371
  10. 2018Annotation Artifacts in Natural Language Inference Datacited by 656
  11. 2019ELI5: Long Form Question Answeringcited by 567
  12. 2017Six Challenges for Neural Machine Translationcited by 334
12 more
  1. 2017Synthetic and Natural Noise Both Break Neural Machine Translationcited by 304
  2. 2018Hypothesis Only Baselines in Natural Language Inferencecited by 291
  3. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
  4. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  5. 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
  6. 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 195
  7. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
  8. 2021Hurdles to Progress in Long-form Question Answeringcited by 166
  9. 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
  10. 2021Robustness Gym: Unifying the NLP Evaluation Landscapecited by 107
  11. 2021Distributed Deep Learning in Open Collaborationscited by 58
  12. 2021Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cardscited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 113; 2023: 154; 2024: 119; 2025: 79; 2026: 49.

526 papers.

Sort:

By area:

  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  2. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  3. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  4. 2022Editing Models with Task Arithmeticcited by 1,076
  5. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  6. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
  7. 2023Larger language models do in-context learning differentlycited by 386
  8. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  9. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
  10. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  11. 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
  12. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
38 more
  1. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
  2. 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 179
  3. 2022Relative representations enable zero-shot latent space communicationcited by 175
  4. 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
  5. 2024Lessons from the Trenches on Reproducible Evaluation of Language Modelscited by 172
  6. 2022SCROLLS: Standardized CompaRison Over Long Language Sequencescited by 170
  7. 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
  8. 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
  9. 2023Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothingcited by 147
  10. 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 143
  11. 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 139
  12. 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 136
  13. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  14. 2021Reframing Human-AI Collaboration for Generating Free-Text Explanationscited by 125
  15. 2023Accelerating Transformer Inference for Translation via Parallel Decodingcited by 123
  16. 2023Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMscited by 121
  17. 2023DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Modelscited by 121
  18. 2022Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrationscited by 116
  19. 2022The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Modelscited by 115
  20. 2023The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuningcited by 106
  21. 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
  22. 2024On-Device Language Models: A Comprehensive Reviewcited by 101
  23. 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Modelscited by 100
  24. 2021An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Modelscited by 96
  25. 2023Sparse Low-rank Adaptation of Pre-trained Language Modelscited by 96
  26. 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 89
  27. 2021MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluationcited by 88
  28. 2023Mitigating Label Biases for In-context Learningcited by 88
  29. 2022Automatic Clipping: Differentially Private Deep Learning Made Easier and Strongercited by 87
  30. 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
  31. 2023DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedulecited by 85
  32. 2022Parallel Context Windows for Large Language Modelscited by 81
  33. 2023Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decodingcited by 80
  34. 2023Inseq: An Interpretability Toolkit for Sequence Generation Modelscited by 78
  35. 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
  36. 2023The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AIcited by 73
  37. 2023Symbol tuning improves in-context learning in language modelscited by 72
  38. 2024Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluationcited by 72

50 most cited of 526 All 526 (JSON)