mlsanityData to 7 Oct 2026

DataLab: A Platform for Data Analysis and Intervention

arXiv 2202.12875 ↗First posted 25 Feb 2022cs.LG cs.AI cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Despite data's crucial role in machine learning, most existing tools and research tend to focus on systems on top of existing data rather than how to interpret and manipulate data. In this paper, we propose DataLab, a unified data-oriented platform that not only allows users to interactively analyze the characteristics of data, but also provides a standardized interface for different data processing operations. Additionally, in view of the ongoing proliferation of datasets, toolname has features for dataset recommendation and global vision analysis that help researchers form a better view of the data ecosystem. So far, DataLab covers 1,715 datasets and 3,583 of its transformed version (e.g., hyponyms replacement), where 728 datasets support various analyses (e.g., with respect to gender bias) with the help of 140M samples annotated by 318 feature functions. DataLab is under active development and will be supported going forward. We have released a web platform, web API, Python SDK, PyPI published package and online documentation, which hopefully, can meet the diverse needs of researchers.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 37 of its 59 references that are in the map. First posted on arXiv 25 Feb 2022.

Builds on

37 of 59 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  3. 2017Billion-scale similarity search with GPUscited by 2,477
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  5. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  6. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  7. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  8. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  9. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  10. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
  11. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  12. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
25 more
  1. 2018Annotation Artifacts in Natural Language Inference Datacited by 656
  2. 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
  3. 2021Datasets: A Community Library for Natural Language Processingcited by 526
  4. 2021A Survey of Data Augmentation Approaches for NLPcited by 408
  5. 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 370
  6. 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
  7. 2018Analysis Methods in Neural Language Processing: A Surveycited by 276
  8. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
  9. 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
  10. 2017Data Augmentation for Low-Resource Neural Machine Translationcited by 139
  11. 2020TLDR: Extreme Summarization of Scientific Documentscited by 136
  12. 2021Systematic Inequalities in Language Technology Performance across the World's Languagescited by 118
  13. 2013From Amateurs to Connoisseurs: Modeling the Evolution of User Expertise through Online Reviewscited by 107
  14. 2020Multi-Dimensional Gender Bias Classificationcited by 80
  15. 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 72
  16. 2021Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Paperscited by 70
  17. 2021ExplainaBoard: An Explainable Leaderboard for NLPcited by 50
  18. 2019GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processingcited by 31
  19. 2019Open Domain Web Keyphrase Extraction Beyond Language Modelingcited by 28
  20. 2020Interpretable Multi-dataset Evaluation for Named Entity Recognitioncited by 27
  21. 2021Dataset Geography: Mapping Language Data to Language Userscited by 22
  22. 2019A Closer Look at Data Bias in Neural Extractive Summarization Modelscited by 18
  23. 2020CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systemscited by 17
  24. 2021How well do you know your summarization datasets?cited by 16
  25. 2021A Data-Centric Framework for Composable NLP Workflowscited by 5

Built on by

Cited by year

Citing papers per year: 2022: 5; 2023: 3.

8 papers.

  1. 2022On Improving Summarization Factual Consistency from Natural Language Feedbackcited by 38
  2. 2022Measuring Datacited by 18
  3. 2022Salience Allocation as Guidance for Abstractive Summarizationcited by 14
  4. 2023InterroLang: Exploring NLP Models and Datasets through Dialogue-based Explanationscited by 11
  5. 2023TabGenie: A Toolkit for Table-to-Text Generationcited by 7
  6. 2022KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Modelscited by 4
  7. 2022Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classificationcited by 3
  8. 2023NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Toolscited by 1