DMLR: Data-centric Machine Learning Research -- Past, Present and Future
Not on the map. Why?
Abstract (arXiv)
Drawing from discussions at the inaugural DMLR workshop at ICML 2023 and meetings prior, in this report we outline the relevance of community engagement and infrastructure development for the creation of next-generation public datasets that will advance machine learning science. We chart a path forward as a collective effort to sustain the creation and maintenance of these datasets and methods towards positive scientific, societal and business impact.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 38 of its 91 references that are in the map. First posted on arXiv 21 Nov 2023.
Builds on
38 of 91 references.
References · 38
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
26 more
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 533
- 2018Rotation Equivariant CNNs for Digital Pathologycited by 422
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
- 2014Caffe: Convolutional Architecture for Fast Feature Embeddingcited by 288
- 2018Do CIFAR-10 Classifiers Generalize to CIFAR-10?cited by 200
- 2019Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchycited by 156
- 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 156
- 2015An open access repository of images on plant health to enable the development of mobile disease diagnosticscited by 135
- 2021Generative Models as a Data Source for Multiview Representation Learningcited by 104
- 2021Learning to See by Looking at Noisecited by 92
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2019Cold Case: The Lost MNIST Digitscited by 62
- 2023GeoDE: a Geographically Diverse Evaluation Dataset for Object Recognitioncited by 50
- 2016Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasetscited by 31
- 2021fastMRI+: Clinical Pathology Annotations for Knee and Brain Fully Sampled Multi-Coil MRI Datacited by 29
- 2023Cousins Of The Vendi Score: A Family Of Similarity-Based Diversity Metrics For Science And Machine Learningcited by 24
- 2022Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular datacited by 22
- 2023Bytes Are All You Need: Transformers Operating Directly On File Bytescited by 18
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
- 2023Generative Fractional Diffusion Modelscited by 12
- 2022Data Models for Dataset Drift Controls in Machine Learning With Optical Imagescited by 5
- 2023Neglected Free Lunch -- Learning Image Classifiers Using Annotation Byproductscited by 4
- 2023Localized Data Work as a Precondition for Data-Centric ML: A Case Study of Full Lifecycle Crop Disease Identification in Ghanacited by 1
Built on by
Citing papers per year: 2024: 6; 2025: 4; 2026: 1.
11 papers.
- 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 81
- 2024Beyond Aesthetics: Cultural Competence in Text-to-Image Modelscited by 30
- 2024Outlier Gradient Analysis: Efficiently Identifying Detrimental Training Samples for Deep Learning Modelscited by 10
- 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
- 2025The Vendiscope: An Algorithmic Microscope For Data Collectionscited by 5
- 2026A Sustainable AI Economy Needs Data Deals That Work for Generatorscited by 3
- 2025Autoguided Online Data Curation for Diffusion Model Trainingcited by 1
- 2025Towards Cross-Modal Error Detection with Tables and Imagescited by 1
- 2024Analyzing Decades-Long Environmental Changes in Namibia Using Archival Aerial Photography and Deep Learningcited by 0
- 2024Local vs. Global: Local Land-Use and Land-Cover Models Deliver Higher Quality Mapscited by 0
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentationcited by 0
- 2026A Sustainable AI Economy Needs Data Deals That Work for Generators15 Jan 2026
- 2025Towards Cross-Modal Error Detection with Tables and Images14 Oct 2025
- 2025Autoguided Online Data Curation for Diffusion Model Training18 Sep 2025
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentation23 May 2025
- 2025The Vendiscope: An Algorithmic Microscope For Data Collections15 Feb 2025
- 2024Local vs. Global: Local Land-Use and Land-Cover Models Deliver Higher Quality Maps1 Dec 2024
- 2024Benchmark Data Repositories for Better Benchmarking31 Oct 2024
- 2024Beyond Aesthetics: Cultural Competence in Text-to-Image Models9 Jul 2024
- 2024Outlier Gradient Analysis: Efficiently Identifying Detrimental Training Samples for Deep Learning Models6 May 2024
- 2024Analyzing Decades-Long Environmental Changes in Namibia Using Archival Aerial Photography and Deep Learning12 Apr 2024
- 2024Croissant: A Metadata Format for ML-Ready Datasets28 Mar 2024