mlsanityData to 7 Oct 2026

A Data-Centric Approach for Training Deep Neural Networks with Less Data

arXiv 2110.03613 ↗First posted 7 Oct 2021cs.AIcited by 28

Not on the map. Why?

Abstract (arXiv)

While the availability of large datasets is perceived to be a key requirement for training deep neural networks, it is possible to train such models with relatively little data. However, compensating for the absence of large datasets demands a series of actions to enhance the quality of the existing samples and to generate new ones. This paper summarizes our winning submission to the "Data-Centric AI" competition. We discuss some of the challenges that arise while training with a small dataset, offer a principled approach for systematic data quality enhancement, and propose a GAN-based solution for synthesizing new data points. Our evaluations indicate that the dataset generated by the proposed pipeline offers 5% accuracy improvement while being significantly smaller than the baseline.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 3 of its 6 references that are in the map. First posted on arXiv 7 Oct 2021.

Builds on

3 of 6 references.

References · 3

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Conditional Generative Adversarial Netscited by 2,152
  3. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 10; 2024: 8; 2025: 2; 2026: 1.

28 papers.

Sort:

By area:

  1. 2023Teaching Arithmetic to Small Transformerscited by 121
  2. 2024Transformers Can Achieve Length Generalization But Not Robustlycited by 82
  3. 2024Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimationcited by 53
  4. 2022Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimationcited by 43
  5. 2024VariErr NLI: Separating Annotation Error from Human Label Variationcited by 42
  6. 2022The Principles of Data-Centric AI (DCAI)cited by 26
  7. 2023AlpaGasus: Training A Better Alpaca with Fewer Datacited by 19
  8. 2022Measuring Datacited by 18
  9. 2023Data-Driven Design for Metamaterials and Multiscale Systems: A Reviewcited by 17
  10. 2023Unsupervised classification to improve the quality of a bird song recording datasetcited by 10
  11. 2023A Data-Centric Solution to NonHomogeneous Dehazing via Vision Transformercited by 9
  12. 2024GDeR: Safeguarding Efficiency, Balancing, and Robustness via Prototypical Graph Pruningcited by 8
16 more
  1. 2024Can Synthetic Audio From Generative Foundation Models Assist Audio Recognition and Speech Modeling?cited by 4
  2. 2025General Information Metrics for Improving AI Model Training Efficiencycited by 4
  3. 2023Label Smarter, Not Harder: CleverLabel for Faster Annotation of Ambiguous Image Classification with Higher Qualitycited by 3
  4. 2023Provable advantages of kernel-based quantum learners and quantum preprocessing based on Grover's algorithmcited by 3
  5. 2022POP: Mining POtential Performance of new fashion products via webly cross-modal query expansioncited by 2
  6. 2024Data-Centric Approach to Constrained Machine Learning: A Case Study on Conway's Game of Lifecited by 2
  7. 2022Smart Active Sampling to enhance Quality Assurance Efficiencycited by 1
  8. 2024Thresholding Data Shapley for Data Cleansing Using Multi-Armed Banditscited by 1
  9. 2022Maintaining Performance with Less Datacited by 0
  10. 2022Deep Learning based pipeline for anomaly detection and quality enhancement in industrial binder jetting processescited by 0
  11. 2023Synfeal: A Data-Driven Simulator for End-to-End Camera Localizationcited by 0
  12. 2023Class-Adaptive Sampling Policy for Efficient Continual Learningcited by 0
  13. 2023CUDC: A Curiosity-Driven Unsupervised Data Collection Method with Adaptive Temporal Distances for Offline Reinforcement Learningcited by 0
  14. 2024Continual Learning: Less Forgetting, More OOD Generalization via Adaptive Contrastive Replaycited by 0
  15. 2025Breaking the Statistical Similarity Trap in Extreme Convection Detectioncited by 0
  16. 2026A Hierarchical Consistency Framework for Auditing Retrieval-Augmented Generation Systemscited by 0