Multimodal-Guided Dynamic Dataset Pruning for Robust and Efficient Data-Centric Learning
Not on the map. Why?
Abstract (arXiv)
Modern deep models are trained on large real-world datasets, where data quality varies and redundancy is common. Data-centric approaches such as dataset pruning have shown promise in improving training efficiency and model performance. However, most existing methods rely on static heuristics or task-specific metrics, limiting their robustness and generalizability across domains. In this work, we introduce a dynamic dataset pruning framework that adaptively selects training samples based on both task-driven difficulty and cross-modality semantic consistency. By incorporating supervision from pretrained multimodal foundation models, our approach captures training dynamics while effectively filtering out uninformative samples. Our work highlights the potential of integrating cross-modality alignment for robust sample selection, advancing data-centric learning toward more efficient and robust practices across application domains.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 57 references that are in the map. First posted on arXiv 17 Jul 2025.
Builds on
42 of 57 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 533
- 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
- 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 497
- 2022Dataset Distillation by Matching Training Trajectoriescited by 442
- 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modelingcited by 431
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
- 2021Dataset Condensation with Differentiable Siamese Augmentationcited by 291
30 more
- 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 274
- 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
- 2020GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learningcited by 226
- 2022Dataset Distillation using Neural Feature Regressioncited by 177
- 2022Minimizing the Accumulated Trajectory Error to Improve Dataset Distillationcited by 142
- 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 133
- 2023CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Predictioncited by 118
- 2023Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matchingcited by 118
- 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 117
- 2023A Comprehensive Survey of Dataset Distillationcited by 115
- 2023InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruningcited by 90
- 2023D2 Pruning: Message Passing for Balancing Diversity and Difficulty in Data Pruningcited by 69
- 2023Data Pruning via Moving-one-Sample-outcited by 67
- 2023Large-scale Dataset Pruning with Dynamic Uncertaintycited by 63
- 2022Adaptive Second Order Coresets for Data-efficient Machine Learningcited by 60
- 2025Dataset Distillation with Neural Characteristic Function: A Minmax Perspectivecited by 45
- 2021Accelerating Deep Learning with Dynamic Data Pruningcited by 43
- 2023Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruningcited by 38
- 2023InfoNCE Loss Provably Learns Cluster-Preserving Representationscited by 37
- 2023Data Valuation Without Training of a Modelcited by 35
- 2018Theory of Curriculum Learning, with Convex Loss Functionscited by 33
- 2022Adaptive Dynamic Filtering Network for Image Denoisingcited by 28
- 2024A CLIP-Powered Framework for Robust and Generalizable Data Selectioncited by 21
- 2024EntAugment: Entropy-Driven Adaptive Data Augmentation Framework for Image Classificationcited by 13
- 2022PADDLES: Phase-Amplitude Spectrum Disentangled Early Stopping for Learning with Noisy Labelscited by 10
- 2023A Weighted K-Center Algorithm for Data Subset Selectioncited by 9
- 2024AdaAugment: A Tuning-Free and Adaptive Approach to Enhance Data Augmentationcited by 7
- 2025When Dynamic Data Selection Meets Data Augmentationcited by 6
- 2025DONOD: Efficient and Generalizable Instruction Fine-Tuning for LLMs via Model-Intrinsic Dataset Pruningcited by 4
- 2023Not All Data Matters: An End-to-End Adaptive Dataset Pruning Framework for Enhancing Model Performance and Efficiencycited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.