mlsanityData to 14 Oct 2026

Mapping the Concept Landscape: Structural Perception of Global Distributions for Transparent Data Pruning

arXiv 2608.22858 ↗First posted 24 Aug 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing data pruning methods predominantly rely on high-dimensional feature embeddings to measure sample importance. However, these compressed vectors often obscure fine-grained semantic interactions, leading to suboptimal coverage of rare semantic concepts in the pruned subsets. In this paper, we propose Mapping the Concept Landscape (MCL), a novel structural perception framework for transparent data pruning. Instead of abstract embeddings, we represent each image-caption pair as an explicit sample-level graph comprising entities, events, and attributes. By integrating these individual graphs into a comprehensive dataset-level graph, we characterize the global distribution of semantic concepts and quantify their rarity across the entire corpus. Based on this structured perception, we develop a greedy concept-coverage maximization algorithm that iteratively selects samples to maximize the marginal gain of high-value, under-represented concepts. Experimental results on various benchmarks demonstrate that our method not only achieves superior pruning efficiency compared to state-of-the-art methods but also provides a transparent and interpretable audit trail for the selection process.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 57 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

45 of 57 references.

References · 45

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  8. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  9. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  10. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  11. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  12. 2019Towards VQA Models That Can Readcited by 1,718
33 more
  1. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  2. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  3. 2023LIMA: Less Is More for Alignmentcited by 1,100
  4. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
  5. 2019Gradient based sample selection for online continual learningcited by 571
  6. 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 533
  7. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  8. 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
  9. 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 339
  10. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  11. 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 307
  12. 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
  13. 2022Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learntcited by 236
  14. 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 133
  15. 2015Online Batch Selection for Faster Training of Neural Networkscited by 122
  16. 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 117
  17. 2023#InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language Modelscited by 109
  18. 2019Accelerating Deep Learning by Focusing on the Biggest Loserscited by 94
  19. 2023InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruningcited by 90
  20. 2024Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Modelscited by 84
  21. 2023D2 Pruning: Message Passing for Balancing Diversity and Difficulty in Data Pruningcited by 69
  22. 2023Data Pruning via Moving-one-Sample-outcited by 67
  23. 2023Large-scale Dataset Pruning with Dynamic Uncertaintycited by 63
  24. 2023Self-Evolved Diverse Data Sampling for Efficient Instruction Tuningcited by 52
  25. 2024Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selectioncited by 48
  26. 2024SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Modelscited by 44
  27. 2021Accelerating Deep Learning with Dynamic Data Pruningcited by 43
  28. 2024ICONS: Influence Consensus for Vision-Language Data Selectioncited by 29
  29. 2024Concept-skill Transferability-based Data Selection for Large Vision-Language Modelscited by 24
  30. 2025Data Pruning by Information Maximizationcited by 15
  31. 2024Diversified Batch Selection for Training Accelerationcited by 14
  32. 2017Deep Multitask Learning for Semantic Dependency Parsingcited by 10
  33. 2025Partial Forward Blocking: A Novel Data Pruning Paradigm for Lossless Training Accelerationcited by 3

Built on by

Not cited yet.