Mapping the Concept Landscape: Structural Perception of Global Distributions for Transparent Data Pruning
Not on the map. Why?
Abstract (arXiv)
Existing data pruning methods predominantly rely on high-dimensional feature embeddings to measure sample importance. However, these compressed vectors often obscure fine-grained semantic interactions, leading to suboptimal coverage of rare semantic concepts in the pruned subsets. In this paper, we propose Mapping the Concept Landscape (MCL), a novel structural perception framework for transparent data pruning. Instead of abstract embeddings, we represent each image-caption pair as an explicit sample-level graph comprising entities, events, and attributes. By integrating these individual graphs into a comprehensive dataset-level graph, we characterize the global distribution of semantic concepts and quantify their rarity across the entire corpus. Based on this structured perception, we develop a greedy concept-coverage maximization algorithm that iteratively selects samples to maximize the marginal gain of high-value, under-represented concepts. Experimental results on various benchmarks demonstrate that our method not only achieves superior pruning efficiency compared to state-of-the-art methods but also provides a transparent and interpretable audit trail for the selection process.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 57 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
45 of 57 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2019Towards VQA Models That Can Readcited by 1,718
33 more
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
- 2019Gradient based sample selection for online continual learningcited by 571
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 533
- 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
- 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
- 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 339
- 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
- 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 307
- 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
- 2022Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learntcited by 236
- 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 133
- 2015Online Batch Selection for Faster Training of Neural Networkscited by 122
- 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 117
- 2023#InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language Modelscited by 109
- 2019Accelerating Deep Learning by Focusing on the Biggest Loserscited by 94
- 2023InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruningcited by 90
- 2024Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Modelscited by 84
- 2023D2 Pruning: Message Passing for Balancing Diversity and Difficulty in Data Pruningcited by 69
- 2023Data Pruning via Moving-one-Sample-outcited by 67
- 2023Large-scale Dataset Pruning with Dynamic Uncertaintycited by 63
- 2023Self-Evolved Diverse Data Sampling for Efficient Instruction Tuningcited by 52
- 2024Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selectioncited by 48
- 2024SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Modelscited by 44
- 2021Accelerating Deep Learning with Dynamic Data Pruningcited by 43
- 2024ICONS: Influence Consensus for Vision-Language Data Selectioncited by 29
- 2024Concept-skill Transferability-based Data Selection for Large Vision-Language Modelscited by 24
- 2025Data Pruning by Information Maximizationcited by 15
- 2024Diversified Batch Selection for Training Accelerationcited by 14
- 2017Deep Multitask Learning for Semantic Dependency Parsingcited by 10
- 2025Partial Forward Blocking: A Novel Data Pruning Paradigm for Lossless Training Accelerationcited by 3
Built on by
Not cited yet.