Foreground-Aware Dataset Distillation via Dynamic Patch Selection
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a foreground-aware dataset distillation method that enhances patch selection in a content-adaptive manner. With the rising computational cost of training large-scale deep models, dataset distillation has emerged as a promising approach for constructing compact synthetic datasets that retain the knowledge of their large original counterparts. However, traditional optimization-based methods often suffer from high computational overhead, memory constraints, and the generation of unrealistic, noise-like images with limited architectural generalization. Recent non-optimization methods alleviate some of these issues by constructing distilled data from real image patches, but the used rigid patch selection strategies can still discard critical information about the main objects. To solve this problem, we first leverage Grounded SAM2 to identify foreground objects and compute per-image foreground occupancy, from which we derive a category-wise patch decision threshold. Guided by these thresholds, we design a dynamic patch selection strategy that, for each image, either selects the most informative patch from multiple candidates or directly resizes the full image when the foreground dominates. This dual-path mechanism preserves more key information about the main objects while reducing redundant background content. Extensive experiments on multiple benchmarks show that the proposed method consistently improves distillation performance over existing approaches, producing more informative and representative distilled datasets and enhancing robustness across different architectures and image compositions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 59 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
49 of 59 references.
References · 49
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 529
- 2020Dataset Condensation with Gradient Matchingcited by 510
- 2022Dataset Distillation by Matching Training Trajectoriescited by 437
- 2021Dataset Condensation with Distribution Matchingcited by 362
- 2022Scaling Up Dataset Distillation to ImageNet-1K with Constant Memorycited by 180
- 2018Fair Clustering Through Fairletscited by 176
- 2021Graph Condensation for Graph Neural Networkscited by 150
- 2022Minimizing the Accumulated Trajectory Error to Improve Dataset Distillationcited by 142
37 more
- 2023Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New Perspectivecited by 136
- 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 125
- 2023Improved Distribution Matching for Dataset Condensationcited by 124
- 2022Privacy for Free: How does Dataset Condensation Help Privacy?cited by 119
- 2023Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matchingcited by 118
- 2023A Comprehensive Survey of Dataset Distillationcited by 114
- 2023On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigmcited by 107
- 2022Dataset Condensation with Contrastive Signalscited by 105
- 2022Condensing Graphs via One-Step Gradient Matchingcited by 100
- 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
- 2023DataDAM: Efficient Dataset Distillation with Attention Matchingcited by 83
- 2023Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matchingcited by 69
- 2021Soft-Label Anonymous Gastric X-ray Image Distillationcited by 51
- 2023M3D: Dataset Condensation by Minimizing Maximum Mean Discrepancycited by 49
- 2023Sequential Subset Matching for Dataset Distillationcited by 40
- 2022Compressed Gastric Image Generation Based on Soft-Label Dataset Distillation for Medical Data Sharingcited by 35
- 2024An Aggregation-Free Federated Learning for Tackling Data Heterogeneitycited by 33
- 2023Loss-Curvature Matching for Dataset Selection and Condensationcited by 32
- 2024Diversity-Driven Synthesis: Enhancing Dataset Distillation through Directed Weight Adjustmentcited by 32
- 2024Exploiting Inter-sample and Inter-feature Relations in Dataset Distillationcited by 31
- 2022Meta Knowledge Condensation for Federated Learningcited by 26
- 2022Dataset Distillation for Medical Dataset Sharingcited by 25
- 2025The Evolution of Dataset Distillation: Toward Scalable and Generalizable Solutionscited by 24
- 2023Vision-Language Dataset Distillationcited by 18
- 2024Importance-Aware Adaptive Dataset Distillationcited by 18
- 2024Graph Data Condensation via Self-expressive Graph Structure Reconstructioncited by 18
- 2024Generative Dataset Distillation: Balancing Global Structure and Local Detailscited by 18
- 2023Unlocking the Potential of Federated Learning: The Symphony of Dataset Distillation via Deep Generative Latentscited by 16
- 2025Hyperbolic Dataset Distillationcited by 15
- 2024Generative Dataset Distillation Based on Diffusion Modelcited by 13
- 2025Diversity-Driven Generative Dataset Distillation Based on Diffusion Model with Self-Adaptive Memorycited by 10
- 2025Task-Specific Generative Dataset Distillation with Difficulty-Guided Samplingcited by 8
- 2025Efficient Multimodal Dataset Distillation via Generative Modelscited by 6
- 2025Decoupled Audio-Visual Dataset Distillationcited by 6
- 2024Behaviour Distillationcited by 5
- 2025Generative Dataset Distillation Based on Self-knowledge Distillationcited by 5
- 2025Distilling Reinforcement Learning into Single-Batch Datasetscited by 2
Built on by
Not cited yet.