RS-Prune: Training-Free Data Pruning at High Ratios for Efficient Remote Sensing Diffusion Foundation Models
Not on the map. Why?
Abstract (arXiv)
Diffusion-based remote sensing (RS) generative foundation models are cruial for downstream tasks. However, these models rely on large amounts of globally representative data, which often contain redundancy, noise, and class imbalance, reducing training efficiency and preventing convergence. Existing RS diffusion foundation models typically aggregate multiple classification datasets or apply simplistic deduplication, overlooking the distributional requirements of generation modeling and the heterogeneity of RS imagery. To address these limitations, we propose a training-free, two-stage data pruning approach that quickly select a high-quality subset under high pruning ratios, enabling a preliminary foundation model to converge rapidly and serve as a versatile backbone for generation, downstream fine-tuning, and other applications. Our method jointly considers local information content with global scene-level diversity and representativeness. First, an entropy-based criterion efficiently removes low-information samples. Next, leveraging RS scene classification datasets as reference benchmarks, we perform scene-aware clustering with stratified sampling to improve clustering effectiveness while reducing computational costs on large-scale unlabeled data. Finally, by balancing cluster-level uniformity and sample representativeness, the method enables fine-grained selection under high pruning ratios while preserving overall diversity and representativeness. Experiments show that, even after pruning 85% of the training data, our method significantly improves convergence and generation quality. Furthermore, diffusion foundation models trained with our method consistently achieve state-of-the-art performance across downstream tasks, including super-resolution and semantic image synthesis. This data pruning paradigm offers practical guidance for developing RS generative foundation models.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
35 of 53 references.
References · 35
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
23 more
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 269
- 2020Identifying Mislabeled Data using the Area Under the Margin Rankingcited by 259
- 2020Coresets via Bilevel Optimization for Continual Learning and Streamingcited by 191
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 115
- 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 80
- 2023Data Pruning via Moving-one-Sample-outcited by 67
- 2023EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolutioncited by 56
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 54
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
- 2023Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruningcited by 38
- 2020Semantic Change Detection with Asymmetric Siamese Networkscited by 31
- 2023RSDiff: Remote Sensing Image Generation from Text Using Diffusion Modelcited by 28
- 2024Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Modelcited by 20
- 2024A CLIP-Powered Framework for Robust and Generalizable Data Selectioncited by 20
- 2024A2-MAE: A spatial-temporal-spectral unified remote sensing pre-training method based on anchor-aware masked autoencodercited by 10
- 2024Data Pruning in Generative Diffusion Modelscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusioncited by 1
- 2026RSEdit: Text-Guided Image Editing for Remote Sensingcited by 1
- 2026Hide and Seek: Investigating Redundancy in Earth Observation Imagerycited by 0
- 2026Fidelity-Diversity-Consistency (FDC): Data Pruning for Remote Sensing Change Detectioncited by 0
- 2026Fidelity-Diversity-Consistency (FDC): Data Pruning for Remote Sensing Change Detection22 Aug 2026
- 2026RSEdit: Text-Guided Image Editing for Remote Sensing14 Mar 2026
- 2026Hide and Seek: Investigating Redundancy in Earth Observation Imagery13 Mar 2026
- 2026Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion22 Jan 2026