mlsanityData to 7 Oct 2026

RS-Prune: Training-Free Data Pruning at High Ratios for Efficient Remote Sensing Diffusion Foundation Models

arXiv 2512.23239 ↗First posted 29 Dec 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Diffusion-based remote sensing (RS) generative foundation models are cruial for downstream tasks. However, these models rely on large amounts of globally representative data, which often contain redundancy, noise, and class imbalance, reducing training efficiency and preventing convergence. Existing RS diffusion foundation models typically aggregate multiple classification datasets or apply simplistic deduplication, overlooking the distributional requirements of generation modeling and the heterogeneity of RS imagery. To address these limitations, we propose a training-free, two-stage data pruning approach that quickly select a high-quality subset under high pruning ratios, enabling a preliminary foundation model to converge rapidly and serve as a versatile backbone for generation, downstream fine-tuning, and other applications. Our method jointly considers local information content with global scene-level diversity and representativeness. First, an entropy-based criterion efficiently removes low-information samples. Next, leveraging RS scene classification datasets as reference benchmarks, we perform scene-aware clustering with stratified sampling to improve clustering effectiveness while reducing computational costs on large-scale unlabeled data. Finally, by balancing cluster-level uniformity and sample representativeness, the method enables fine-grained selection under high pruning ratios while preserving overall diversity and representativeness. Experiments show that, even after pruning 85% of the training data, our method significantly improves convergence and generation quality. Furthermore, diffusion foundation models trained with our method consistently achieve state-of-the-art performance across downstream tasks, including super-resolution and semantic image synthesis. This data pruning paradigm offers practical guidance for developing RS generative foundation models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

35 of 53 references.

References · 35

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  10. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  11. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  12. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
23 more
  1. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
  2. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  3. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
  4. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
  5. 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 269
  6. 2020Identifying Mislabeled Data using the Area Under the Margin Rankingcited by 259
  7. 2020Coresets via Bilevel Optimization for Continual Learning and Streamingcited by 191
  8. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
  9. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
  10. 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 115
  11. 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 80
  12. 2023Data Pruning via Moving-one-Sample-outcited by 67
  13. 2023EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolutioncited by 56
  14. 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 54
  15. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
  16. 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
  17. 2023Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruningcited by 38
  18. 2020Semantic Change Detection with Asymmetric Siamese Networkscited by 31
  19. 2023RSDiff: Remote Sensing Image Generation from Text Using Diffusion Modelcited by 28
  20. 2024Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Modelcited by 20
  21. 2024A CLIP-Powered Framework for Robust and Generalizable Data Selectioncited by 20
  22. 2024A2-MAE: A spatial-temporal-spectral unified remote sensing pre-training method based on anchor-aware masked autoencodercited by 10
  23. 2024Data Pruning in Generative Diffusion Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.