mlsanityData to 7 Oct 2026

Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion

arXiv 2601.15829 ↗First posted 22 Jan 2026cs.CVcited by 1

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Recent years have witnessed the remarkable success of deep learning in remote sensing image interpretation, driven by the availability of large-scale benchmark datasets. However, this reliance on massive training data also brings substantial storage and computational costs. To address this challenge, this study introduces the concept of dataset distillation into the field of remote sensing image interpretation for the first time. Specifically, we propose discriminative prototype-guided diffusion (DPD), a diffusion-based generative distillation framework that condenses a large-scale remote sensing dataset into a compact and representative distilled dataset. To improve the semantic fidelity and diversity of the synthesized samples, we extract representative prototypes for each category in the latent space. We then construct hyperspherical semantic anchors around the prototypes to guide the reverse denoising trajectory. Furthermore, to enhance the discriminative quality of the generated samples, multiple candidates are generated for each prototype and ranked by a latent classifier using a logit-margin criterion, with the most discriminative candidates selected to form the final distilled dataset. Experiments on three high-resolution remote sensing scene classification benchmarks show that the proposed method can distill realistic, diverse, and discriminative samples for downstream model training. Code and pre-trained models are available online (https://github.com/YonghaoXu/DPD).

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 47 of its 71 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

47 of 71 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives13 Apr
  2. 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Model18 Mar
  3. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery6 Dec

Other references · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2025Qwen3 Technical Reportcited by 8,195
  8. 2016Densely Connected Convolutional Networkscited by 6,691
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  11. 2025Qwen2.5-VL Technical Reportcited by 5,418
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,276
32 more
  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  2. 2016Improved Techniques for Training GANscited by 2,938
  3. 2020Designing Network Design Spacescited by 954
  4. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
  5. 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
  6. 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 519
  7. 2020Dataset Condensation with Gradient Matchingcited by 510
  8. 2022Dataset Distillation by Matching Training Trajectoriescited by 437
  9. 2021Dataset Condensation with Distribution Matchingcited by 362
  10. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
  11. 2018Dataset Distillationcited by 224
  12. 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
  13. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
  14. 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 132
  15. 2023Dataset Distillation: A Comprehensive Reviewcited by 126
  16. 2023A Comprehensive Survey of Dataset Distillationcited by 114
  17. 2019Soft-Label Dataset Distillation and Text Dataset Distillationcited by 106
  18. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
  19. 2020Flexible Dataset Distillation: Learn Labels Instead of Imagescited by 91
  20. 2023Efficient Dataset Distillation via Minimax Diffusioncited by 81
  21. 2024D4M: Dataset Distillation via Disentangled Diffusion Modelcited by 76
  22. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
  23. 2023DiM: Distilling Dataset into Generative Modelcited by 45
  24. 2022Txt2Img-MHN: Remote Sensing Image Generation from Text Using Modern Hopfield Networkscited by 28
  25. 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
  26. 2023There Are No Data Like More Data- Datasets for Deep Learning in Earth Observationcited by 16
  27. 2025Taming Diffusion for Dataset Distillation with High Representativenesscited by 16
  28. 2025CaO2: Rectifying Inconsistencies in Diffusion-Based Dataset Distillationcited by 13
  29. 2025FedRSClip: Federated Learning for Remote Sensing Scene Classification Using Vision-Language Modelscited by 11
  30. 2023Federated Learning Across Decentralized and Unshared Archives for Remote Sensing Image Classificationcited by 10
  31. 2025RS-Prune: Training-Free Data Pruning at High Ratios for Efficient Remote Sensing Diffusion Foundation Modelscited by 4
  32. 2025Core-Set Selection for Data-efficient Land Cover Segmentationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?
  2. 2025EarthSynth: Generating Informative Earth Observation with Diffusion Models
  3. 2024Remote Diffusion
  4. 2026SlimDiffSR: Toward Lightweight and Efficient Remote Sensing Image Super-Resolution via Diffusion Model Distillation
  5. 2026Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensing
  6. 2025Object Fidelity Diffusion for Remote Sensing Image Generation
  7. 2026Noise2Map: End-to-End Diffusion Model for Semantic Segmentation and Change Detection
  8. 2025A Gift from the Integration of Discriminative and Diffusion-based Generative Learning: Boundary Refinement Remote Sensing Semantic Segmentation