Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Recent years have witnessed the remarkable success of deep learning in remote sensing image interpretation, driven by the availability of large-scale benchmark datasets. However, this reliance on massive training data also brings substantial storage and computational costs. To address this challenge, this study introduces the concept of dataset distillation into the field of remote sensing image interpretation for the first time. Specifically, we propose discriminative prototype-guided diffusion (DPD), a diffusion-based generative distillation framework that condenses a large-scale remote sensing dataset into a compact and representative distilled dataset. To improve the semantic fidelity and diversity of the synthesized samples, we extract representative prototypes for each category in the latent space. We then construct hyperspherical semantic anchors around the prototypes to guide the reverse denoising trajectory. Furthermore, to enhance the discriminative quality of the generated samples, multiple candidates are generated for each prototype and ranked by a latent classifier using a logit-margin criterion, with the most discriminative candidates selected to form the final distilled dataset. Experiments on three high-resolution remote sensing scene classification benchmarks show that the proposed method can distill realistic, diverse, and discriminative samples for downstream model training. Code and pre-trained models are available online (https://github.com/YonghaoXu/DPD).
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 47 of its 71 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
47 of 71 references.
Closest ancestors · 3
Same direction, newest first
- 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives13 Apr
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Model18 Mar
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery6 Dec
Other references · 44
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2025Qwen3 Technical Reportcited by 8,195
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
32 more
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2016Improved Techniques for Training GANscited by 2,938
- 2020Designing Network Design Spacescited by 954
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 519
- 2020Dataset Condensation with Gradient Matchingcited by 510
- 2022Dataset Distillation by Matching Training Trajectoriescited by 437
- 2021Dataset Condensation with Distribution Matchingcited by 362
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2018Dataset Distillationcited by 224
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 132
- 2023Dataset Distillation: A Comprehensive Reviewcited by 126
- 2023A Comprehensive Survey of Dataset Distillationcited by 114
- 2019Soft-Label Dataset Distillation and Text Dataset Distillationcited by 106
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
- 2020Flexible Dataset Distillation: Learn Labels Instead of Imagescited by 91
- 2023Efficient Dataset Distillation via Minimax Diffusioncited by 81
- 2024D4M: Dataset Distillation via Disentangled Diffusion Modelcited by 76
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2023DiM: Distilling Dataset into Generative Modelcited by 45
- 2022Txt2Img-MHN: Remote Sensing Image Generation from Text Using Modern Hopfield Networkscited by 28
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2023There Are No Data Like More Data- Datasets for Deep Learning in Earth Observationcited by 16
- 2025Taming Diffusion for Dataset Distillation with High Representativenesscited by 16
- 2025CaO2: Rectifying Inconsistencies in Diffusion-Based Dataset Distillationcited by 13
- 2025FedRSClip: Federated Learning for Remote Sensing Scene Classification Using Vision-Language Modelscited by 11
- 2023Federated Learning Across Decentralized and Unshared Archives for Remote Sensing Image Classificationcited by 10
- 2025RS-Prune: Training-Free Data Pruning at High Ratios for Efficient Remote Sensing Diffusion Foundation Modelscited by 4
- 2025Core-Set Selection for Data-efficient Land Cover Segmentationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?
- 2025EarthSynth: Generating Informative Earth Observation with Diffusion Models
- 2024Remote Diffusion
- 2026SlimDiffSR: Toward Lightweight and Efficient Remote Sensing Image Super-Resolution via Diffusion Model Distillation
- 2026Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensing
- 2025Object Fidelity Diffusion for Remote Sensing Image Generation
- 2026Noise2Map: End-to-End Diffusion Model for Semantic Segmentation and Change Detection
- 2025A Gift from the Integration of Discriminative and Diffusion-based Generative Learning: Boundary Refinement Remote Sensing Semantic Segmentation