mlsanityData to 14 Oct 2026

Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?

arXiv 2503.07890 ↗First posted 10 Mar 2025cs.CVcited by 10

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Self-supervised learning (SSL) has revolutionized representation learning in Remote Sensing (RS), advancing Geospatial Foundation Models (GFMs) to leverage vast unlabeled satellite imagery for diverse downstream tasks. Currently, GFMs primarily employ objectives like contrastive learning or masked image modeling, owing to their proven success in learning transferable representations. However, generative diffusion models, which demonstrate the potential to capture multi-grained semantics essential for RS tasks during image generation, remain underexplored for discriminative applications. This prompts the question: can generative diffusion models also excel and serve as GFMs with sufficient discriminative power? In this work, we answer this question with SatDiFuser, a framework that transforms a diffusion-based generative geospatial foundation model into a powerful pretraining tool for discriminative RS. By systematically analyzing multi-stage, noise-dependent diffusion features, we develop three fusion strategies to effectively leverage these diverse representations. Extensive experiments on remote sensing benchmarks show that SatDiFuser outperforms state-of-the-art GFMs, achieving gains of up to +5.7% mIoU in semantic segmentation and +7.9% F1-score in classification, demonstrating the capacity of diffusion-based generative foundation models to rival or exceed discriminative GFMs. The source code is available at: https://github.com/yurujaja/SatDiFuser.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 64 of its 74 references that are in the map. First posted on arXiv 10 Mar 2025.

Builds on

64 of 74 references.

Closest ancestors · 16

Same direction, newest first

  1. 2024Semantic Guided Large Scale Factor Remote Sensing Image Super-resolution with Generative Diffusion Prior11 May
  2. 2024Detecting Out-Of-Distribution Earth Observation Images with Diffusion Models19 Apr
  3. 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives13 Apr
  4. 2024Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Model26 Mar
  5. 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation25 Mar
  6. 2024IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-sensing Images18 Mar
  7. 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Model18 Mar
  8. 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models24 Feb
  9. 2024Siamese Meets Diffusion Network: SMDNet for Enhanced Change Detection in High-Resolution RS Imagery17 Jan
  10. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery6 Dec
  11. 2023TDiffDe: A Truncated Diffusion Model for Remote Sensing Hyperspectral Image Denoising22 Nov
  12. 2023DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Images8 Aug
4 more
  1. 2023Exploring Multi-Timestep Multi-Stage Diffusion Features for Hyperspectral Image Classification15 Jun
  2. 2023GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature Guided DDPM6 Jun
  3. 2023DiffUCD:Unsupervised Hyperspectral Image Change Detection with Semantic Correlation Diffusion Model21 May
  4. 2022DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detection23 Jun

Other references · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  10. 2022A ConvNet for the 2020scited by 3,579
  11. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  12. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
36 more
  1. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
  2. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  3. 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
  4. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  5. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  6. 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 280
  7. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
  8. 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
  9. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  10. 2020Geography-Aware Self-Supervised Learningcited by 190
  11. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  12. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  13. 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
  14. 2023Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusioncited by 131
  15. 2023Denoising Diffusion Autoencoders are Unified Self-supervised Learnerscited by 130
  16. 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
  17. 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 123
  18. 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
  19. 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignmentcited by 71
  20. 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
  21. 2023Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidarcited by 60
  22. 2024Diffusion Models and Representation Learning: A Surveycited by 54
  23. 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
  24. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 48
  25. 2024Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensingcited by 47
  26. 2024Bridging Remote Sensors with Multisensor Geospatial Foundation Modelscited by 46
  27. 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 42
  28. 2024Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Modelcited by 37
  29. 2023SLiMe: Segment Like Mecited by 34
  30. 2023Do text-free diffusion models learn discriminative visual representations?cited by 33
  31. 2024CrossEarth: Geospatial Vision Foundation Model for Domain Generalizable Remote Sensing Semantic Segmentationcited by 27
  32. 2024DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cutcited by 26
  33. 2024SwiMDiff: Scene-wide Matching Contrastive Learning with Diffusion Constraint for Remote Sensing Imagecited by 14
  34. 2022Multi-Class Segmentation from Aerial Views using Recursive Noise Diffusioncited by 8
  35. 2023MDFL: Multi-domain Diffusion-driven Feature Learningcited by 8
  36. 2024Cross-sensor self-supervised training and alignment for remote sensingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 7.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensing
  2. 2026Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion
  3. 2024Remote Diffusion
  4. 2025COP-GEN-Beta: Unified Generative Modelling of COPernicus Imagery Thumbnails
  5. 2025EarthSynth: Generating Informative Earth Observation with Diffusion Models
  6. 2025Environment-Aware Satellite Image Generation with Diffusion Models
  7. 2025A Gift from the Integration of Discriminative and Diffusion-based Generative Learning: Boundary Refinement Remote Sensing Semantic Segmentation
  8. 2026GeoSANE: Learning Geospatial Representations from Models, Not Data