Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Self-supervised learning (SSL) has revolutionized representation learning in Remote Sensing (RS), advancing Geospatial Foundation Models (GFMs) to leverage vast unlabeled satellite imagery for diverse downstream tasks. Currently, GFMs primarily employ objectives like contrastive learning or masked image modeling, owing to their proven success in learning transferable representations. However, generative diffusion models, which demonstrate the potential to capture multi-grained semantics essential for RS tasks during image generation, remain underexplored for discriminative applications. This prompts the question: can generative diffusion models also excel and serve as GFMs with sufficient discriminative power? In this work, we answer this question with SatDiFuser, a framework that transforms a diffusion-based generative geospatial foundation model into a powerful pretraining tool for discriminative RS. By systematically analyzing multi-stage, noise-dependent diffusion features, we develop three fusion strategies to effectively leverage these diverse representations. Extensive experiments on remote sensing benchmarks show that SatDiFuser outperforms state-of-the-art GFMs, achieving gains of up to +5.7% mIoU in semantic segmentation and +7.9% F1-score in classification, demonstrating the capacity of diffusion-based generative foundation models to rival or exceed discriminative GFMs. The source code is available at: https://github.com/yurujaja/SatDiFuser.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 64 of its 74 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
64 of 74 references.
Closest ancestors · 16
Same direction, newest first
- 2024Semantic Guided Large Scale Factor Remote Sensing Image Super-resolution with Generative Diffusion Prior11 May
- 2024Detecting Out-Of-Distribution Earth Observation Images with Diffusion Models19 Apr
- 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives13 Apr
- 2024Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Model26 Mar
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation25 Mar
- 2024IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-sensing Images18 Mar
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Model18 Mar
- 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models24 Feb
- 2024Siamese Meets Diffusion Network: SMDNet for Enhanced Change Detection in High-Resolution RS Imagery17 Jan
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery6 Dec
- 2023TDiffDe: A Truncated Diffusion Model for Remote Sensing Hyperspectral Image Denoising22 Nov
- 2023DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Images8 Aug
4 more
- 2023Exploring Multi-Timestep Multi-Stage Diffusion Features for Hyperspectral Image Classification15 Jun
- 2023GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature Guided DDPM6 Jun
- 2023DiffUCD:Unsupervised Hyperspectral Image Change Detection with Semantic Correlation Diffusion Model21 May
- 2022DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detection23 Jun
Other references · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2022A ConvNet for the 2020scited by 3,579
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
36 more
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 280
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
- 2023Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusioncited by 131
- 2023Denoising Diffusion Autoencoders are Unified Self-supervised Learnerscited by 130
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 123
- 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
- 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignmentcited by 71
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2023Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidarcited by 60
- 2024Diffusion Models and Representation Learning: A Surveycited by 54
- 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 48
- 2024Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensingcited by 47
- 2024Bridging Remote Sensors with Multisensor Geospatial Foundation Modelscited by 46
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 42
- 2024Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Modelcited by 37
- 2023SLiMe: Segment Like Mecited by 34
- 2023Do text-free diffusion models learn discriminative visual representations?cited by 33
- 2024CrossEarth: Geospatial Vision Foundation Model for Domain Generalizable Remote Sensing Semantic Segmentationcited by 27
- 2024DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cutcited by 26
- 2024SwiMDiff: Scene-wide Matching Contrastive Learning with Diffusion Constraint for Remote Sensing Imagecited by 14
- 2022Multi-Class Segmentation from Aerial Views using Recursive Noise Diffusioncited by 8
- 2023MDFL: Multi-domain Diffusion-driven Feature Learningcited by 8
- 2024Cross-sensor self-supervised training and alignment for remote sensingcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 7.
10 papers.
- 2025TESSERA: Temporal Embeddings of Surface Spectra for Earth Representation and Analysiscited by 39
- 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 12
- 2025Object Fidelity Diffusion for Remote Sensing Image Generationcited by 5
- 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentationcited by 4
- 2025Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challengescited by 3
- 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observationcited by 2
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Datacited by 1
- 2026ChangeFlow -- Latent Rectified Flow for Change Detection in Remote Sensingcited by 0
- 2026Now We Know? A Systematic Comparison of TerraMind and THORcited by 0
- 2026GeoCore-9B: Towards Geo-Aware Generative Foundation Models in Earth Observationcited by 0
- 2026GeoCore-9B: Towards Geo-Aware Generative Foundation Models in Earth Observation3 Aug 2026
- 2026Now We Know? A Systematic Comparison of TerraMind and THOR20 Jul 2026
- 2026ChangeFlow -- Latent Rectified Flow for Change Detection in Remote Sensing14 May 2026
- 2026No One Knows the State of the Art in Geospatial Foundation Models12 May 2026
- 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation12 Mar 2026
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data3 Mar 2026
- 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observation23 Feb 2026
- 2025Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challenges27 Oct 2025
- 2025Object Fidelity Diffusion for Remote Sensing Image Generation14 Aug 2025
- 2025TESSERA: Temporal Embeddings of Surface Spectra for Earth Representation and Analysis25 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensing
- 2026Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion
- 2024Remote Diffusion
- 2025COP-GEN-Beta: Unified Generative Modelling of COPernicus Imagery Thumbnails
- 2025EarthSynth: Generating Informative Earth Observation with Diffusion Models
- 2025Environment-Aware Satellite Image Generation with Diffusion Models
- 2025A Gift from the Integration of Discriminative and Diffusion-based Generative Learning: Boundary Refinement Remote Sensing Semantic Segmentation
- 2026GeoSANE: Learning Geospatial Representations from Models, Not Data