GeoSET: Generalist Foundation Model for SAR-to-EO Image Translation
Not on the map. Why?
Abstract (arXiv)
Paired synthetic aperture radar (SAR) and electro-optical (EO) imagery is increasingly available across sensors, resolutions, and geographic regions. Yet existing SAR-to-EO image translation (SET) methods are typically trained on a single, limited-scale dataset, producing models specialized to particular sensing conditions. We introduce GeoSET, the first generalist model for SET, built around a single pretrained parent that is adapted to downstream datasets under a common protocol. We curate over 3 million high-quality SAR--EO pairs from a collection of more than 10 million SAR observations, spanning diverse sensors, spatial resolutions, and ground sampling distances. To bridge the modality gap between SAR observations and a pretrained image generator, we develop a speckle-robust SAR encoder and pretrain the conditional generator on this heterogeneous corpus. The resulting parent supports efficient adaptation across downstream datasets through low-rank adaptation (LoRA), updating only 0.60% of the generator parameters and requiring approximately one hour per dataset. Across six downstream benchmarks, GeoSET achieves state-of-the-art results in FID and DISTS with full fine-tuning or LoRA, demonstrating effective transfer across heterogeneous SAR-EO domains.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
30 of 43 references.
References · 30
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2025DINOv3cited by 1,414
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
18 more
- 2018Demystifying MMD GANscited by 1,293
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 88
- 2020SpaceNet 6: Multi-Sensor All Weather Mapping Datasetcited by 47
- 2021The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusioncited by 27
- 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
- 2025TerraMesh: A Planetary Mosaic of Multimodal Earth Observation Datacited by 14
- 2024Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translationcited by 10
- 20243MOS: Multi-sources, Multi-resolutions, and Multi-scenes dataset for Optical-SAR image matchingcited by 8
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
- 2025SARMAE: Masked Autoencoder for SAR Representation Learningcited by 8
- 2024Seg-CycleGAN : SAR-to-optical image translation guided by a downstream taskcited by 4
- 2023SAR2EO: A High-resolution Image Translation Framework with Denoising Enhancementcited by 3
- 2026SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cmcited by 2
Built on by
Not cited yet.