The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion
Not on the map. Why?
Abstract (arXiv)
While deep learning techniques have an increasing impact on many technical fields, gathering sufficient amounts of training data is a challenging problem in remote sensing. In particular, this holds for applications involving data from multiple sensors with heterogeneous characteristics. One example for that is the fusion of synthetic aperture radar (SAR) data and optical imagery. With this paper, we publish the SEN1-2 dataset to foster deep learning research in SAR-optical data fusion. SEN1-2 comprises 282,384 pairs of corresponding image patches, collected from across the globe and throughout all meteorological seasons. Besides a detailed description of the dataset, we show exemplary results for several possible applications, such as SAR image colorization, SAR-optical image matching, and creation of artificial optical images from SAR input data. Since SEN1-2 is the first large open dataset of this kind, we believe it will support further developments in the field of deep learning for remote sensing as well as multi-sensor data fusion.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 5; 2024: 10; 2025: 12; 2026: 8.
42 papers.
Sort:
By area:
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2021The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusioncited by 27
- 2022SAR Despeckling using a Denoising Diffusion Probabilistic Modelcited by 19
- 2024Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translationcited by 10
- 2024Planted: a dataset for planted forest identification from multi-satellite time seriescited by 9
- 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Surveycited by 9
- 2025Multi-Resolution SAR and Optical Remote Sensing Image Registration Methods: A Review, Datasets, and Future Perspectivescited by 9
- 20243MOS: Multi-sources, Multi-resolutions, and Multi-scenes dataset for Optical-SAR image matchingcited by 8
- 2024MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generationcited by 8
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
- 2025Cross-modal Ship Re-Identification via Optical and SAR Imagery: A Novel Dataset and Methodcited by 8
- 2023Advances and Challenges in Multimodal Remote Sensing Image Registrationcited by 7
30 more
- 2024M3LEO: A Multi-Modal, Multi-Label Earth Observation Dataset Integrating Interferometric SAR and Multispectral Datacited by 6
- 2025MIFNet: Learning Modality-Invariant Features for Generalizable Multimodal Image Matchingcited by 6
- 2025SARMAE: Masked Autoencoder for SAR Representation Learningcited by 6
- 2022SAR-to-EO Image Translation with Multi-Conditional Adversarial Networkscited by 3
- 2023Incomplete Multimodal Learning for Remote Sensing Data Fusioncited by 3
- 2024Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillationcited by 3
- 2024SAR to Optical Image Translation with Color Supervised Diffusion Modelcited by 3
- 2025SAR-TEXT: A Large-Scale SAR Image-Text Dataset Built with SAR-Narrator and A Progressive Learning Strategy for Downstream Taskscited by 3
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translationcited by 3
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensingcited by 3
- 2021Homography augumented momentum constrastive learning for SAR image retrievalcited by 2
- 2022Amplitude SAR Imagery Splicing Localizationcited by 2
- 2023TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shiftingcited by 2
- 2025CSHNet: A Novel Information Asymmetric Image Translation Methodcited by 2
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysiscited by 2
- 2021Learning a Joint Embedding of Multiple Satellite Sensors: A Case Study for Lake Ice Monitoringcited by 1
- 2023SAR-to-Optical Image Translation via Thermodynamics-inspired Networkcited by 1
- 2023A Benchmarking Protocol for SAR Colorization: From Regression to Deep Learning Approachescited by 1
- 2025Multi-Expert Learning Framework with the State Space Model for Optical and SAR Image Registrationcited by 1
- 2026SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cmcited by 1
- 2024REMM:Rotation-Equivariant Framework for End-to-End Multimodal Image Matchingcited by 0
- 2025Semi-supervised Multiscale Matching for SAR-Optical Imagecited by 0
- 2025SOMA: Feature Gradient Enhanced Affine-Flow Matching for SAR-Optical Registrationcited by 0
- 2025Deepfake Geography: Detecting AI-Generated Satellite Imagescited by 0
- 2025Maritime object classification with SAR imagery using quantum kernel methodscited by 0
- 2026Matching of SAR and optical images based on transformation to shared modalitycited by 0
- 2026TAR: Text Semantic Assisted Cross-modal Image Registration Framework for Optical and SAR Imagescited by 0
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modelingcited by 0
- 2026Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migrationcited by 0
- 2026LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matchingcited by 0
- 2026LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matching4 Aug 2026
- 2026Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migration27 Jun 2026
- 2026SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cm18 Jun 2026
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026TAR: Text Semantic Assisted Cross-modal Image Registration Framework for Optical and SAR Images12 May 2026
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensing4 Mar 2026
- 2026Matching of SAR and optical images based on transformation to shared modality13 Feb 2026
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation26 Jan 2026
- 2025SARMAE: Masked Autoencoder for SAR Representation Learning18 Dec 2025
- 2025Maritime object classification with SAR imagery using quantum kernel methods12 Dec 2025
- 2025Deepfake Geography: Detecting AI-Generated Satellite Images21 Nov 2025
- 2025SOMA: Feature Gradient Enhanced Affine-Flow Matching for SAR-Optical Registration17 Nov 2025
30 more
- 2025Semi-supervised Multiscale Matching for SAR-Optical Image11 Aug 2025
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis4 Aug 2025
- 2025SAR-TEXT: A Large-Scale SAR Image-Text Dataset Built with SAR-Narrator and A Progressive Learning Strategy for Downstream Tasks24 Jul 2025
- 2025Multi-Expert Learning Framework with the State Space Model for Optical and SAR Image Registration6 Jul 2025
- 2025Cross-modal Ship Re-Identification via Optical and SAR Imagery: A Novel Dataset and Method27 Jun 2025
- 2025Multi-Resolution SAR and Optical Remote Sensing Image Registration Methods: A Review, Datasets, and Future Perspectives3 Feb 2025
- 2025MIFNet: Learning Modality-Invariant Features for Generalizable Multimodal Image Matching20 Jan 2025
- 2025CSHNet: A Novel Information Asymmetric Image Translation Method17 Jan 2025
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation16 Nov 2024
- 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Survey5 Nov 2024
- 2024MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generation26 Oct 2024
- 2024Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translation15 Aug 2024
- 2024SAR to Optical Image Translation with Color Supervised Diffusion Model24 Jul 2024
- 2024REMM:Rotation-Equivariant Framework for End-to-End Multimodal Image Matching16 Jul 2024
- 2024Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation8 Jul 2024
- 2024M3LEO: A Multi-Modal, Multi-Label Earth Observation Dataset Integrating Interferometric SAR and Multispectral Data6 Jun 2024
- 2024Planted: a dataset for planted forest identification from multi-satellite time series24 May 2024
- 20243MOS: Multi-sources, Multi-resolutions, and Multi-scenes dataset for Optical-SAR image matching1 Apr 2024
- 2023TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting31 Dec 2023
- 2023A Benchmarking Protocol for SAR Colorization: From Regression to Deep Learning Approaches12 Oct 2023
- 2023SAR-to-Optical Image Translation via Thermodynamics-inspired Network23 May 2023
- 2023Incomplete Multimodal Learning for Remote Sensing Data Fusion22 Apr 2023
- 2023Advances and Challenges in Multimodal Remote Sensing Image Registration2 Feb 2023
- 2022EarthNets: Empowering AI in Earth Observation10 Oct 2022
- 2022SAR-to-EO Image Translation with Multi-Conditional Adversarial Networks26 Jul 2022
- 2022SAR Despeckling using a Denoising Diffusion Probabilistic Model9 Jun 2022
- 2022Amplitude SAR Imagery Splicing Localization7 Jan 2022
- 2021Homography augumented momentum constrastive learning for SAR image retrieval21 Sep 2021
- 2021Learning a Joint Embedding of Multiple Satellite Sensors: A Case Study for Lake Ice Monitoring19 Jul 2021
- 2021The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusion15 Mar 2021
- 2024Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translationcited by 10
- 2024MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generationcited by 8
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
- 2024Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillationcited by 3
- 2024SAR to Optical Image Translation with Color Supervised Diffusion Modelcited by 3
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translationcited by 3
- 2025Deepfake Geography: Detecting AI-Generated Satellite Imagescited by 0
- 2026Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migrationcited by 0
- 2026Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migration27 Jun 2026
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation26 Jan 2026
- 2025Deepfake Geography: Detecting AI-Generated Satellite Images21 Nov 2025
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation16 Nov 2024
- 2024MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generation26 Oct 2024
- 2024Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translation15 Aug 2024
- 2024SAR to Optical Image Translation with Color Supervised Diffusion Model24 Jul 2024
- 2024Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation8 Jul 2024
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2021The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusioncited by 27
- 2022SAR Despeckling using a Denoising Diffusion Probabilistic Modelcited by 19
- 2024Planted: a dataset for planted forest identification from multi-satellite time seriescited by 9
- 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Surveycited by 9
- 2025Multi-Resolution SAR and Optical Remote Sensing Image Registration Methods: A Review, Datasets, and Future Perspectivescited by 9
- 20243MOS: Multi-sources, Multi-resolutions, and Multi-scenes dataset for Optical-SAR image matchingcited by 8
- 2025Cross-modal Ship Re-Identification via Optical and SAR Imagery: A Novel Dataset and Methodcited by 8
- 2023Advances and Challenges in Multimodal Remote Sensing Image Registrationcited by 7
- 2024M3LEO: A Multi-Modal, Multi-Label Earth Observation Dataset Integrating Interferometric SAR and Multispectral Datacited by 6
- 2025MIFNet: Learning Modality-Invariant Features for Generalizable Multimodal Image Matchingcited by 6
- 2025SARMAE: Masked Autoencoder for SAR Representation Learningcited by 6
12 most cited of 33 All 33 (JSON)
- 2026LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matching4 Aug 2026
- 2026SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cm18 Jun 2026
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026TAR: Text Semantic Assisted Cross-modal Image Registration Framework for Optical and SAR Images12 May 2026
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensing4 Mar 2026
- 2026Matching of SAR and optical images based on transformation to shared modality13 Feb 2026
- 2025SARMAE: Masked Autoencoder for SAR Representation Learning18 Dec 2025
- 2025Maritime object classification with SAR imagery using quantum kernel methods12 Dec 2025
- 2025SOMA: Feature Gradient Enhanced Affine-Flow Matching for SAR-Optical Registration17 Nov 2025
- 2025Semi-supervised Multiscale Matching for SAR-Optical Image11 Aug 2025
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis4 Aug 2025
- 2025Multi-Expert Learning Framework with the State Space Model for Optical and SAR Image Registration6 Jul 2025
12 newest of 33 All 33 (JSON)