# The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion

arXiv: https://arxiv.org/abs/1807.01569 · HTML: https://mlsanity.com/paper/1807.01569/

## Key facts

- Cited by 42 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jul 2018.

## Built on by (most cited first, 30 of 42)

- [EarthNets: Empowering AI in Earth Observation](https://mlsanity.com/paper/2210.04936/) (2022)
- [The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusion](https://mlsanity.com/paper/2103.08259/) (2021)
- [SAR Despeckling using a Denoising Diffusion Probabilistic Model](https://mlsanity.com/paper/2206.04514/) (2022)
- [Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translation](https://mlsanity.com/paper/2408.07947/) (2024)
- [Planted: a dataset for planted forest identification from multi-satellite time series](https://mlsanity.com/paper/2406.18554/) (2024)
- [Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Survey](https://mlsanity.com/paper/2411.05027/) (2024)
- [Multi-Resolution SAR and Optical Remote Sensing Image Registration Methods: A Review, Datasets, and Future Perspectives](https://mlsanity.com/paper/2502.01002/) (2025)
- [3MOS: Multi-sources, Multi-resolutions, and Multi-scenes dataset for Optical-SAR image matching](https://mlsanity.com/paper/2404.00838/) (2024)
- [MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generation](https://mlsanity.com/paper/2410.22362/) (2024)
- [C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation](https://mlsanity.com/paper/2411.10788/) (2024)
- [Cross-modal Ship Re-Identification via Optical and SAR Imagery: A Novel Dataset and Method](https://mlsanity.com/paper/2506.22027/) (2025)
- [SARMAE: Masked Autoencoder for SAR Representation Learning](https://mlsanity.com/paper/2512.16635/) (2025)
- [Advances and Challenges in Multimodal Remote Sensing Image Registration](https://mlsanity.com/paper/2302.00912/) (2023)
- [M3LEO: A Multi-Modal, Multi-Label Earth Observation Dataset Integrating Interferometric SAR and Multispectral Data](https://mlsanity.com/paper/2406.04230/) (2024)
- [MIFNet: Learning Modality-Invariant Features for Generalizable Multimodal Image Matching](https://mlsanity.com/paper/2501.11299/) (2025)
- [Any2Any: Unified Arbitrary Modality Translation for Remote Sensing](https://mlsanity.com/paper/2603.04114/) (2026)
- [SAR-to-EO Image Translation with Multi-Conditional Adversarial Networks](https://mlsanity.com/paper/2207.13184/) (2022)
- [Incomplete Multimodal Learning for Remote Sensing Data Fusion](https://mlsanity.com/paper/2304.11381/) (2023)
- [Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation](https://mlsanity.com/paper/2407.06095/) (2024)
- [SAR to Optical Image Translation with Color Supervised Diffusion Model](https://mlsanity.com/paper/2407.16921/) (2024)
- [SAR-TEXT: A Large-Scale SAR Image-Text Dataset Built with SAR-Narrator and A Progressive Learning Strategy for Downstream Tasks](https://mlsanity.com/paper/2507.18743/) (2025)
- [SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis](https://mlsanity.com/paper/2508.02384/) (2025)
- [Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation](https://mlsanity.com/paper/2601.18623/) (2026)
- [Homography augumented momentum constrastive learning for SAR image retrieval](https://mlsanity.com/paper/2109.10329/) (2021)
- [Amplitude SAR Imagery Splicing Localization](https://mlsanity.com/paper/2201.02409/) (2022)
- [TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting](https://mlsanity.com/paper/2401.00440/) (2023)
- [CSHNet: A Novel Information Asymmetric Image Translation Method](https://mlsanity.com/paper/2501.10197/) (2025)
- [SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cm](https://mlsanity.com/paper/2606.20523/) (2026)
- [Learning a Joint Embedding of Multiple Satellite Sensors: A Case Study for Lake Ice Monitoring](https://mlsanity.com/paper/2107.09092/) (2021)
- [SAR-to-Optical Image Translation via Thermodynamics-inspired Network](https://mlsanity.com/paper/2305.13839/) (2023)

## Abstract (arXiv)

While deep learning techniques have an increasing impact on many technical fields, gathering sufficient amounts of training data is a challenging problem in remote sensing. In particular, this holds for applications involving data from multiple sensors with heterogeneous characteristics. One example for that is the fusion of synthetic aperture radar (SAR) data and optical imagery. With this paper, we publish the SEN1-2 dataset to foster deep learning research in SAR-optical data fusion. SEN1-2 comprises 282,384 pairs of corresponding image patches, collected from across the globe and throughout all meteorological seasons. Besides a detailed description of the dataset, we show exemplary results for several possible applications, such as SAR image colorization, SAR-optical image matching, and creation of artificial optical images from SAR input data. Since SEN1-2 is the first large open dataset of this kind, we believe it will support further developments in the field of deep learning for remote sensing as well as multi-sensor data fusion.