Heterogeneous SAR-optical fusion for near-real-time land use and land cover mapping under cloud contamination: A novel framework and global benchmark dataset
Not on the map. Why?
Abstract (arXiv)
Optical remote sensing imagery is frequently degraded by cloud and cloud-shadow contamination, which limits its reliability for near-real-time land use and land cover (LULC) mapping. Although synthetic aperture radar (SAR) can provide cloud-penetrating structural information, existing SAR-optical fusion methods often assume reliable optical observations and insufficiently address the semantic uncertainty introduced by cloud contamination. To address this issue, we propose CloudLULC-Net, an end-to-end heterogeneous SAR-optical fusion framework that directly predicts LULC maps from cloud-contaminated Sentinel-2 imagery and temporally adjacent Sentinel-1 SAR observations. The proposed network incorporates optical reliability modulation to suppress unreliable optical responses, heterogeneous information adaptive aggregation to model high-order spatial-channel interactions between optical and SAR representations, and a unified semantic mapping transformer to organize fused features in a LULC-oriented latent space. A semantic anchor-guided optimization strategy is further introduced to improve the consistency of intermediate semantic representations. To support this task, we construct CloudLULC-Set, a large-scale benchmark dataset containing 40,223 curated SAR-optical-label triplets with pixel-level LULC annotations across diverse geographic regions and cloud conditions. Experimental results show that CloudLULC-Net achieves an OA of 86.60%, an F1-score of 83.29%, and an mIoU of 73.51%, outperforming representative heterogeneous reconstruction-first and end-to-end SAR-optical mapping methods. Comparisons with existing global LULC products and analyses under different cloud-cover levels further demonstrate the robustness and practical value of CloudLULC-Net for target-date LULC mapping in cloud-prone regions.The project is publicly available at: https://github.com/RSIIPAC/CloudLULC
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 57 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
18 of 57 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2021FNet: Mixing Tokens with Fourier Transformscited by 343
- 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 276
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
- 2019SEN12MS -- A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusioncited by 95
- 2024Frequency-aware Feature Fusion for Dense Image Predictioncited by 48
- 2020SpaceNet 6: Multi-Sensor All Weather Mapping Datasetcited by 47
- 2020Multi-Sensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagerycited by 36
6 more
- 2024Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Networkcited by 7
- 2023Holistic Dynamic Frequency Transformer for Image Fusion and Exposure Correctioncited by 4
- 2026SOMA-1M: A Large-Scale SAR-Optical Multi-resolution Alignment Dataset for Multi-Task Remote Sensingcited by 3
- 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensingcited by 3
- 2025PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classificationcited by 2
- 2021Self-supervised SAR-optical Data Fusion and Land-cover Mapping using Sentinel-1/-2 Imagescited by 1
Built on by
Not cited yet.