mlsanityData to 7 Oct 2026

Heterogeneous SAR-optical fusion for near-real-time land use and land cover mapping under cloud contamination: A novel framework and global benchmark dataset

arXiv 2606.17713 ↗First posted 16 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Optical remote sensing imagery is frequently degraded by cloud and cloud-shadow contamination, which limits its reliability for near-real-time land use and land cover (LULC) mapping. Although synthetic aperture radar (SAR) can provide cloud-penetrating structural information, existing SAR-optical fusion methods often assume reliable optical observations and insufficiently address the semantic uncertainty introduced by cloud contamination. To address this issue, we propose CloudLULC-Net, an end-to-end heterogeneous SAR-optical fusion framework that directly predicts LULC maps from cloud-contaminated Sentinel-2 imagery and temporally adjacent Sentinel-1 SAR observations. The proposed network incorporates optical reliability modulation to suppress unreliable optical responses, heterogeneous information adaptive aggregation to model high-order spatial-channel interactions between optical and SAR representations, and a unified semantic mapping transformer to organize fused features in a LULC-oriented latent space. A semantic anchor-guided optimization strategy is further introduced to improve the consistency of intermediate semantic representations. To support this task, we construct CloudLULC-Set, a large-scale benchmark dataset containing 40,223 curated SAR-optical-label triplets with pixel-level LULC annotations across diverse geographic regions and cloud conditions. Experimental results show that CloudLULC-Net achieves an OA of 86.60%, an F1-score of 83.29%, and an mIoU of 73.51%, outperforming representative heterogeneous reconstruction-first and end-to-end SAR-optical mapping methods. Comparisons with existing global LULC products and analyses under different cloud-cover levels further demonstrate the robustness and practical value of CloudLULC-Net for target-date LULC mapping in cloud-prone regions.The project is publicly available at: https://github.com/RSIIPAC/CloudLULC

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 57 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

18 of 57 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  4. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  5. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  6. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
  7. 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 276
  8. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
  9. 2019SEN12MS -- A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusioncited by 95
  10. 2024Frequency-aware Feature Fusion for Dense Image Predictioncited by 48
  11. 2020SpaceNet 6: Multi-Sensor All Weather Mapping Datasetcited by 47
  12. 2020Multi-Sensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagerycited by 36
6 more
  1. 2024Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Networkcited by 7
  2. 2023Holistic Dynamic Frequency Transformer for Image Fusion and Exposure Correctioncited by 4
  3. 2026SOMA-1M: A Large-Scale SAR-Optical Multi-resolution Alignment Dataset for Multi-Task Remote Sensingcited by 3
  4. 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensingcited by 3
  5. 2025PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classificationcited by 2
  6. 2021Self-supervised SAR-optical Data Fusion and Land-cover Mapping using Sentinel-1/-2 Imagescited by 1

Built on by

Not cited yet.