# Cloud and Cloud Shadow Segmentation for Remote Sensing Imagery via Filtered Jaccard Loss Function and Parametric Augmentation

arXiv: https://arxiv.org/abs/2001.08768 · HTML: https://mlsanity.com/paper/2001.08768/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Jan 2020.

## Built on by (most cited first, 7 of 7)

- [EarthNets: Empowering AI in Earth Observation](https://mlsanity.com/paper/2210.04936/) (2022)
- [SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks](https://mlsanity.com/paper/2111.08349/) (2021)
- [Machine Learning in Space: Surveying the Robustness of on-board ML models to Radiation](https://mlsanity.com/paper/2405.02642/) (2024)
- [FPGA-Based Neural Network Accelerators for Space Applications: A Survey](https://mlsanity.com/paper/2504.16173/) (2025)
- [WakeupUrban: Unsupervised Semantic Segmentation of Mid-20th century Urban Landscapes with Satellite Imagery](https://mlsanity.com/paper/2506.09476/) (2025)
- [Distribution-aware Interactive Attention Network and Large-scale Cloud Recognition Benchmark on FY-4A Satellite Image](https://mlsanity.com/paper/2401.03182/) (2024)
- [TIRAuxCloud: A Thermal Infrared Dataset for Day and Night Cloud Detection](https://mlsanity.com/paper/2602.21905/) (2026)

## Abstract (arXiv)

Cloud and cloud shadow segmentation are fundamental processes in optical remote sensing image analysis. Current methods for cloud/shadow identification in geospatial imagery are not as accurate as they should, especially in the presence of snow and haze. This paper presents a deep learning-based framework for the detection of cloud/shadow in Landsat 8 images. Our method benefits from a convolutional neural network, Cloud-Net+ (a modification of our previously proposed Cloud-Net citemyigarss) that is trained with a novel loss function (Filtered Jaccard Loss). The proposed loss function is more sensitive to the absence of foreground objects in an image and penalizes/rewards the predicted mask more accurately than other common loss functions. In addition, a sunlight direction-aware data augmentation technique is developed for the task of cloud shadow detection to extend the generalization ability of the proposed model by expanding existing training sets. The combination of Cloud-Net+, Filtered Jaccard Loss function, and the proposed augmentation algorithm delivers superior results on four public cloud/shadow detection datasets. Our experiments on Pascal VOC dataset exemplifies the applicability and quality of our proposed network and loss function in other computer vision applications.
