mlsanityData to 7 Oct 2026

Seeing Through Clouds in Satellite Images

arXiv 2106.08408 ↗First posted 15 Jun 2021cs.CV eess.IVcited by 13

Not on the map. Why?

Abstract (arXiv)

This paper presents a neural-network-based solution to recover pixels occluded by clouds in satellite images. We leverage radio frequency (RF) signals in the ultra/super-high frequency band that penetrate clouds to help reconstruct the occluded regions in multispectral images. We introduce the first multi-modal multi-temporal cloud removal model. Our model uses publicly available satellite observations and produces daily cloud-free images. Experimental results show that our system significantly outperforms baselines by 8dB in PSNR. We also demonstrate use cases of our system in digital agriculture, flood monitoring, and wildfire detection. We will release the processed dataset to facilitate future research.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 26 of its 116 references that are in the map. First posted on arXiv 15 Jun 2021.

Builds on

26 of 116 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  7. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  8. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  9. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  10. 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 515
  11. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  12. 2018Audio-Visual Scene Analysis with Self-Supervised Multisensory Featurescited by 335
14 more
  1. 2018The Sound of Pixelscited by 258
  2. 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 178
  3. 2019The Sound of Motionscited by 145
  4. 2018Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Imagescited by 118
  5. 2019Deep Flow-Guided Video Inpaintingcited by 116
  6. 2018Learning to Separate Object Sounds by Watching Unlabeled Videocited by 114
  7. 2019Deep Video Inpaintingcited by 107
  8. 2019SEN12MS -- A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusioncited by 95
  9. 2019Image inpainting: A reviewcited by 89
  10. 2017Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Netscited by 26
  11. 2019Making the Invisible Visible: Action Recognition Through Walls and Occlusionscited by 25
  12. 2014A variational approach to stable principal component pursuitcited by 8
  13. 2018Non-local tensor completion for multitemporal remotely sensed images inpaintingcited by 4
  14. 2016Removing Clouds and Recovering Ground Observations in Satellite Image Sequences via Temporally Contiguous Robust Matrix Completioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 1; 2023: 3; 2024: 4; 2025: 2; 2026: 2.

13 papers.

Sort:

By area:

  1. 2024RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculturecited by 80
  2. 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignmentcited by 71
  3. 2023GPT-4 as an Agronomist Assistant? Answering Agriculture Exams Using Large Language Modelscited by 12
  4. 2023U-TILISE: A Sequence-to-sequence Model for Cloud Removal in Optical Satellite Time Seriescited by 8
  5. 2024AllClear: A Comprehensive Dataset and Benchmark for Cloud Removal in Satellite Imagerycited by 7
  6. 2024S4: Self-Supervised Sensing Across the Spectrumcited by 5
  7. 2025A Satellite-Ground Synergistic Large Vision-Language Model System for Earth Observationcited by 2
  8. 2022Enhancing Satellite Imagery using Deep Learning for the Sensor To Shooter Timelinecited by 1
  9. 2024Domain Adaptation for Sustainable Soil Management using Causal and Contrastive Constraint Minimizationcited by 1
  10. 2025CloudBreaker: Breaking the Cloud Covers of Sentinel-2 Images using Multi-Stage Trained Conditional Flow Matching on Sentinel-1cited by 1
  11. 2021Cloud Removal from Satellite Imagescited by 0
  12. 2026HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Datescited by 0
1 more
  1. 2026To Remove or Not to Remove Clouds: A Comparative Analysis and Fusion of Raw SAR and Synthetic NDWI for Overcast Water Segmentationcited by 0