mlsanityData to 14 Oct 2026

Exploring the Capability of Text-to-Image Diffusion Models with Structural Edge Guidance for Multi-Spectral Satellite Image Inpainting

arXiv 2311.03008 ↗First posted 6 Nov 2023cs.CVcited by 9

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

The letter investigates the utility of text-to-image inpainting models for satellite image data. Two technical challenges of injecting structural guiding signals into the generative process as well as translating the inpainted RGB pixels to a wider set of MSI bands are addressed by introducing a novel inpainting framework based on StableDiffusion and ControlNet as well as a novel method for RGB-to-MSI translation. The results on a wider set of data suggest that the inpainting synthesized via StableDiffusion suffers from undesired artifacts and that a simple alternative of self-supervised internal inpainting achieves a higher quality of synthesis.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 19 of its 30 references that are in the map. First posted on arXiv 6 Nov 2023.

Builds on

19 of 30 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan

Other references · 18

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  10. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  11. 2023Consistency Modelscited by 1,822
  12. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
6 more
  1. 2017Deep Image Priorcited by 1,098
  2. 2015Holistically-Nested Edge Detectioncited by 592
  3. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  4. 2022SEN12MS-CR-TS: A Remote Sensing Data Set for Multi-modal Multi-temporal Cloud Removalcited by 32
  5. 2023From LAION-5B to LAION-EO: Filtering Billions of Images Using Anchor Datasets for Satellite Image Extractioncited by 14
  6. 2022Convolutional Neural Processes for Inpainting Satellite Imagescited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 8.

9 papers.

  1. 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectivescited by 27
  2. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
  3. 2025The Change You Want To Detect: Semantic Change Detection In Earth Observation With Hybrid Data Generationcited by 12
  4. 2025DiffRIS: Enhancing Referring Remote Sensing Image Segmentation with Pre-trained Text-to-Image Diffusion Modelscited by 6
  5. 2025DiffusionRL: Efficient Training of Diffusion Policies for Robotic Grasping Using RL-Adapted Large-Scale Datasetscited by 4
  6. 2025COP-GEN-Beta: Unified Generative Modelling of COPernicus Imagery Thumbnailscited by 2
  7. 2025DM-FNet: Unified multimodal medical image fusion via diffusion process-trained encoder-decodercited by 2
  8. 2025CompSlider: Compositional Slider for Disentangled Multiple-Attribute Image Generationcited by 2
  9. 2025KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Imagecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025One Stone with Two Birds: A Null-Text-Null Frequency-Aware Diffusion Models for Text-Guided Image Inpainting
  2. 2024Improving Text-guided Object Inpainting with Semantic Pre-inpainting
  3. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery
  4. 2025Ultra High-Resolution Image Inpainting with Patch-Based Content Consistency Adapter
  5. 2024RAD: Region-Aware Diffusion Models for Image Inpainting
  6. 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Models
  7. 2024Diffusion-based image inpainting with internal learning
  8. 2026Training-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model