Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentation
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Long-tailed class imbalance remains a fundamental obstacle in semantic segmentation of high-resolution remote-sensing imagery, where dominant classes shape learned representations and rare classes are systematically under-segmented. This challenge becomes more acute in cross-domain settings such as LoveDA, which exhibits an explicit Urban/Rural split with substantial appearance differences and inconsistent class-frequency statistics across domains. We propose a prompt-controlled diffusion augmentation framework that generates paired label-image samples with explicit control over semantic composition and domain, enabling targeted enrichment of underrepresented classes rather than indiscriminate dataset expansion. A domain-aware, masked, ratio-conditioned discrete diffusion model first synthesizes layouts that satisfy class-ratio targets while preserving realistic spatial co-occurrence, and a ControlNet-guided diffusion model then renders photorealistic, domain-consistent images from these layouts. When mixed with real data, the resulting synthetic pairs improve multiple segmentation backbones, especially on minority classes and under domain shift, showing that better downstream segmentation comes from adding the right samples in the right proportions. Source codes, pretrained models, and synthetic datasets are available at hrefhttps://buddhi19.github.io/SyntheticGentextttbuddhi19.github.io/SyntheticGen.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 19 of its 25 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
19 of 25 references.
Closest ancestors · 2
Same direction, newest first
- 2023SatDM: Synthesizing Realistic Satellite Image with Semantic Layout Conditioning using Diffusion Models28 Sep
- 2023RSDiff: Remote Sensing Image Generation from Text Using Diffusion Model3 Sep
Other references · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
5 more
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
- 2023Class-Balancing Diffusion Modelscited by 47
- 2023AerialFormer: Multi-resolution Transformer for Aerial Image Segmentationcited by 23
- 2023Distribution Shift Inversion for Out-of-Distribution Predictioncited by 23
- 2025Uncertainty-Aware ControlNet: Bridging Domain Gaps with Synthetic Image Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Tackling Few-Shot Segmentation in Remote Sensing via Inpainting Diffusion Model
- 2025A Gift from the Integration of Discriminative and Diffusion-based Generative Learning: Boundary Refinement Remote Sensing Semantic Segmentation
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation
- 2024P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentation
- 2026Noise2Map: End-to-End Diffusion Model for Semantic Segmentation and Change Detection
- 2025Source-Free Domain Adaptive Semantic Segmentation of Remote Sensing Images with Diffusion-Guided Label Enrichment
- 2025Task-Oriented Data Synthesis and Control-Rectify Sampling for Remote Sensing Semantic Segmentation
- 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentation