Multi-Class Segmentation from Aerial Views using Recursive Noise Diffusion
Not on the map. Why?
Abstract (arXiv)
Semantic segmentation from aerial views is a crucial task for autonomous drones, as they rely on precise and accurate segmentation to navigate safely and efficiently. However, aerial images present unique challenges such as diverse viewpoints, extreme scale variations, and high scene complexity. In this paper, we propose an end-to-end multi-class semantic segmentation diffusion model that addresses these challenges. We introduce recursive denoising to allow information to propagate through the denoising process, as well as a hierarchical multi-scale approach that complements the diffusion process. Our method achieves promising results on the UAVid dataset and state-of-the-art performance on the Vaihingen Building segmentation benchmark. Being the first iteration of this method, it shows great promise for future improvements.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 45 of its 66 references that are in the map. First posted on arXiv 1 Dec 2022.
Builds on
45 of 66 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
33 more
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2018Efficient Attention: Attention with Linear Complexitiescited by 366
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2017Dilated Residual Networkscited by 293
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
- 2019Structured Knowledge Distillation for Dense Predictioncited by 277
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 275
- 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
- 2020Hierarchical Multi-Scale Attention for Semantic Segmentationcited by 183
- 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
- 2015Attention to Scale: Scale-aware Semantic Image Segmentationcited by 169
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
- 2018Learning Semantic Segmentation from Synthetic Data: A Geometrically Guided Input-Output Adaptation Approachcited by 119
- 2020Unsupervised Domain Adaptation in Semantic Segmentation: a Reviewcited by 88
- 2016Semantic Segmentation using Adversarial Networkscited by 73
- 2018Learning deep structured active contours end-to-endcited by 38
- 2019Unsupervised Domain Adaptation using Generative Adversarial Networks for Semantic Segmentation of Aerial Imagescited by 32
- 2019DARNet: Deep Active Ray Network for Building Segmentationcited by 30
- 2021Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Imagescited by 28
- 2014Feedforward semantic segmentation with zoom-out featurescited by 21
- 2020End-to-End Trainable Deep Active Contour Models for Automated Image Segmentation: Delineating Buildings in Aerial Imagerycited by 16
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 1; 2026: 1.
8 papers.
- 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectivescited by 27
- 2024DiffDet4SAR: Diffusion-based Aircraft Target Detection Network for SAR Imagescited by 15
- 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?cited by 10
- 2023Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentationcited by 5
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Modelscited by 5
- 2023Single-View Height Estimation with Conditional Diffusion Probabilistic Modelscited by 1
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Datacited by 1
- 2024P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentationcited by 0
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data3 Mar 2026
- 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?10 Mar 2025
- 2024P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentation30 May 2024
- 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives13 Apr 2024
- 2024DiffDet4SAR: Diffusion-based Aircraft Target Detection Network for SAR Images4 Apr 2024
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Models30 Aug 2023
- 2023Single-View Height Estimation with Conditional Diffusion Probabilistic Models26 Apr 2023
- 2023Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation10 Mar 2023
Similar, not cited
Close in wording, no citation either way
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation
- 2023Stable Diffusion For Aerial Object Detection
- 2026Restrict, Don't Retrain: Inference-Time VLM Guidance for Zero-Shot Aerial Segmentation
- 2025Top2Ground: A Height-Aware Dual Conditioning Diffusion Model for Robust Aerial-to-Ground View Generation
- 2025AetherVision-Bench: An Open-Vocabulary RGB-Infrared Benchmark for Multi-Angle Segmentation across Aerial and Ground Perspectives
- 2026SkyVLaM: Multimodal Large Language Model for UAV Video Understanding in Remote Sensing
- 2026BEV-Denoise: Learning Intrinsic Noise for Accurate Bird's-Eye-View Semantic Segmentation
- 2025AeroReformer: Aerial Referring Transformer for UAV-based Referring Image Segmentation