UDHF2-Net: Uncertainty-diffusion-model-based High-Frequency TransFormer Network for Remotely Sensed Imagery Interpretation
Not on the map. Why?
Abstract (arXiv)
Remotely sensed imagery interpretation (RSII) faces the three major problems: (1) objective representation of spatial distribution patterns; (2) edge uncertainty problem caused by downsampling encoder and intrinsic edge noises (e.g., mixed pixel and edge occlusion etc.); and (3) false detection problem caused by geometric registration error in change detection. To solve the aforementioned problems, uncertainty-diffusion-model-based high-Frequency TransFormer network (UDHF2-Net) is the first to be proposed, whose superiorities are as follows: (1) a spatially-stationary-and-non-stationary high-frequency connection paradigm (SHCP) is proposed to enhance the interaction of spatially frequency-wise stationary and non-stationary features to yield high-fidelity edge extraction result. Inspired by HRFormer, SHCP proposes high-frequency-wise stream to replace high-resolution-wise stream in HRFormer through the whole encoder-decoder process with parallel frequency-wise high-to-low streams, so it improves the edge extraction accuracy by continuously remaining high-frequency information; (2) a mask-and-geo-knowledge-based uncertainty diffusion module (MUDM), which is a self-supervised learning strategy, is proposed to improve the edge accuracy of extraction and change detection by gradually removing the simulated spectrum noises based on geo-knowledge and the generated diffused spectrum noises; (3) a frequency-wise semi-pseudo-Siamese UDHF2-Net is the first to be proposed to balance accuracy and complexity for change detection. Besides the aforementioned spectrum noises in semantic segmentation, MUDM is also a self-supervised learning strategy to effectively reduce the edge false change detection from the generated imagery with geometric registration error.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 93 references that are in the map. First posted on arXiv 23 Jun 2024.
Builds on
37 of 93 references.
References · 37
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
25 more
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2018Efficient Attention: Attention with Linear Complexitiescited by 366
- 2018Fully Convolutional Siamese Networks for Change Detectioncited by 305
- 2021Remote Sensing Image Change Detection with Transformerscited by 305
- 2022A Transformer-Based Siamese Network for Change Detectioncited by 243
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
- 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
- 2017PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrievalcited by 96
- 2019Building Change Detection for Remote Sensing Images Using a Dual Task Constrained Deep Siamese Convolutional Network Modelcited by 84
- 2022Changer: Feature Interaction is What You Need for Change Detectioncited by 78
- 2021SwiftNet: Real-time Video Object Segmentationcited by 67
- 2020Multi-Attention-Network for Semantic Segmentation of Fine Resolution Remote Sensing Imagescited by 59
- 2020MLRSNet: A Multi-label High Spatial Resolution Remote Sensing Dataset for Semantic Scene Understandingcited by 59
- 2022Fully Convolutional Change Detection Framework with Generative Adversarial Network for Unsupervised, Weakly Supervised and Regional Supervised Change Detectioncited by 46
- 2021Endmember-Guided Unmixing Network (EGU-Net): A General Deep Learning Framework for Self-Supervised Hyperspectral Unmixingcited by 29
- 2021Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Imagescited by 28
- 2023DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Imagescited by 26
- 2023Exchanging Dual Encoder-Decoder: A New Strategy for Change Detection with Semantic Guidance and Spatial Localizationcited by 21
- 2019Detecting Urban Changes with Recurrent Neural Networks from Multitemporal Sentinel-2 Datacited by 20
- 2016Dense semantic labeling of sub-decimeter resolution images with convolutional neural networkscited by 19
- 2024SFFNet: A Wavelet-Based Spatial and Frequency Domain Fusion Network for Remote Sensing Segmentationcited by 16
- 2023OGMN: Occlusion-guided Multi-task Network for Object Detection in UAV Imagescited by 8
- 2022Pansharpening via Frequency-Aware Fusion Network with Explicit Similarity Constraintscited by 5
- 2018Deep Learning Hyperspectral Image Classification Using Multiple Class-based Denoising Autoencoders, Mixed Pixel Training Augmentation, and Morphological Operationscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Frequency-Aware Vision-Language Multimodality Generalization Network for Remote Sensing Image Classification
- 2024Adaptive Semantic-Enhanced Denoising Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution
- 2025TTRD3: Texture Transfer Residual Denoising Dual Diffusion Model for Remote Sensing Image Super-Resolution
- 2024Siamese Meets Diffusion Network: SMDNet for Enhanced Change Detection in High-Resolution RS Imagery
- 2024Frequency-Adaptive Pan-Sharpening with Mixture of Experts
- 2024Mask Approximation Net: A Novel Diffusion Model Approach for Remote Sensing Change Captioning
- 2026Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion
- 2025Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolution