Hierarchical Adaptive Feature Refinement Network for VHR Remote Sensing Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Semantic segmentation of very-high-resolution (VHR) remote sensing imagery increasingly benefits from strong pretrained hierarchical encoders, yet exploiting their multi-stage representations remains difficult. Nearby regions demand different balances between fine detail and semantic context, aggressive task-specific transformations perturb useful pretrained features, and conventional semantic supervision provides limited structural guidance. We present HAFR-Net, a progressive refinement framework that adaptively organizes and conservatively refines hierarchical representations instead of replacing them with a monolithic decoder transformation. Heterogeneity-Guided Stage-Adaptive Fusion (HG-SAF) predicts dense stage weights conditioned on local feature variation. A Frequency-Residual Adapter (FRA) then injects frequency information through a bounded, zero-initialized residual branch that keeps the fused representation as its reference. A Confusion-Aware Tri-Prior Decoder (CATP) finally regularizes the prediction with boundary, objectness, and training-derived class-relation cues. Under a matched Swin-B training and single-scale inference protocol, HAFR-Net attains 84.12%, 87.86%, 55.17%, and 67.70% mIoU on ISPRS Vaihingen, ISPRS Potsdam, LoveDA, and OpenEarthMap, improving the matched UPerNet baseline by 0.55, 0.95, 1.55, and 1.84 percentage points, respectively. Controlled analyses further show consistent spatial reweighting beyond content-only routing, improved boundary and thin-structure accuracy over matched spatial and spectral alternatives, and reduced confusion on pre-declared class pairs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 62 references that are in the map. First posted on arXiv 16 Aug 2026.
Builds on
42 of 62 references.
References · 42
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2016Pyramid Scene Parsing Networkcited by 2,479
30 more
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2021Going deeper with Image Transformerscited by 764
- 2017Learning multiple visual domains with residual adapterscited by 557
- 2021FNet: Mixing Tokens with Fourier Transformscited by 347
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2021Global Filter Networks for Image Classificationcited by 260
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2018Boundary loss for highly unbalanced segmentationcited by 190
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 188
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 167
- 2019Gated-SCNN: Gated Shape CNNs for Semantic Segmentationcited by 166
- 2016Richer Convolutional Features for Edge Detectioncited by 143
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2018CGNet: A Light-weight Context Guided Network for Semantic Segmentationcited by 94
- 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 82
- 2020Multi-Attention-Network for Semantic Segmentation of Fine Resolution Remote Sensing Imagescited by 59
- 2021A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Imagescited by 56
- 2024RS3Mamba: Visual State Space Model for Remote Sensing Images Semantic Segmentationcited by 33
- 2023AerialFormer: Multi-resolution Transformer for Aerial Image Segmentationcited by 23
- 2024SFFNet: A Wavelet-Based Spatial and Frequency Domain Fusion Network for Remote Sensing Segmentationcited by 17
- 2024A Unified Framework with Multimodal Fine-tuning for Remote Sensing Semantic Segmentationcited by 15
- 2025Adaptive Frequency Enhancement Network for Remote Sensing Image Semantic Segmentationcited by 8
- 2024LOGCAN++: Adaptive Local-global class-aware network for semantic segmentation of remote sensing imagerycited by 7
- 2025Dynamic Dictionary Learning for Remote Sensing Image Segmentationcited by 7
- 2024UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Imagescited by 5
Built on by
Not cited yet.