AerialFormer: Multi-resolution Transformer for Aerial Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Aerial Image Segmentation is a top-down perspective semantic segmentation and has several challenging characteristics such as strong imbalance in the foreground-background distribution, complex background, intra-class heterogeneity, inter-class homogeneity, and tiny objects. To handle these problems, we inherit the advantages of Transformers and propose AerialFormer, which unifies Transformers at the contracting path with lightweight Multi-Dilated Convolutional Neural Networks (MD-CNNs) at the expanding path. Our AerialFormer is designed as a hierarchical structure, in which Transformer encoder outputs multi-scale features and MD-CNNs decoder aggregates information from the multi-scales. Thus, it takes both local and global contexts into consideration to render powerful representations and high-resolution segmentation. We have benchmarked AerialFormer on three common datasets including iSAID, LoveDA, and Potsdam. Comprehensive experiments and extensive ablation studies show that our proposed AerialFormer outperforms previous state-of-the-art methods with remarkable performance. Our source code will be publicly available upon acceptance.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 82 of its 121 references that are in the map. First posted on arXiv 12 Jun 2023.
Builds on
82 of 121 references.
References · 82
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Layer Normalizationcited by 5,669
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
38 more
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2017Non-local Neural Networkscited by 2,293
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2017Deformable Convolutional Networkscited by 1,488
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2018Dual Attention Network for Scene Segmentationcited by 1,003
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
- 2020Image Segmentation Using Deep Learning: A Surveycited by 660
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 576
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 573
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 495
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 488
- 2018Context Encoding for Semantic Segmentationcited by 290
- 2019Cross-Modal Self-Attention Network for Referring Image Segmentationcited by 263
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2017LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentationcited by 214
- 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 167
- 2018Pyramid Attention Network for Semantic Segmentationcited by 149
- 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
- 2019Expectation-Maximization Attention Networks for Semantic Segmentationcited by 147
50 most cited of 82 All 82 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 7; 2025: 11; 2026: 3.
23 papers.
Sort:
By area:
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2024GiT: Towards Generalist Vision Transformer through Universal Language Interfacecited by 24
- 2024Towards Open-Vocabulary Remote Sensing Image Semantic Segmentationcited by 19
- 2023OpenForest: A data catalogue for machine learning in forest monitoringcited by 15
- 2025SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentationcited by 8
- 2025Dynamic Dictionary Learning for Remote Sensing Image Segmentationcited by 7
- 2024Learning from Unlabelled Data with Transformers: Domain Adaptation for Semantic Segmentation of High Resolution Aerial Imagescited by 4
- 2025CP2M: Clustered-Patch-Mixed Mosaic Augmentation for Aerial Image Segmentationcited by 3
- 2025Remote Sensing Semantic Segmentation Quality Assessment based on Vision Language Modelcited by 3
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormercited by 2
- 2023SolarFormer: Multi-scale Transformer for Solar PV Profilingcited by 1
- 2024Neural Embedding Compression For Efficient Multi-Task Earth Observation Modellingcited by 1
11 more
- 2024Heuristical Comparison of Vision Transformers Against Convolutional Neural Networks for Semantic Segmentation on Remote Sensing Imagerycited by 1
- 2025LightFormer: A lightweight and efficient decoder for remote sensing image segmentationcited by 1
- 2025ECMNet:Lightweight Semantic Segmentation with Efficient CNN-Mamba Networkcited by 1
- 2025WakeupUrban: Unsupervised Semantic Segmentation of Mid-20th century Urban Landscapes with Satellite Imagerycited by 1
- 2025Stratify or Die: Rethinking Data Splits in Image Segmentationcited by 1
- 2025ChromaFormer: A Scalable and Accurate Transformer Architecture for Land Cover Classificationcited by 0
- 2025Differential Morphological Profile Neural Networks for Semantic Segmentationcited by 0
- 2025BiCoR-Seg: Bidirectional Co-Refinement Framework for High-Resolution Remote Sensing Image Segmentationcited by 0
- 2026Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentationcited by 0
- 2026Hierarchical Adaptive Feature Refinement Network for VHR Remote Sensing Image Segmentationcited by 0
- 2026CRISP: Calibration-Aware Visual State Space Duality for Remote Sensing Semantic Segmentationcited by 0
- 2026CRISP: Calibration-Aware Visual State Space Duality for Remote Sensing Semantic Segmentation24 Aug 2026
- 2026Hierarchical Adaptive Feature Refinement Network for VHR Remote Sensing Image Segmentation16 Aug 2026
- 2026Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentation4 Feb 2026
- 2025BiCoR-Seg: Bidirectional Co-Refinement Framework for High-Resolution Remote Sensing Image Segmentation23 Dec 2025
- 2025Stratify or Die: Rethinking Data Splits in Image Segmentation25 Sep 2025
- 2025Differential Morphological Profile Neural Networks for Semantic Segmentation4 Sep 2025
- 2025SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation17 Jul 2025
- 2025WakeupUrban: Unsupervised Semantic Segmentation of Mid-20th century Urban Landscapes with Satellite Imagery11 Jun 2025
- 2025ECMNet:Lightweight Semantic Segmentation with Efficient CNN-Mamba Network10 Jun 2025
- 2025LightFormer: A lightweight and efficient decoder for remote sensing image segmentation15 Apr 2025
- 2025ChromaFormer: A Scalable and Accurate Transformer Architecture for Land Cover Classification11 Mar 2025
- 2025Dynamic Dictionary Learning for Remote Sensing Image Segmentation9 Mar 2025
11 more
- 2025Remote Sensing Semantic Segmentation Quality Assessment based on Vision Language Model19 Feb 2025
- 2025CP2M: Clustered-Patch-Mixed Mosaic Augmentation for Aerial Image Segmentation26 Jan 2025
- 2024Towards Open-Vocabulary Remote Sensing Image Semantic Segmentation27 Dec 2024
- 2024Heuristical Comparison of Vision Transformers Against Convolutional Neural Networks for Semantic Segmentation on Remote Sensing Imagery14 Nov 2024
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormer1 Oct 2024
- 2024Learning from Unlabelled Data with Transformers: Domain Adaptation for Semantic Segmentation of High Resolution Aerial Images17 Apr 2024
- 2024Neural Embedding Compression For Efficient Multi-Task Earth Observation Modelling26 Mar 2024
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining20 Mar 2024
- 2024GiT: Towards Generalist Vision Transformer through Universal Language Interface14 Mar 2024
- 2023OpenForest: A data catalogue for machine learning in forest monitoring1 Nov 2023
- 2023SolarFormer: Multi-scale Transformer for Solar PV Profiling30 Oct 2023
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2024GiT: Towards Generalist Vision Transformer through Universal Language Interfacecited by 24
- 2024Towards Open-Vocabulary Remote Sensing Image Semantic Segmentationcited by 19
- 2023OpenForest: A data catalogue for machine learning in forest monitoringcited by 15
- 2025SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentationcited by 8
- 2025Dynamic Dictionary Learning for Remote Sensing Image Segmentationcited by 7
- 2024Learning from Unlabelled Data with Transformers: Domain Adaptation for Semantic Segmentation of High Resolution Aerial Imagescited by 4
- 2025CP2M: Clustered-Patch-Mixed Mosaic Augmentation for Aerial Image Segmentationcited by 3
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormercited by 2
- 2023SolarFormer: Multi-scale Transformer for Solar PV Profilingcited by 1
- 2024Neural Embedding Compression For Efficient Multi-Task Earth Observation Modellingcited by 1
- 2024Heuristical Comparison of Vision Transformers Against Convolutional Neural Networks for Semantic Segmentation on Remote Sensing Imagerycited by 1
12 most cited of 20 All 20 (JSON)
- 2026CRISP: Calibration-Aware Visual State Space Duality for Remote Sensing Semantic Segmentation24 Aug 2026
- 2026Hierarchical Adaptive Feature Refinement Network for VHR Remote Sensing Image Segmentation16 Aug 2026
- 2025BiCoR-Seg: Bidirectional Co-Refinement Framework for High-Resolution Remote Sensing Image Segmentation23 Dec 2025
- 2025Stratify or Die: Rethinking Data Splits in Image Segmentation25 Sep 2025
- 2025Differential Morphological Profile Neural Networks for Semantic Segmentation4 Sep 2025
- 2025SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation17 Jul 2025
- 2025WakeupUrban: Unsupervised Semantic Segmentation of Mid-20th century Urban Landscapes with Satellite Imagery11 Jun 2025
- 2025LightFormer: A lightweight and efficient decoder for remote sensing image segmentation15 Apr 2025
- 2025ChromaFormer: A Scalable and Accurate Transformer Architecture for Land Cover Classification11 Mar 2025
- 2025Dynamic Dictionary Learning for Remote Sensing Image Segmentation9 Mar 2025
- 2025CP2M: Clustered-Patch-Mixed Mosaic Augmentation for Aerial Image Segmentation26 Jan 2025
- 2024Towards Open-Vocabulary Remote Sensing Image Semantic Segmentation27 Dec 2024
12 newest of 20 All 20 (JSON)