Improving Building Segmentation for Off-Nadir Satellite Imagery
Not on the map. Why?
Abstract (arXiv)
Automatic building segmentation is an important task for satellite imagery analysis and scene understanding. Most existing segmentation methods focus on the case where the images are taken from directly overhead (i.e., low off-nadir/viewing angle). These methods often fail to provide accurate results on satellite images with larger off-nadir angles due to the higher noise level and lower spatial resolution. In this paper, we propose a method that is able to provide accurate building segmentation for satellite imagery captured from a large range of off-nadir angles. Based on Bayesian deep learning, we explicitly design our method to learn the data noise via aleatoric and epistemic uncertainty modeling. Satellite image metadata (e.g., off-nadir angle and ground sample distance) is also used in our model to further improve the result. We show that with uncertainty modeling and metadata injection, our method achieves better performance than the baseline method, especially for noisy images taken from large off-nadir angles.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 8 Sep 2021.
Builds on
27 of 42 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
15 more
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
- 2015Holistically-Nested Edge Detectioncited by 592
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
- 2017Functional Map of the Worldcited by 338
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
- 2019ManiGAN: Text-Guided Image Manipulationcited by 156
- 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 139
- 2018TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentationcited by 76
- 2021The Multi-Temporal Urban Development SpaceNet Datasetcited by 62
- 2020Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysiscited by 61
- 2019SpaceNet MVOI: a Multi-View Overhead Imagery Datasetcited by 29
- 2020Satellite Image Classification with Deep Learningcited by 12
Built on by
Not cited yet.