mlsanityData to 14 Oct 2026

Focusing on Shadows for Predicting Heightmaps from Single Remotely Sensed RGB Images with Deep Learning

arXiv 2104.10874 ↗First posted 22 Apr 2021cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating the heightmaps of buildings and vegetation in single remotely sensed images is a challenging problem. Effective solutions to this problem can comprise the stepping stone for solving complex and demanding problems that require 3D information of aerial imagery in the remote sensing discipline, which might be expensive or not feasible to require. We propose a task-focused Deep Learning (DL) model that takes advantage of the shadow map of a remotely sensed image to calculate its heightmap. The shadow is computed efficiently and does not add significant computation complexity. The model is trained with aerial images and their Lidar measurements, achieving superior performance on the task. We validate the model with a dataset covering a large area of Manchester, UK, as well as the 2018 IEEE GRSS Data Fusion Contest Lidar dataset. Our work suggests that the proposed DL architecture and the technique of injecting shadows information into the model are valuable for improving the heightmap estimation task for single remotely sensed imagery.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 62 references that are in the map. First posted on arXiv 22 Apr 2021.

Builds on

26 of 62 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2017Mask R-CNNcited by 7,277
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  6. 2016Densely Connected Convolutional Networkscited by 6,720
  7. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  8. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  9. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  10. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  11. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  12. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
14 more
  1. 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
  2. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  3. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  4. 2018A Survey on Deep Transfer Learningcited by 419
  5. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
  6. 2018Markerless tracking of user-defined features with deep learningcited by 206
  7. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  8. 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
  9. 2016The Importance of Skip Connections in Biomedical Image Segmentationcited by 126
  10. 2017A Review on Deep Learning Techniques Applied to Semantic Segmentationcited by 122
  11. 2018Semantic Stereo for Incidental Satellite Imagescited by 53
  12. 2018IM2HEIGHT: Height Estimation from Single Monocular Imagery via Fully Residual Convolutional-Deconvolutional Networkcited by 31
  13. 2020SharinGAN: Combining Synthetic and Real Data for Unsupervised Geometry Estimationcited by 25
  14. 2019Multi-Task Learning of Height and Semantics from Aerial Imagescited by 14

Built on by

Not cited yet.