mlsanityData to 14 Oct 2026

Revisiting Near/Remote Sensing with Geospatial Attention

arXiv 2204.01807 ↗First posted 4 Apr 2022cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

This work addresses the task of overhead image segmentation when auxiliary ground-level images are available. Recent work has shown that performing joint inference over these two modalities, often called near/remote sensing, can yield significant accuracy improvements. Extending this line of work, we introduce the concept of geospatial attention, a geometry-aware attention mechanism that explicitly considers the geospatial relationship between the pixels in a ground-level image and a geographic location. We propose an approach for computing geospatial attention that incorporates geometric features and the appearance of the overhead and ground-level imagery. We introduce a novel architecture for near/remote sensing that is based on geospatial attention and demonstrate its use for five segmentation tasks. The results demonstrate that our method significantly outperforms the previous state-of-the-art methods.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 30 of its 64 references that are in the map. First posted on arXiv 4 Apr 2022.

Builds on

30 of 64 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  7. 2016Layer Normalizationcited by 5,669
  8. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  9. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  10. 2015Spatial Transformer Networkscited by 1,429
  11. 2018Image Transformercited by 772
  12. 2016SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioningcited by 219
18 more
  1. 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 186
  2. 2019Lending Orientation to Neural Networks for Cross-view Geo-localizationcited by 180
  3. 2020Epipolar Transformerscited by 117
  4. 2021Coming Down to Earth: Satellite-to-Street View Synthesis for Geo-Localizationcited by 113
  5. 2016Localizing and Orienting Street Views Using Overhead Imagerycited by 94
  6. 2016Predicting Ground-Level Scene Layout from Aerial Imagerycited by 90
  7. 2018Learn To Pay Attentioncited by 83
  8. 2021Geometry-Guided Street-View Panorama Synthesis from Satellite Imagerycited by 41
  9. 2019Understanding urban landuse from the above and ground perspectives: a deep learning, multimodal solutioncited by 26
  10. 2020SkyScapes -- Fine-Grained Semantic Understanding of Aerial Scenescited by 22
  11. 2020Learning a Dynamic Map of Visual Appearancecited by 18
  12. 2017A Unified Model for Near and Remote Sensingcited by 14
  13. 2016Understanding and Mapping Natural Beautycited by 10
  14. 2017Towards seamless multi-view scene analysis from satellite to street-levelcited by 10
  15. 2018Fine-Grained Land Use Classification at the City Scale Using Ground-Level Imagescited by 8
  16. 2020Dynamic Traffic Modeling From Overhead Imagerycited by 8
  17. 2021Augmenting Depth Estimation with Geospatial Contextcited by 7
  18. 2016Land Use Classification using Convolutional Neural Networks Applied to Ground-Level Imagescited by 5

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 3; 2024: 5; 2025: 1.

12 papers.

  1. 2023Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairscited by 29
  2. 2022OmniCity: Omnipotent City Understanding with Multi-level and Multi-view Imagescited by 21
  3. 2024SG-BEV: Satellite-Guided BEV Fusion for Cross-View Semantic Segmentationcited by 18
  4. 2023Mutation-Based Adversarial Attacks on Neural Text Detectorscited by 9
  5. 2025Seeing through Satellite Images at Street Viewscited by 9
  6. 2022Geo-Information Harvesting from Social Media Datacited by 5
  7. 2024Mixed-View Panorama Synthesis using Geospatially Guided Diffusioncited by 4
  8. 2022Handling Image and Label Resolution Mismatch in Remote Sensingcited by 3
  9. 2024Computer Vision for Multimedia Geolocation in Human Trafficking Investigation: A Systematic Literature Reviewcited by 3
  10. 2023Fast Dust Sand Image Enhancement Based on Color Correction and New Membership Functioncited by 0
  11. 2024Probabilistic Image-Driven Traffic Modeling via Remote Sensingcited by 0
  12. 2024Fine-Grained Building Function Recognition from Street-View Images via Geometry-Aware Semi-Supervised Learningcited by 0