# Cross-view Geo-localization with Evolving Transformer

arXiv: https://arxiv.org/abs/2107.00842 · HTML: https://mlsanity.com/paper/2107.00842/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- Builds on 18 of its 24 references that are in the map.
- First posted on arXiv 2 Jul 2021.

## Builds on (most cited first, 18 of 18)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Decoupled Weight Decay Regularization](https://mlsanity.com/paper/1711.05101/) (2017)
- [NetVLAD: CNN architecture for weakly supervised place recognition](https://mlsanity.com/paper/1511.07247/) (2015)
- [Dynamic Routing Between Capsules](https://mlsanity.com/paper/1710.09829/) (2017)
- [Multi-scale Interactive Network for Salient Object Detection](https://mlsanity.com/paper/2007.09062/) (2020)
- [Wide-Area Image Geolocalization with Aerial Reference Imagery](https://mlsanity.com/paper/1510.03743/) (2015)
- [Lending Orientation to Neural Networks for Cross-view Geo-localization](https://mlsanity.com/paper/1903.12351/) (2019)
- [University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localization](https://mlsanity.com/paper/2002.12186/) (2020)
- [Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matching](https://mlsanity.com/paper/2005.03860/) (2020)
- [Bridging the Domain Gap for Ground-to-Aerial Image Matching](https://mlsanity.com/paper/1904.11045/) (2019)
- [Localizing and Orienting Street Views Using Overhead Imagery](https://mlsanity.com/paper/1608.00161/) (2016)
- [Optimal Feature Transport for Cross-View Image Geo-Localization](https://mlsanity.com/paper/1907.05021/) (2019)
- [Predicting Ground-Level Scene Layout from Aerial Imagery](https://mlsanity.com/paper/1612.02709/) (2016)
- [3D Visual Perception for Self-Driving Cars using a Multi-Camera System: Calibration, Mapping, Localization, and Obstacle Detection](https://mlsanity.com/paper/1708.09839/) (2017)
- [GeoCapsNet: Aerial to Ground view Image Geo-localization using Capsule Network](https://mlsanity.com/paper/1904.06281/) (2019)
- [Memory-Augmented Relation Network for Few-Shot Learning](https://mlsanity.com/paper/2005.04414/) (2020)

## Built on by (most cited first, 10 of 10)

- [A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localization](https://mlsanity.com/paper/2201.09206/) (2022)
- [CV-Cities: Advancing Cross-View Geo-Localization in Global Cities](https://mlsanity.com/paper/2411.12431/) (2024)
- [Cross-view geo-localization: a survey](https://mlsanity.com/paper/2406.09722/) (2024)
- [Transformer-Guided Convolutional Neural Network for Cross-View Geolocalization](https://mlsanity.com/paper/2204.09967/) (2022)
- [ModaLink: Unifying Modalities for Efficient Image-to-PointCloud Place Recognition](https://mlsanity.com/paper/2403.18762/) (2024)
- [GeoVLM: Improving Automated Vehicle Geolocalisation Using Vision-Language Matching](https://mlsanity.com/paper/2505.13669/) (2025)
- [Enhancing Ground-to-Aerial Image Matching for Visual Misinformation Detection Using Semantic Segmentation](https://mlsanity.com/paper/2502.06288/) (2025)
- [Cross-view Localization and Synthesis -- Datasets, Challenges and Opportunities](https://mlsanity.com/paper/2510.22736/) (2025)
- [Lifting Vision: Ground to Aerial Localization with Reasoning Guided Planning](https://mlsanity.com/paper/2512.24404/) (2025)
- [Road Maps as Free Geometric Priors: Weather-Invariant Drone Geo-Localization with GeoFuse](https://mlsanity.com/paper/2605.14925/) (2026)

## Abstract (arXiv)

In this work, we address the problem of cross-view geo-localization, which estimates the geospatial location of a street view image by matching it with a database of geo-tagged aerial images. The cross-view matching task is extremely challenging due to drastic appearance and geometry differences across views. Unlike existing methods that predominantly fall back on CNN, here we devise a novel evolving geo-localization Transformer (EgoTR) that utilizes the properties of self-attention in Transformer to model global dependencies, thus significantly decreasing visual ambiguities in cross-view geo-localization. We also exploit the positional encoding of Transformer to help the EgoTR understand and correspond geometric configurations between ground and aerial images. Compared to state-of-the-art methods that impose strong assumption on geometry knowledge, the EgoTR flexibly learns the positional embeddings through the training objective and hence becomes more practical in many real-world scenarios. Although Transformer is well suited to our task, its vanilla self-attention mechanism independently interacts within image patches in each layer, which overlooks correlations between layers. Instead, this paper propose a simple yet effective self-cross attention mechanism to improve the quality of learned representations. The self-cross attention models global dependencies between adjacent layers, which relates between image patches while modeling how features evolve in the previous layer. As a result, the proposed self-cross attention leads to more stable training, improves the generalization ability and encourages representations to keep evolving as the network goes deeper. Extensive experiments demonstrate that our EgoTR performs favorably against state-of-the-art methods on standard, fine-grained and cross-dataset cross-view geo-localization tasks.
