Weather-Robust Cross-View Geo-Localization via Prototype-Based Semantic Part Discovery
Not on the map. Why?
Abstract (arXiv)
Cross-view geo-localization (CVGL), which matches an oblique drone view to a geo-referenced satellite tile, has emerged as a key alternative for autonomous drone navigation when GNSS signals are jammed, spoofed, or unavailable. Despite strong recent progress, three limitations persist: (1) global-descriptor designs compress the patch grid into a single vector without separating layout from texture across the view gap; (2) altitude-related scale variation is retained in the learned embedding rather than marginalized; and (3) multi-objective training relies on hand-tuned scalars over losses on incompatible gradient scales. We propose SkyPart, a lightweight swappable head for patch-based vision transformers (ViTs) that institutes explicit part grouping over the patch grid. SkyPart has four theory-grounded components: (i) learnable prototypes competing for patch tokens via single-pass cosine assignment; (ii) altitude-conditioned linear modulation applied only during training, making the retrieval embedding altitude-free at inference; (iii) a graph-attention readout over active prototypes; and (iv) a Kendall uncertainty-weighted multi-objective loss whose stationary points are Pareto-stationary. At 26.95M parameters and 22.14 GFLOPs, SkyPart is the smallest among top-performing methods and sets a new state of the art on SUES-200, University-1652, and DenseUAV under a single-pass, no-re-ranking, no-TTA protocol. Its advantage over the strongest baseline widens under the ten-condition WeatherPrompt corruption benchmark.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 73 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
46 of 73 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Graph Attention Networkscited by 8,923
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
34 more
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2019Relational Knowledge Distillationcited by 889
- 2020Object-Centric Learning with Slot Attentioncited by 876
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
- 2019Contrastive Representation Distillationcited by 748
- 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 727
- 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 473
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 403
- 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 215
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 186
- 2022SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentationcited by 164
- 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 157
- 2020Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matchingcited by 126
- 2023Sample4Geo: Hard Negative Sampling For Cross-View Geo-Localisationcited by 110
- 2020Each Part Matters: Local Patterns Facilitate Cross-view Geo-localizationcited by 97
- 2022SUES-200: A Multi-height Multi-scene Cross-view Image Benchmark Across Drone and Satellitecited by 64
- 2022A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localizationcited by 57
- 2022Vision-Based UAV Self-Positioning in Low-Altitude Urban Environmentscited by 46
- 2022Multiple-environment Self-adaptive Network for Aerial-view Geo-localizationcited by 37
- 2024SDPL: Shifting-Dense Partition Learning for UAV-View Geo-Localizationcited by 25
- 2024Multi-Level Embedding and Alignment Network with Consistency and Invariance Learning for Cross-View Geo-Localizationcited by 16
- 2024Multi-weather Cross-view Geo-localization Using Denoising Diffusion Modelscited by 11
- 2025Exploring the best way for UAV visual localization under Low-altitude Multi-view Observation Condition: a Benchmarkcited by 11
- 2023Let All be Whitened: Multi-teacher Distillation for Efficient Visual Retrievalcited by 7
- 2025WeatherPrompt: Multi-modality Representation Learning for All-Weather Drone Visual Geo-Localizationcited by 7
- 2025Precise GPS-Denied UAV Self-Positioning via Context-Enhanced Cross-View Geo-Localizationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.