# Long-Term Invariant Local Features via Implicit Cross-Domain Correspondences

arXiv: https://arxiv.org/abs/2311.03345 · HTML: https://mlsanity.com/paper/2311.03345/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 6 of its 64 references that are in the map.
- First posted on arXiv 6 Nov 2023.

## Builds on (most cited first, 6 of 6)

- [GAIA-1: A Generative World Model for Autonomous Driving](https://mlsanity.com/paper/2309.17080/) (2023)
- [DISK: Learning local features with policy gradient](https://mlsanity.com/paper/2006.13566/) (2020)
- [Universal Correspondence Network](https://mlsanity.com/paper/1606.03558/) (2016)
- [Neural Outlier Rejection for Self-Supervised Keypoint Learning](https://mlsanity.com/paper/1912.10615/) (2019)
- [Self-ensembling for visual domain adaptation](https://mlsanity.com/paper/1706.05208/) (2017)
- [Image Stylization for Robust Features](https://mlsanity.com/paper/2008.06959/) (2020)

## Abstract (arXiv)

Modern learning-based visual feature extraction networks perform well in intra-domain localization, however, their performance significantly declines when image pairs are captured across long-term visual domain variations, such as different seasonal and daytime variations. In this paper, our first contribution is a benchmark to investigate the performance impact of long-term variations on visual localization. We conduct a thorough analysis of the performance of current state-of-the-art feature extraction networks under various domain changes and find a significant performance gap between intra- and cross-domain localization. We investigate different methods to close this gap by improving the supervision of modern feature extractor networks. We propose a novel data-centric method, Implicit Cross-Domain Correspondences (iCDC). iCDC represents the same environment with multiple Neural Radiance Fields, each fitting the scene under individual visual domains. It utilizes the underlying 3D representations to generate accurate correspondences across different long-term visual conditions. Our proposed method enhances cross-domain localization performance, significantly reducing the performance gap. When evaluated on popular long-term localization benchmarks, our trained networks consistently outperform existing methods. This work serves as a substantial stride toward more robust visual localization pipelines for long-term deployments, and opens up research avenues in the development of long-term invariant descriptors.
