# Deep Homography Estimation for Visual Place Recognition

arXiv: https://arxiv.org/abs/2402.16086 · HTML: https://mlsanity.com/paper/2402.16086/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 31 of its 57 references that are in the map.
- First posted on arXiv 25 Feb 2024.

## Builds on (most cited first, 30 of 31)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [SuperGlue: Learning Feature Matching with Graph Neural Networks](https://mlsanity.com/paper/1911.11763/) (2019)
- [SuperPoint: Self-Supervised Interest Point Detection and Description](https://mlsanity.com/paper/1712.07629/) (2017)
- [NetVLAD: CNN architecture for weakly supervised place recognition](https://mlsanity.com/paper/1511.07247/) (2015)
- [Fine-tuning CNN Image Retrieval with No Human Annotation](https://mlsanity.com/paper/1711.02512/) (2017)
- [DSAC - Differentiable RANSAC for Camera Localization](https://mlsanity.com/paper/1611.05705/) (2016)
- [Escaping the Big Data Paradigm with Compact Transformers](https://mlsanity.com/paper/2104.05704/) (2021)
- [Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition](https://mlsanity.com/paper/2103.01486/) (2021)
- [Visual Camera Re-Localization from RGB and RGB-D Images Using DSAC](https://mlsanity.com/paper/2002.12324/) (2020)
- [Deep Image Homography Estimation](https://mlsanity.com/paper/1606.03798/) (2016)
- [Neural-Guided RANSAC: Learning Where to Sample Model Hypotheses](https://mlsanity.com/paper/1905.04132/) (2019)
- [Self-supervising Fine-grained Region Similarities for Large-scale Image Localization](https://mlsanity.com/paper/2006.03926/) (2020)
- [Deep Learning Features at Scale for Visual Place Recognition](https://mlsanity.com/paper/1701.05105/) (2017)
- [Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model](https://mlsanity.com/paper/1709.03966/) (2017)
- [Content-Aware Unsupervised Deep Homography Estimation](https://mlsanity.com/paper/1909.05983/) (2019)
- [Deep Homography Estimation for Dynamic Scenes](https://mlsanity.com/paper/2004.02132/) (2020)
- [SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognition](https://mlsanity.com/paper/2102.11603/) (2021)
- [A Holistic Visual Place Recognition Approach using Lightweight CNNs for Significant ViewPoint and Appearance Changes](https://mlsanity.com/paper/1811.03032/) (2018)
- [Scalable Place Recognition Under Appearance Change for Autonomous Driving](https://mlsanity.com/paper/1908.00178/) (2019)
- [Viewpoint Invariant Dense Matching for Visual Geolocalization](https://mlsanity.com/paper/2109.09827/) (2021)
- [Single-View Place Recognition under Seasonal Changes](https://mlsanity.com/paper/1808.06516/) (2018)
- [DenserNet: Weakly Supervised Visual Localization Using Multi-scale Feature Aggregation](https://mlsanity.com/paper/2012.02366/) (2020)
- [Hierarchical Multi-Process Fusion for Visual Place Recognition](https://mlsanity.com/paper/2002.03895/) (2020)
- [Don't Look Back: Robustifying Place Categorization for Viewpoint- and Condition-Invariant Place Recognition](https://mlsanity.com/paper/1801.05078/) (2018)
- [Localizing Discriminative Visual Landmarks for Place Recognition](https://mlsanity.com/paper/1904.06635/) (2019)
- [STA-VPR: Spatio-temporal Alignment for Visual Place Recognition](https://mlsanity.com/paper/2103.13580/) (2021)
- [Perceptual Loss for Robust Unsupervised Homography Estimation](https://mlsanity.com/paper/2104.10011/) (2021)
- [A Multi-Domain Feature Learning Method for Visual Place Recognition](https://mlsanity.com/paper/1902.10058/) (2019)
- [Improving Condition- and Environment-Invariant Place Recognition with Semantic Place Categorization](https://mlsanity.com/paper/1706.07144/) (2017)

## Built on by (most cited first, 5 of 5)

- [CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition](https://mlsanity.com/paper/2402.19231/) (2024)
- [SelaVPR++: Towards Seamless Adaptation of Foundation Models for Efficient Place Recognition](https://mlsanity.com/paper/2502.16601/) (2025)
- [EDTformer: An Efficient Decoder Transformer for Visual Place Recognition](https://mlsanity.com/paper/2412.00784/) (2024)
- [Towards Implicit Aggregation: Robust Image Representation for Place Recognition in the Transformer Era](https://mlsanity.com/paper/2511.06024/) (2025)
- [SAGE: Spatial-visual Adaptive Graph Exploration for Efficient Visual Place Recognition](https://mlsanity.com/paper/2509.25723/) (2025)

## Abstract (arXiv)

Visual place recognition (VPR) is a fundamental task for many applications such as robot localization and augmented reality. Recently, the hierarchical VPR methods have received considerable attention due to the trade-off between accuracy and efficiency. They usually first use global features to retrieve the candidate images, then verify the spatial consistency of matched local features for re-ranking. However, the latter typically relies on the RANSAC algorithm for fitting homography, which is time-consuming and non-differentiable. This makes existing methods compromise to train the network only in global feature extraction. Here, we propose a transformer-based deep homography estimation (DHE) network that takes the dense feature map extracted by a backbone network as input and fits homography for fast and learnable geometric verification. Moreover, we design a re-projection error of inliers loss to train the DHE network without additional homography labels, which can also be jointly trained with the backbone network to help it extract the features that are more suitable for local matching. Extensive experiments on benchmark datasets show that our method can outperform several state-of-the-art methods. And it is more than one order of magnitude faster than the mainstream hierarchical VPR methods using RANSAC. The code is released at https://github.com/Lu-Feng/DHE-VPR.
