NetVLAD: CNN architecture for weakly supervised place recognition
Not on the map. Why?
Abstract (arXiv)
We tackle the problem of large scale visual place recognition, where the task is to quickly and accurately recognize the location of a given query photograph. We present the following three principal contributions. First, we develop a convolutional neural network (CNN) architecture that is trainable in an end-to-end manner directly for the place recognition task. The main component of this architecture, NetVLAD, is a new generalized VLAD layer, inspired by the "Vector of Locally Aggregated Descriptors" image representation commonly used in image retrieval. The layer is readily pluggable into any CNN architecture and amenable to training via backpropagation. Second, we develop a training procedure, based on a new weakly supervised ranking loss, to learn parameters of the architecture in an end-to-end manner from images depicting the same places over time downloaded from Google Street View Time Machine. Finally, we show that the proposed architecture significantly outperforms non-learnt image representations and off-the-shelf CNN descriptors on two challenging place recognition benchmarks, and improves over current state-of-the-art compact image representations on standard image retrieval benchmarks.
Key facts. Cited by 935 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 141; 2022: 161; 2023: 163; 2024: 167; 2025: 164; 2026: 139.
935 papers.
Sort:
By area:
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 223
- 2024Global Structure-from-Motion Revisitedcited by 215
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 160
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 159
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
38 more
- 2021Coming Down to Earth: Satellite-to-Street View Synthesis for Geo-Localizationcited by 112
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2023EigenPlaces: Training Viewpoint Robust Models for Visual Place Recognitioncited by 109
- 2023Sample4Geo: Hard Negative Sampling For Cross-View Geo-Localisationcited by 107
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2021Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillationcited by 104
- 2021T2VLAD: Global-Local Sequence Alignment for Text-Video Retrievalcited by 103
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2022GSV-Cities: Toward Appropriate Supervised Visual Place Recognitioncited by 92
- 2022Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Imagecited by 88
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2023An Outlook into the Future of Egocentric Visioncited by 84
- 2022Deep Visual Geo-localization Benchmarkcited by 83
- 2021Where is your place, Visual Place Recognition?cited by 82
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2023Detector-Free Structure from Motioncited by 71
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2021LCDNet: Deep Loop Closure Detection and Point Cloud Registration for LiDAR SLAMcited by 67
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 65
- 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisationcited by 63
- 2024BoQ: A Place is Worth a Bag of Learnable Queriescited by 63
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2024CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognitioncited by 61
- 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 59
- 2025MegaLoc: One Retrieval to Place Them Allcited by 58
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognitioncited by 56
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2022A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localizationcited by 55
- 2021DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Featurescited by 54
50 most cited of 935 All 935 (JSON)
- 2026Less Context, Better Geometry: Masked Geometric Encoder for Robust 3D Foundation Models5 Oct 2026
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection26 Sep 2026
- 2026Automotive mmWave Spinning Radar Place Recognition with Spatially Gated Feature-Correlation Representation23 Sep 2026
- 2026Geometry-Conditioned Visual Place Recognition in Natural Environments23 Sep 2026
- 2026Calibrating Retrieval Geometry: Reliability-Guided Training-Free Aggregation for Visual Place Recognition22 Sep 2026
- 2026M3GA-Wild: A Large-Scale Dataset and Benchmark for Multi-Modal Multi-session Ground-to-Aerial Place Recognition in Forests19 Sep 2026
- 2026CoRef-GS: Cooperative Referring Gaussian Splatting for Multi-Agent Scene Understanding17 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026HuMemSLAM: Efficient Human-Inspired Semantic Place Recognition for Robust Visual SLAM15 Sep 2026
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations11 Sep 2026
- 2026TRAIL: Trajectory-Aware Visual Place Recognition against Unordered Databases7 Sep 2026
38 more
- 2026LightSplat: Real-Time High-Fidelity 3D Gaussian SLAM with Loop Closure7 Sep 2026
- 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition3 Sep 2026
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026POI-Loc: A Fine-Grained POI Localization Benchmark and an Asymmetric Global-to-Local Matching Method2 Sep 2026
- 2026HorizonNet for visual terrain navigation31 Aug 2026
- 2026FoundYou: A Unified Model for Personalized Segmentation and Retrieval30 Aug 2026
- 2026Ground-to-Satellite Localization in Unconstrained Image Collections for 3D Scene Reconstruction29 Aug 2026
- 2026Pixel-wise Geo-registration of Drone and Satellite Images28 Aug 2026
- 2026SSMB: Self-Supervised Local Feature Detection under Motion Blur27 Aug 2026
- 2026CGS-SLAM: Collaborative Gaussian Splatting based SLAM for Multi-Agent Reconstruction27 Aug 2026
- 2026Spotter: Efficient Urban Visual Localization via Geo-Referenced Facade Landmarks in GPS-Degraded Environments24 Aug 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026DynCur-Geo: Dynamic Curiosity Reward Shaping for Multimodal Active Geo-Localization19 Aug 2026
- 2026UniDot: A Unified Network for Sequence Modeling and Feature Interaction in Large-scale Recommendation17 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026Semi-Dense Matching Uncertainty Is Not Just Local Confidence9 Aug 2026
- 2026Are Visual Place Recognition Models Recognizing Places or Conditions? Distractor-Augmented Evaluation and Condition Suppression7 Aug 2026
- 2026Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting3 Aug 2026
- 2026FeDepth: Federated Learning for Depth Estimation under Robot Heterogeneity2 Aug 2026
- 2026Accuracy potential of visual localization exploiting high-end street-level imagery27 Jul 2026
- 2026DTIF: Robust Loop Closure Detection via Delaunay Triangle Topology in Complex Forests23 Jul 2026
- 2026HETA++: Global Structure-from-Motion with Hybrid Explicit Translation Averaging17 Jul 2026
- 2026Are All Tokens Necessary for Visual Place Recognition? An Empirical Study of Token Reduction for Efficient Inference17 Jul 2026
- 2026Selectivity Drives Efficiency: Dataset Pruning for Visual Place Recognition16 Jul 2026
- 2026Visual Place Recognition Using Rate-Encoded Spiking Neural Networks with Discrete STDP Learning15 Jul 2026
- 2026Breaking D'ej`a Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning14 Jul 2026
- 2026Self-Healing Visual Recovery for Autonomous Ground Vehicles Using Camera-Only Visual Odometry13 Jul 2026
- 2026SalientGS: Unified SfM-to-3DGS with Importance-Guided MCMC Gaussian Allocation13 Jul 2026
- 2026What VGGT Knows About Overlap: Probing Geometric Foundation Models for Co-Visibility10 Jul 2026
- 2026Causal-RetiGraph: Cross-Cohort Retinal Support and Same-Subject Pathway Analysis for Diabetic Retinopathy6 Jul 2026
- 2026Computing Monetary Risk Measures in Linear Time6 Jul 2026
- 2026Route-MHT: Multimodal Transformer Guardrails for Thermal Visual Place Recognition6 Jul 2026
- 2026Reference-Induced Consensus for Selective Posed-Reference Visual Localization6 Jul 2026
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training2 Jul 2026
- 2026DL-VINS-Factory: A Modular Framework for Learned Visual Front-Ends in Visual-Inertial SLAM2 Jul 2026
- 2026Where Am I? Semantic Map Grounding via Vision-Language Models for Multi-Modal Localization1 Jul 2026
- 2026Seeing Through the Weights: Privacy Leakage in Scene Coordinate Regression30 Jun 2026
50 newest of 935 All 935 (JSON)
- 2024Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Frameworkcited by 11
- 2024Tell Me Where You Are: Multimodal LLMs Meet Place Recognitioncited by 7
- 2025Co-VisiON: Co-Visibility ReasONing on Sparse Image Sets of Indoor Scenescited by 2
- 2026Indexing Multimodal Language Models for Large-scale Image Retrievalcited by 1
- 2025Lifting Vision: Ground to Aerial Localization with Reasoning Guided Planningcited by 0
- 2026Breaking D'ej`a Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoningcited by 0
- 2026Breaking D'ej`a Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning14 Jul 2026
- 2026Indexing Multimodal Language Models for Large-scale Image Retrieval14 Apr 2026
- 2025Lifting Vision: Ground to Aerial Localization with Reasoning Guided Planning30 Dec 2025
- 2025Co-VisiON: Co-Visibility ReasONing on Sparse Image Sets of Indoor Scenes20 Jun 2025
- 2024Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework21 Aug 2024
- 2024Tell Me Where You Are: Multimodal LLMs Meet Place Recognition25 Jun 2024
- 2024INQUIRE: A Natural World Text-to-Image Retrieval Benchmarkcited by 33
- 2026VLM-Loc: Localization in Point Cloud Maps via Vision-Language Modelscited by 4
- 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Modelscited by 2
- 2026Memory Over Maps: 3D Object Localization Without Reconstructioncited by 1
- 2026Where Do Vision-Language Models Fail? World Scale Analysis for Image Geolocalizationcited by 0
- 2026Where Am I? Semantic Map Grounding via Vision-Language Models for Multi-Modal Localizationcited by 0
- 2026Where Am I? Semantic Map Grounding via Vision-Language Models for Multi-Modal Localization1 Jul 2026
- 2026Where Do Vision-Language Models Fail? World Scale Analysis for Image Geolocalization17 Apr 2026
- 2026Memory Over Maps: 3D Object Localization Without Reconstruction20 Mar 2026
- 2026VLM-Loc: Localization in Point Cloud Maps via Vision-Language Models10 Mar 2026
- 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models27 Aug 2025
- 2024INQUIRE: A Natural World Text-to-Image Retrieval Benchmark4 Nov 2024
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2025Perspective-aware 3D Gaussian Inpainting with Multi-view Consistencycited by 3
- 2023CaLDiff: Camera Localization in NeRF via Pose Diffusioncited by 2
- 2026DiffPlace: Street View Generation via Place-Controllable Diffusion Model Enhancing Place Recognitioncited by 1
- 2026DiffPlace: Street View Generation via Place-Controllable Diffusion Model Enhancing Place Recognition12 Feb 2026
- 2025Perspective-aware 3D Gaussian Inpainting with Multi-view Consistency13 Oct 2025
- 2024Measuring Style Similarity in Diffusion Models1 Apr 2024
- 2023CaLDiff: Camera Localization in NeRF via Pose Diffusion23 Dec 2023
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 223
- 2024Global Structure-from-Motion Revisitedcited by 215
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 160
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 159
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
12 most cited of 911 All 911 (JSON)
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection26 Sep 2026
- 2026Automotive mmWave Spinning Radar Place Recognition with Spatially Gated Feature-Correlation Representation23 Sep 2026
- 2026Geometry-Conditioned Visual Place Recognition in Natural Environments23 Sep 2026
- 2026Calibrating Retrieval Geometry: Reliability-Guided Training-Free Aggregation for Visual Place Recognition22 Sep 2026
- 2026M3GA-Wild: A Large-Scale Dataset and Benchmark for Multi-Modal Multi-session Ground-to-Aerial Place Recognition in Forests19 Sep 2026
- 2026CoRef-GS: Cooperative Referring Gaussian Splatting for Multi-Agent Scene Understanding17 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026HuMemSLAM: Efficient Human-Inspired Semantic Place Recognition for Robust Visual SLAM15 Sep 2026
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations11 Sep 2026
- 2026TRAIL: Trajectory-Aware Visual Place Recognition against Unordered Databases7 Sep 2026
- 2026LightSplat: Real-Time High-Fidelity 3D Gaussian SLAM with Loop Closure7 Sep 2026
12 newest of 911 All 911 (JSON)