Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking
Not on the map. Why?
Abstract (arXiv)
In this paper we address issues with image retrieval benchmarking on standard and popular Oxford 5k and Paris 6k datasets. In particular, annotation errors, the size of the dataset, and the level of challenge are addressed: new annotation for both datasets is created with an extra attention to the reliability of the ground truth. Three new protocols of varying difficulty are introduced. The protocols allow fair comparison between different methods, including those using a dataset pre-processing stage. For each dataset, 15 new challenging queries are introduced. Finally, a new set of 1M hard, semi-automatically cleaned distractors is selected. An extensive comparison of the state-of-the-art methods is performed on the new benchmark. Different types of methods are evaluated, ranging from local-feature-based to modern CNN based methods. The best results are achieved by taking the best of the two worlds. Most importantly, image retrieval appears far from being solved.
Key facts. Cited by 189 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 25; 2023: 39; 2024: 25; 2025: 29; 2026: 33.
189 papers.
Sort:
By area:
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2021XCiT: Cross-Covariance Image Transformerscited by 335
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2022What to Hide from Your Students: Attention-Guided Masked Image Modelingcited by 117
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2021Training Vision Transformers for Image Retrievalcited by 90
- 2023Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Taskscited by 72
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
38 more
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 65
- 2021Instance-level Image Retrieval using Reranking Transformerscited by 63
- 2022ClusterGNN: Cluster-based Coarse-to-Fine Graph Neural Network for Efficient Feature Matchingcited by 62
- 2025MegaLoc: One Retrieval to Place Them Allcited by 58
- 2023SoftCLIP: Softer Cross-modal Alignment Makes CLIP Strongercited by 56
- 2024OmniGlue: Generalizable Feature Matching with Foundation Model Guidancecited by 55
- 2021DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Featurescited by 54
- 2021Recall@k Surrogate Loss with Large Batches and Similarity Mixupcited by 49
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 48
- 2022Correlation Verification for Image Retrievalcited by 47
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 46
- 2022Teaching Matters: Investigating the Role of Supervision in Vision Transformerscited by 45
- 2021The 2021 Image Similarity Dataset and Challengecited by 44
- 2021One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objectivecited by 43
- 2023Data-efficient Large Scale Place Recognition with Graded Similarity Supervisioncited by 43
- 2025Cross the Gap: Exposing the Intra-modal Misalignment in CLIP via Modality Inversioncited by 42
- 2023Global Features are All You Need for Image Retrieval and Rerankingcited by 41
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
- 2023Simple, Effective and General: A New Backbone for Cross-view Image Geo-localizationcited by 36
- 2022Learning Super-Features for Image Retrievalcited by 35
- 2025ILIAS: Instance-Level Image retrieval At Scalecited by 29
- 2023Towards Universal Image Embeddings: A Large-Scale Dataset and Challenge for Generic Image Representationscited by 28
- 2021Class-Balanced Distillation for Long-Tailed Visual Recognitioncited by 27
- 2022Investigating the Role of Image Retrieval for Visual Localization -- An exhaustive benchmarkcited by 27
- 2021Noise-resistant Deep Metric Learning with Ranking-based Instance Selectioncited by 23
- 2022Towards Universal Backward-Compatible Representation Learningcited by 20
- 2021Robust and Decomposable Average Precision for Image Retrievalcited by 19
- 2022Boosting vision transformers for image retrievalcited by 19
- 2024Revisit Anything: Visual Place Recognition via Image Segment Retrievalcited by 19
- 2024Where's Waldo: Diffusion Features for Personalized Segmentation and Retrievalcited by 18
- 2022MimCo: Masked Image Modeling Pre-training with Contrastive Teachercited by 16
- 2023Keep It SimPool: Who Said Supervised Transformers Suffer from Attention Deficit?cited by 16
- 2024AMES: Asymmetric and Memory-Efficient Similarity Estimation for Instance-level Retrievalcited by 16
- 2025Hypergraph Vision Transformers: Images are More than Nodes, More than Edgescited by 16
- 2024On the Estimation of Image-matching Uncertainty in Visual Place Recognitioncited by 15
- 2021Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localizationcited by 14
- 2021Contextual Similarity Aggregation with Self-attention for Visual Re-rankingcited by 14
- 2021Self-Distilled Self-Supervised Representation Learningcited by 14
50 most cited of 189 All 189 (JSON)
- 2026Masked Swingers: Harnessing Data Augmentation to Advance Autoencoders for Self-Supervised Learning29 Sep 2026
- 2026RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models15 Sep 2026
- 2026Compensating for Scarce Historical Images in Cross-Domain Cultural Heritage Retrieval Using Synthetic Aging8 Sep 2026
- 2026ViTAMINS: An Empirical Study of Training Self-Supervised Vision Transformers with Synthetic Hard Negatives1 Sep 2026
- 2026FoundYou: A Unified Model for Personalized Segmentation and Retrieval30 Aug 2026
- 2026Unified and Efficient Point-Line Local Features20 Aug 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026KnifeHunter: Structured Local Representation Learning for Fine-Grained Knife Image Retrieval in Law Enforcement7 Aug 2026
- 2026Illuminating Visual Identity in Universal Multimodal Embeddings3 Aug 2026
- 2026Explaining Image Similarity with Automatically Extracted Concept Activation Vectors30 Jul 2026
- 2026Why Domain Matters: Domain-Aware Benchmarking of Underwater Object Detection and Annotation Quality12 Jul 2026
- 2026Beyond Post-Quantization: Native Hash Learning with a Dedicated HASH Token3 Jul 2026
38 more
- 2026Revising RVL-CDIP: Quantifying Errors and Test-Train Overlap30 Jun 2026
- 2026Dyna-DINO: Efficient ViT Distillation Via Adaptive Representation Anchoring17 Jun 2026
- 2026Dithering Defense: Adversarial Robustness of Vision Foundation Models via Multi-Level Floyd-Steinberg Dithering21 May 2026
- 2026PySIFT: GPU-Resident Deterministic SIFT for Deep Learning Vision Pipelines18 May 2026
- 2026SceneGlue: Scene-Aware Transformer for Feature Matching without Scene-Level Annotation15 Apr 2026
- 2026Indexing Multimodal Language Models for Large-scale Image Retrieval14 Apr 2026
- 2026CLAY: Conditional Visual Similarity Modulation in Vision-Language Embedding Space13 Apr 2026
- 2026SearchAD: Large-Scale Rare Image Retrieval Dataset for Autonomous Driving9 Apr 2026
- 2026ELViS: Efficient Visual Similarity from Local Descriptors that Generalizes Across Domains30 Mar 2026
- 2026TerraSky3D: Multi-View Reconstructions of European Landmarks in 4K30 Mar 2026
- 2026SpatialBoost: Enhancing Visual Representation through Language-Guided Reasoning23 Mar 2026
- 2026IsoCLIP: Decomposing CLIP Projectors for Efficient Intra-modal Alignment20 Mar 2026
- 2026Visual Product Search Benchmark17 Mar 2026
- 2026Reevaluating the Intra-Modal Misalignment Hypothesis in CLIP17 Mar 2026
- 2026Visual Words Meet BM25: Sparse Auto-Encoder Visual Word Scoring for Image Retrieval6 Mar 2026
- 2026RaCo: Ranking and Covariance for Practical Learned Keypoints17 Feb 2026
- 2026EPRBench: A High-Quality Benchmark Dataset for Event Stream Based Visual Place Recognition13 Feb 2026
- 2026Learning What to Predict: Downstream-Guided Task Design for Continued Pretraining29 Jan 2026
- 2026IOTA: Corrective Knowledge-Guided Prompt Learning via Black-White Box Framework28 Jan 2026
- 2026IIR-VLM: In-Context Instance-level Recognition for Large Vision-Language Models20 Jan 2026
- 2026CLIDD: Cross-Layer Independent Deformable Description for Efficient and Discriminative Local Feature Representation14 Jan 2026
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Models26 Dec 2025
- 2025MMLANDMARKS: a Cross-View Instance-Level Benchmark for Geo-Spatial Understanding19 Dec 2025
- 2025Enhancing Geo-localization for Crowdsourced Flood Imagery via LLM-Guided Attention25 Nov 2025
- 2025DORAEMON: A Unified Library for Visual Object Modeling and Representation Learning at Scale6 Nov 2025
- 2025Instance-Level Composed Image Retrieval29 Oct 2025
- 2025LightGlueStick: a Fast and Robust Glue for Joint Point-Line Matching18 Oct 2025
- 2025Instance-Level Generation for Representation Learning10 Oct 2025
- 2025Global-to-Local or Local-to-Global? Enhancing Image Retrieval with Efficient Local Search and Effective Global Re-ranking4 Sep 2025
- 2025Environmental Change Detection for Real-World Change Analysis13 Jun 2025
- 2025Locality Preserving Markovian Transition for Instance Retrieval5 Jun 2025
- 2025LotusFilter: Fast Diverse Nearest Neighbor Search via a Learned Cutoff Table5 Jun 2025
- 2025Self-Organizing Visual Prototypes for Non-Parametric Representation Learning23 May 2025
- 2025Beyond Classification: Evaluating Diffusion Denoised Smoothing for Security-Utility Trade off21 May 2025
- 2025Ditch the Denoiser: Emergence of Noise Robustness in Self-Supervised Learning from Data Curriculum18 May 2025
- 2025Learning Compatible Multi-Prize Subnetworks for Asymmetric Retrieval16 Apr 2025
- 2025Hypergraph Vision Transformers: Images are More than Nodes, More than Edges11 Apr 2025
- 2025CoMatcher: Multi-View Collaborative Feature Matching2 Apr 2025
50 newest of 189 All 189 (JSON)
- 2023SoftCLIP: Softer Cross-modal Alignment Makes CLIP Strongercited by 56
- 2025Cross the Gap: Exposing the Intra-modal Misalignment in CLIP via Modality Inversioncited by 42
- 2025ILIAS: Instance-Level Image retrieval At Scalecited by 29
- 2026IsoCLIP: Decomposing CLIP Projectors for Efficient Intra-modal Alignmentcited by 3
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Modelscited by 1
- 2026IIR-VLM: In-Context Instance-level Recognition for Large Vision-Language Modelscited by 1
- 2026RegRet: Enhancing Region-Level Retrieval in Large Multimodal Modelscited by 0
- 2026RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models15 Sep 2026
- 2026IsoCLIP: Decomposing CLIP Projectors for Efficient Intra-modal Alignment20 Mar 2026
- 2026IIR-VLM: In-Context Instance-level Recognition for Large Vision-Language Models20 Jan 2026
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Models26 Dec 2025
- 2025ILIAS: Instance-Level Image retrieval At Scale17 Feb 2025
- 2025Cross the Gap: Exposing the Intra-modal Misalignment in CLIP via Modality Inversion6 Feb 2025
- 2023SoftCLIP: Softer Cross-modal Alignment Makes CLIP Stronger30 Mar 2023
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2024Gen-SIS: Generative Self-augmentation Improves Self-supervised Learningcited by 4
- 2025Leveraging Diffusion Model and Image Foundation Model for Improved Correspondence Matching in Coronary Angiographycited by 0
- 2025Leveraging Diffusion Model and Image Foundation Model for Improved Correspondence Matching in Coronary Angiography31 Mar 2025
- 2024Gen-SIS: Generative Self-augmentation Improves Self-supervised Learning2 Dec 2024
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models7 Dec 2022
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021XCiT: Cross-Covariance Image Transformerscited by 335
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2022What to Hide from Your Students: Attention-Guided Masked Image Modelingcited by 117
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2021Training Vision Transformers for Image Retrievalcited by 90
- 2023Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Taskscited by 72
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 65
12 most cited of 177 All 177 (JSON)
- 2026Masked Swingers: Harnessing Data Augmentation to Advance Autoencoders for Self-Supervised Learning29 Sep 2026
- 2026Compensating for Scarce Historical Images in Cross-Domain Cultural Heritage Retrieval Using Synthetic Aging8 Sep 2026
- 2026ViTAMINS: An Empirical Study of Training Self-Supervised Vision Transformers with Synthetic Hard Negatives1 Sep 2026
- 2026FoundYou: A Unified Model for Personalized Segmentation and Retrieval30 Aug 2026
- 2026Unified and Efficient Point-Line Local Features20 Aug 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026KnifeHunter: Structured Local Representation Learning for Fine-Grained Knife Image Retrieval in Law Enforcement7 Aug 2026
- 2026Illuminating Visual Identity in Universal Multimodal Embeddings3 Aug 2026
- 2026Explaining Image Similarity with Automatically Extracted Concept Activation Vectors30 Jul 2026
- 2026Why Domain Matters: Domain-Aware Benchmarking of Underwater Object Detection and Annotation Quality12 Jul 2026
- 2026Beyond Post-Quantization: Native Hash Learning with a Dedicated HASH Token3 Jul 2026
- 2026Revising RVL-CDIP: Quantifying Errors and Test-Train Overlap30 Jun 2026
12 newest of 177 All 177 (JSON)