A Decade Survey of Content Based Image Retrieval using Deep Learning
Not on the map. Why?
Abstract (arXiv)
The content based image retrieval aims to find the similar images from a large scale dataset against a query image. Generally, the similarity between the representative features of the query image and dataset images is used to rank the images for retrieval. In early days, various hand designed feature descriptors have been investigated based on the visual cues such as color, texture, shape, etc. that represent the images. However, the deep learning has emerged as a dominating alternative of hand-designed feature engineering from a decade. It learns the features automatically from the data. This paper presents a comprehensive survey of deep learning based developments in the past decade for content based image retrieval. The categorization of existing state-of-the-art methods from different perspectives is also performed for greater understanding of the progress. The taxonomy used in this survey covers different supervision, different networks, different descriptor type and different retrieval type. A performance analysis is also performed using the state-of-the-art methods. The insights are also presented for the benefit of the researchers to observe the progress and to make the best choices. The survey presented in this paper will help in further research progress in image retrieval using deep learning.
Key facts. Cited by 72 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 10; 2023: 20; 2024: 10; 2025: 13; 2026: 8.
72 papers.
Sort:
By area:
- 2021Activation Functions in Deep Learning: A Comprehensive Survey and Benchmarkcited by 155
- 2023Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Taskscited by 72
- 2023Data Roaming and Quality Assessment for Composed Image Retrievalcited by 46
- 2021One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objectivecited by 43
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptionscited by 21
- 20233D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiologycited by 12
- 2022A survey on knowledge-enhanced multimodal learningcited by 11
- 2021Vision Transformer Hashing for Image Retrievalcited by 9
- 2023Have We Ever Encountered This Before? Retrieving Out-of-Distribution Road Obstacles from Driving Scenescited by 9
- 2023Medical Image Retrieval Using Pretrained Embeddingscited by 8
- 2022Motif Mining: Finding and Summarizing Remixed Image Contentcited by 7
- 2022Content-Based Medical Image Retrieval with Opponent Class Adaptive Margin Losscited by 7
38 more
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spacescited by 7
- 2024LInK: Learning Joint Representations of Design and Performance Spaces through Contrastive Learning for Mechanism Synthesiscited by 7
- 2023Language Guided Local Infiltration for Interactive Image Retrievalcited by 6
- 2023Survey of Automatic Plankton Image Recognition: Challenges, Existing Solutions and Future Perspectivescited by 6
- 2024Leveraging Foundation Models for Content-Based Image Retrieval in Radiologycited by 6
- 2025Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlookcited by 6
- 2022AdaNorm: Adaptive Gradient Norm Correction based Optimizer for CNNscited by 5
- 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
- 2021Bridging Gap between Image Pixels and Semantics via Supervision: A Surveycited by 4
- 2023LRVS-Fashion: Extending Visual Search with Referring Instructionscited by 4
- 2024SPLICE -- Streamlining Digital Pathology Image Processingcited by 4
- 2024Content-Based Image Retrieval for Multi-Class Volumetric Radiology Images: A Benchmark Studycited by 4
- 2025RadIR: A Scalable Framework for Multi-Grained Medical Image Retrieval via Radiology Report Miningcited by 4
- 2021Frequency Disentangled Residual Networkcited by 3
- 2023Ranking Loss and Sequestering Learning for Reducing Image Search Bias in Histopathologycited by 3
- 2022Learning Image Representations for Content Based Image Retrieval of Radiotherapy Treatment Planscited by 2
- 2022Guided Unsupervised Learning by Subaperture Decomposition for Ocean SAR Image Retrievalcited by 2
- 2023WSD: Wild Selfie Dataset for Face Recognition in Selfie Imagescited by 2
- 2023The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challengescited by 2
- 2023Risk Controlled Image Retrievalcited by 2
- 2023Selection of Distinct Morphologies to Divide & Conquer Gigapixel Pathology Imagescited by 2
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applicationscited by 2
- 2026Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learningcited by 2
- 2021Joint Triplet Autoencoder for Histopathological Colon Cancer Nuclei Retrievalcited by 1
- 2022Context Unaware Knowledge Distillation for Image Retrievalcited by 1
- 2023A survey of manifold learning and its applications for multimediacited by 1
- 2023The Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Modelcited by 1
- 2024Region-aware Image-based Human Action Retrieval with Transformerscited by 1
- 2025Circuit Diagram Retrieval Based on Hierarchical Circuit Graph Representationcited by 1
- 2025Content-based 3D Image Retrieval and a ColBERT-inspired Re-ranking for Tumor Flagging and Stagingcited by 1
- 2025Pore-scale Image Patch Dataset and A Comparative Evaluation of Pore-scale Facial Featurescited by 1
- 2021PrivateMail: Supervised Manifold Learning of Deep Features With Differential Privacy for Image Retrievalcited by 0
- 2021Scalable Visual Attribute Extraction through Hidden Layers of a Residual ConvNetcited by 0
- 2021A multimodal deep learning framework for scalable content based visual media retrievalcited by 0
- 2021AC-CovidNet: Attention Guided Contrastive CNN for Recognition of Covid-19 in Chest X-Ray Imagescited by 0
- 2021Semantic Map Injected GAN Training for Image-to-Image Translationcited by 0
- 2022OSCARS: An Outlier-Sensitive Content-Based Radiography Retrieval Systemcited by 0
- 2022Contrastive Cross-Modal Knowledge Sharing Pre-training for Vision-Language Representation Learning and Retrievalcited by 0
50 most cited of 72 All 72 (JSON)
- 2026Automated Goldsmith's Mark Retrieval in Silverware17 Sep 2026
- 2026Compensating for Scarce Historical Images in Cross-Domain Cultural Heritage Retrieval Using Synthetic Aging8 Sep 2026
- 2026RFHNet: Relational and Frequency-Aware Hashing Network for Large-Scale Fine-Grained Food Image Retrieval7 Jul 2026
- 2026Geometric Analysis of Self-Supervised Vision Representations for Semantic Image Retrieval27 Apr 2026
- 2026Detecting Media Clones in Cultural Repositories Using a Positive Unlabeled Learning Approach5 Apr 2026
- 2026Arbitrary Ratio Feature Compression via Next Token Prediction12 Feb 2026
- 2026WristMIR: Coarse-to-Fine Region-Aware Retrieval of Pediatric Wrist Radiographs with Radiology Report-Driven Learning8 Feb 2026
- 2026Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learning16 Jan 2026
- 2025Pore-scale Image Patch Dataset and A Comparative Evaluation of Pore-scale Facial Features29 Nov 2025
- 2025THIR: Topological Histopathological Image Retrieval17 Nov 2025
- 2025MIRAGE: Runtime Scheduling for Multi-Vector Image Retrieval with Hierarchical Decomposition10 Oct 2025
- 2025Concept Retrieval -- What and How?8 Oct 2025
38 more
- 2025Performance-Efficiency Trade-off for Fashion Image Retrieval29 Sep 2025
- 2025Composed Object Retrieval: Object-level Retrieval via Composed Expressions6 Aug 2025
- 2025Content-based 3D Image Retrieval and a ColBERT-inspired Re-ranking for Tumor Flagging and Staging23 Jul 2025
- 2025GenFlow: Interactive Modular System for Image Generation26 Jun 2025
- 2025Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook1 May 2025
- 2025RadIR: A Scalable Framework for Multi-Grained Medical Image Retrieval via Radiology Report Mining6 Mar 2025
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applications3 Mar 2025
- 2025Fast 3D point clouds retrieval for Large-scale 3D Place Recognition28 Feb 2025
- 2025Circuit Diagram Retrieval Based on Hierarchical Circuit Graph Representation5 Feb 2025
- 2024Transductive Learning for Near-Duplicate Image Detection in Scanned Photo Collections25 Oct 2024
- 2024Garment Attribute Manipulation with Multi-level Attention16 Sep 2024
- 2024A Survey of Multimodal Composite Editing and Retrieval9 Sep 2024
- 2024Region-aware Image-based Human Action Retrieval with Transformers13 Jul 2024
- 2024LInK: Learning Joint Representations of Design and Performance Spaces through Contrastive Learning for Mechanism Synthesis31 May 2024
- 2024Content-Based Image Retrieval for Multi-Class Volumetric Radiology Images: A Benchmark Study15 May 2024
- 2024Finding Beautiful and Happy Images for Mental Health and Well-being Applications28 Apr 2024
- 2024SPLICE -- Streamlining Digital Pathology Image Processing26 Apr 2024
- 2024Leveraging Foundation Models for Content-Based Image Retrieval in Radiology11 Mar 2024
- 2024Transformer-based Clipped Contrastive Quantization Learning for Unsupervised Image Retrieval27 Jan 2024
- 2023The Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Model4 Dec 2023
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spaces24 Nov 2023
- 20233D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology23 Nov 2023
- 2023Medical Image Retrieval Using Pretrained Embeddings22 Nov 2023
- 2023Selection of Distinct Morphologies to Divide & Conquer Gigapixel Pathology Images16 Nov 2023
- 2023Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks30 Oct 2023
- 2023A survey of manifold learning and its applications for multimedia8 Sep 2023
- 2023Have We Ever Encountered This Before? Retrieving Out-of-Distribution Road Obstacles from Driving Scenes8 Sep 2023
- 2023Risk Controlled Image Retrieval14 Jul 2023
- 2023LRVS-Fashion: Extending Visual Search with Referring Instructions5 Jun 2023
- 2023Class Anchor Margin Loss for Content-Based Image Retrieval1 Jun 2023
- 2023Towards Efficient Deep Hashing Retrieval: Condensing Your Data via Feature-Embedding Matching29 May 2023
- 2023Survey of Automatic Plankton Image Recognition: Challenges, Existing Solutions and Future Perspectives19 May 2023
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptions10 May 2023
- 2023Language Guided Local Infiltration for Interactive Image Retrieval16 Apr 2023
- 2023Ranking Loss and Sequestering Learning for Reducing Image Search Bias in Histopathology15 Apr 2023
- 2023Data Roaming and Quality Assessment for Composed Image Retrieval16 Mar 2023
- 2023Knowledge-Based Counterfactual Queries for Visual Question Answering5 Mar 2023
- 2023The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challenges4 Mar 2023
50 newest of 72 All 72 (JSON)
- 2022Context Unaware Knowledge Distillation for Image Retrieval19 Jul 2022
- 2021Activation Functions in Deep Learning: A Comprehensive Survey and Benchmarkcited by 155
- 2023Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Taskscited by 72
- 2023Data Roaming and Quality Assessment for Composed Image Retrievalcited by 46
- 2021One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objectivecited by 43
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptionscited by 21
- 20233D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiologycited by 12
- 2022A survey on knowledge-enhanced multimodal learningcited by 11
- 2021Vision Transformer Hashing for Image Retrievalcited by 9
- 2023Have We Ever Encountered This Before? Retrieving Out-of-Distribution Road Obstacles from Driving Scenescited by 9
- 2023Medical Image Retrieval Using Pretrained Embeddingscited by 8
- 2022Motif Mining: Finding and Summarizing Remixed Image Contentcited by 7
- 2022Content-Based Medical Image Retrieval with Opponent Class Adaptive Margin Losscited by 7
12 most cited of 68 All 68 (JSON)
- 2026Automated Goldsmith's Mark Retrieval in Silverware17 Sep 2026
- 2026Compensating for Scarce Historical Images in Cross-Domain Cultural Heritage Retrieval Using Synthetic Aging8 Sep 2026
- 2026RFHNet: Relational and Frequency-Aware Hashing Network for Large-Scale Fine-Grained Food Image Retrieval7 Jul 2026
- 2026Geometric Analysis of Self-Supervised Vision Representations for Semantic Image Retrieval27 Apr 2026
- 2026Detecting Media Clones in Cultural Repositories Using a Positive Unlabeled Learning Approach5 Apr 2026
- 2026Arbitrary Ratio Feature Compression via Next Token Prediction12 Feb 2026
- 2026WristMIR: Coarse-to-Fine Region-Aware Retrieval of Pediatric Wrist Radiographs with Radiology Report-Driven Learning8 Feb 2026
- 2026Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learning16 Jan 2026
- 2025Pore-scale Image Patch Dataset and A Comparative Evaluation of Pore-scale Facial Features29 Nov 2025
- 2025THIR: Topological Histopathological Image Retrieval17 Nov 2025
- 2025Concept Retrieval -- What and How?8 Oct 2025
- 2025Performance-Efficiency Trade-off for Fashion Image Retrieval29 Sep 2025
12 newest of 68 All 68 (JSON)