Learning Fine-grained Image Similarity with Deep Ranking
Not on the map. Why?
Abstract (arXiv)
Learning fine-grained image similarity is a challenging task. It needs to capture between-class and within-class image differences. This paper proposes a deep ranking model that employs deep learning techniques to learn similarity metric directly from images.It has higher learning capability than models based on hand-crafted features. A novel multiscale network structure has been developed to describe the images effectively. An efficient triplet sampling algorithm is proposed to learn the model with distributed asynchronized stochastic gradient. Extensive experiments show that the proposed algorithm outperforms models based on hand-crafted visual features and deep classification models.
Key facts. Cited by 189 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Apr 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 65; 2022: 45; 2023: 41; 2024: 17; 2025: 16; 2026: 5.
189 papers.
Sort:
By area:
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2021Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Searchcited by 90
- 2021Semantic Communications: Principles and Challengescited by 90
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2021CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representationscited by 72
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2021Deep One-Class Classification via Interpolated Gaussian Descriptorcited by 67
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
38 more
- 2021Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmarkcited by 47
- 2022FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Contextcited by 47
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 46
- 2022Unbiased Supervised Contrastive Learningcited by 40
- 2023Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Compositional Understandingcited by 40
- 2022Probabilistic Representations for Video Contrastive Learningcited by 33
- 2021Pairwise Supervised Contrastive Learning of Sentence Representationscited by 31
- 2023Gloss-Free End-to-End Sign Language Translationcited by 31
- 2021Visual Search at Alibabacited by 27
- 2022HIER: Metric Learning Beyond Class Labels via Hierarchical Regularizationcited by 26
- 2024Composed Video Retrieval via Enriched Context and Discriminative Embeddingscited by 26
- 2023Large Separable Kernel Attention: Rethinking the Large Kernel Attention Design in CNNcited by 25
- 2021Learning Efficient Representations for Keyword Spotting with Triplet Losscited by 24
- 2021It Takes Two to Tango: Mixup for Deep Metric Learningcited by 23
- 2021Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detectioncited by 23
- 2021Deep Relational Metric Learningcited by 22
- 2021Embedding Transfer with Label Relaxation for Improved Metric Learningcited by 21
- 2021Learning with Memory-based Virtual Classes for Deep Metric Learningcited by 21
- 2022CoNT: Contrastive Neural Text Generationcited by 21
- 2022Self-Supervised Monocular Depth Estimation: Solving the Edge-Fattening Problemcited by 20
- 2022Learning a Structured Latent Space for Unsupervised Point Cloud Completioncited by 17
- 2023Proxy Anchor-based Unsupervised Learning for Continuous Generalized Category Discoverycited by 16
- 2021Gaussian Mixture Variational Autoencoder with Contrastive Learning for Multi-Label Classificationcited by 15
- 2022On the Learning and Learnability of Quasimetricscited by 15
- 2023A survey and taxonomy of loss functions in machine learningcited by 15
- 2023ACLS: Adaptive and Conditional Label Smoothing for Network Calibrationcited by 15
- 2021Dynamic Class Queue for Large Scale Face Recognition In the Wildcited by 14
- 2023Universal Multimodal Representation for Language Understandingcited by 14
- 2021Cross-Image Region Mining with Region Prototypical Network for Weakly Supervised Segmentationcited by 13
- 2021Telling the What while Pointing to the Where: Multimodal Queries for Image Retrievalcited by 12
- 2022Clustering Aided Weakly Supervised Training to Detect Anomalous Events in Surveillance Videoscited by 12
- 2021A Computational Framework for Slang Generationcited by 11
- 2021ASMR: Learning Attribute-Based Person Search with Adaptive Semantic Margin Regularizercited by 11
- 2022Is Fairness Only Metric Deep? Evaluating and Addressing Subgroup Gaps in Deep Metric Learningcited by 11
- 2023Cross-Modal Retrieval for Motion and Text via DropTriple Losscited by 11
- 2022What You See is Not What the Network Infers: Detecting Adversarial Examples Based on Semantic Contradictioncited by 10
- 2022Enhancing Adversarial Robustness for Deep Metric Learningcited by 10
- 2023Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Groundingcited by 10
50 most cited of 189 All 189 (JSON)
- 2026Tracking Intermittent Particles with Self-Learned Visual Features10 Jul 2026
- 2026TREK: Distill to Explore, Reinforce to Refine6 Jul 2026
- 2026HodgeCover: Higher-Order Topological Coverage Drives Compression of Sparse Mixture-of-Experts13 May 2026
- 2026Maintaining Difficulty: A Margin Scheduler for Triplet Loss in Siamese Networks Training27 Mar 2026
- 2026BLENDER: Blended Text Embeddings and Diffusion Residuals for Intra-Class Image Synthesis in Deep Metric Learning28 Jan 2026
- 2025Intelligent Image Search Algorithms Fusing Visual Large Models25 Nov 2025
- 2025Dual-level Progressive Hardness-Aware Reweighting for Cross-View Geo-Localization31 Oct 2025
- 2025Perspective-aware 3D Gaussian Inpainting with Multi-view Consistency13 Oct 2025
- 2025The Overlooked Value of Test-time Reference Sets in Visual Place Recognition4 Oct 2025
- 2025Annotation-Free Human Sketch Quality Assessment28 Jul 2025
- 2025AbRank: A Benchmark Dataset and Metric-Learning Framework for Antibody-Antigen Affinity Ranking21 Jun 2025
- 2025NDCG-Consistent Softmax Approximation with Accelerated Convergence11 Jun 2025
38 more
- 2025Self-supervised Latent Space Optimization with Nebula Variational Coding2 Jun 2025
- 20253D Skeleton-Based Action Recognition: A Review1 Jun 2025
- 2025Mixture-of-Attack-Experts with Class Regularization for Unified Physical-Digital Face Attack Detection1 Apr 2025
- 2025Pairwise Matching of Intermediate Representations for Fine-grained Explainability28 Mar 2025
- 2025STEAD: Spatio-Temporal Efficient Anomaly Detection for Time and Compute Sensitive Applications11 Mar 2025
- 2025Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia10 Mar 2025
- 2025Unveiling ECC Vulnerabilities: LSTM Networks for Operation Recognition in Side-Channel Attacks24 Feb 2025
- 2025SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval12 Jan 2025
- 2025Real-Time Neural-Enhancement for Online Cloud Gaming12 Jan 2025
- 2024ExeChecker: Where Did I Go Wrong?13 Dec 2024
- 2024Few-Class Arena: A Benchmark for Efficient Selection of Vision Models and Dataset Difficulty Measurement2 Nov 2024
- 2024Is Function Similarity Over-Engineered? Building a Benchmark30 Oct 2024
- 2024DAAL: Density-Aware Adaptive Line Margin Loss for Multi-Modal Deep Metric Learning7 Oct 2024
- 2024A Survey of Multimodal Composite Editing and Retrieval9 Sep 2024
- 2024Improved Diversity-Promoting Collaborative Metric Learning for Recommendation2 Sep 2024
- 2024From Attributes to Natural Language: A Survey and Foresight on Text-based Person Re-identification31 Jul 2024
- 2024Differentiable Product Quantization for Memory Efficient Camera Relocalization22 Jul 2024
- 2024CLOVER: Context-aware Long-term Object Viewpoint- and Environment- Invariant Representation Learning12 Jul 2024
- 2024Enhancing context models for point cloud geometry compression with context feature residuals and multi-loss11 Jul 2024
- 2024Pseudo-Prompt Generating in Pre-trained Vision-Language Models for Multi-Label Medical Image Classification10 May 2024
- 2024Event-enhanced Retrieval in Real-time Search9 Apr 2024
- 2024Composed Video Retrieval via Enriched Context and Discriminative Embeddings25 Mar 2024
- 2024Revisiting Experience Replayable Conditions15 Feb 2024
- 2024Generalized People Diversity: Learning a Human Perception-Aligned Diversity Representation for People Images25 Jan 2024
- 2024Interleaving One-Class and Weakly-Supervised Models with Adaptive Thresholding for Unsupervised Video Anomaly Detection24 Jan 2024
- 2024Towards Improved Proxy-based Deep Metric Learning via Data-Augmented Domain Adaptation1 Jan 2024
- 2023Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Grounding27 Dec 2023
- 2023Collapse-Aware Triplet Decoupling for Adversarially Robust Image Retrieval12 Dec 2023
- 2023Improve Supervised Representation Learning with Masked Image Modeling1 Dec 2023
- 2023Quantum learning and essential cognition under the traction of meta-characteristics in an open world22 Nov 2023
- 2023Robust Feature Learning and Global Variance-Driven Classifier Alignment for Long-Tail Class Incremental Learning2 Nov 2023
- 2023A Lightweight Video Anomaly Detection Model with Weak Supervision and Adaptive Instance Selection9 Oct 2023
- 2023GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policy16 Sep 2023
- 2023Learning Unified Distance Metric Across Diverse Data Distributions with Parameter-Efficient Transfer Learning16 Sep 2023
- 2023Introspective Deep Metric Learning11 Sep 2023
- 2023How to Evaluate Semantic Communications for Images with ViTScore Metric?9 Sep 2023
- 2023Large Separable Kernel Attention: Rethinking the Large Kernel Attention Design in CNN4 Sep 2023
- 2023Efficient Discovery and Effective Evaluation of Visual Perceptual Similarity: A Benchmark and Beyond28 Aug 2023
50 newest of 189 All 189 (JSON)
- 2023Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Compositional Understandingcited by 40
- 2022A Comprehensive Empirical Study of Vision-Language Pre-trained Model for Supervised Cross-Modal Retrievalcited by 4
- 2024Pseudo-Prompt Generating in Pre-trained Vision-Language Models for Multi-Label Medical Image Classificationcited by 1
- 2024Pseudo-Prompt Generating in Pre-trained Vision-Language Models for Multi-Label Medical Image Classification10 May 2024
- 2023Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Compositional Understanding15 Jun 2023
- 2022A Comprehensive Empirical Study of Vision-Language Pre-trained Model for Supervised Cross-Modal Retrieval8 Jan 2022
- 2026TREK: Distill to Explore, Reinforce to Refinecited by 1
- 2026TREK: Distill to Explore, Reinforce to Refine6 Jul 2026
- 2024Event-enhanced Retrieval in Real-time Searchcited by 1
- 2024Event-enhanced Retrieval in Real-time Search9 Apr 2024
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2021Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Searchcited by 90
- 2021Semantic Communications: Principles and Challengescited by 90
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2021CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representationscited by 72
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2021Deep One-Class Classification via Interpolated Gaussian Descriptorcited by 67
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
12 most cited of 181 All 181 (JSON)
- 2026Tracking Intermittent Particles with Self-Learned Visual Features10 Jul 2026
- 2026Maintaining Difficulty: A Margin Scheduler for Triplet Loss in Siamese Networks Training27 Mar 2026
- 2026BLENDER: Blended Text Embeddings and Diffusion Residuals for Intra-Class Image Synthesis in Deep Metric Learning28 Jan 2026
- 2025Intelligent Image Search Algorithms Fusing Visual Large Models25 Nov 2025
- 2025Dual-level Progressive Hardness-Aware Reweighting for Cross-View Geo-Localization31 Oct 2025
- 2025The Overlooked Value of Test-time Reference Sets in Visual Place Recognition4 Oct 2025
- 2025Annotation-Free Human Sketch Quality Assessment28 Jul 2025
- 2025AbRank: A Benchmark Dataset and Metric-Learning Framework for Antibody-Antigen Affinity Ranking21 Jun 2025
- 2025NDCG-Consistent Softmax Approximation with Accelerated Convergence11 Jun 2025
- 2025Self-supervised Latent Space Optimization with Nebula Variational Coding2 Jun 2025
- 20253D Skeleton-Based Action Recognition: A Review1 Jun 2025
- 2025Pairwise Matching of Intermediate Representations for Fine-grained Explainability28 Mar 2025
12 newest of 181 All 181 (JSON)