Attributable Visual Similarity Learning
Not on the map. Why?
Abstract (arXiv)
This paper proposes an attributable visual similarity learning (AVSL) framework for a more accurate and explainable similarity measure between images. Most existing similarity learning methods exacerbate the unexplainability by mapping each sample to a single point in the embedding space with a distance metric (e.g., Mahalanobis distance, Euclidean distance). Motivated by the human semantic similarity cognition, we propose a generalized similarity learning paradigm to represent the similarity between two images with a graph and then infer the overall similarity accordingly. Furthermore, we establish a bottom-up similarity construction and top-down similarity inference framework to infer the similarity based on semantic hierarchy consistency. We first identify unreliable higher-level similarity nodes and then correct them using the most coherent adjacent lower-level similarity nodes, which simultaneously preserve traces for similarity attribution. Extensive experiments on the CUB-200-2011, Cars196, and Stanford Online Products datasets demonstrate significant improvements over existing deep similarity learning methods and verify the interpretability of our framework. Code is available at https://github.com/zbr17/AVSL.
Key facts. Cited by 12 papers in the map (data through 13 Oct 2026). Builds on 38 of its 60 references that are in the map. First posted on arXiv 28 Mar 2022.
Builds on
38 of 60 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,476
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,713
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,055
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,838
- 2015Learning Deep Features for Discriminative Localizationcited by 2,434
- 2013Visualizing and Understanding Convolutional Networkscited by 2,282
- 2014How transferable are features in deep neural networks?cited by 1,219
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 785
- 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
26 more
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2015Understanding Neural Networks Through Deep Visualizationcited by 333
- 2017Sampling Matters in Deep Embedding Learningcited by 285
- 2017No Fuss Distance Metric Learning using Proxiescited by 226
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2017Beyond triplet loss: a deep quadruplet network for person re-identificationcited by 172
- 2019SoftTriple Loss: Deep Metric Learning Without Triplet Samplingcited by 163
- 2017Interpretable Convolutional Neural Networkscited by 161
- 2017Deep Metric Learning with Angular Losscited by 107
- 2017Smart Mining for Deep Metric Learningcited by 96
- 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
- 2018Attention-based Ensemble for Deep Metric Learningcited by 56
- 2019Hardness-Aware Deep Metric Learningcited by 55
- 2017Interpreting CNN Knowledge via an Explanatory Graphcited by 49
- 2020NBDT: Neural-Backed Decision Treescited by 46
- 2016Hard-Aware Deeply Cascaded Embeddingcited by 44
- 2018Deep Metric Learning with BIER: Boosting Independent Embeddings Robustlycited by 40
- 2019Signal-to-Noise Ratio: A Robust Distance Metric for Deep Metric Learningcited by 32
- 2021Towards Interpretable Deep Metric Learning with Structural Matchingcited by 30
- 2019Visualizing Deep Similarity Networkscited by 24
- 2021Deep Relational Metric Learningcited by 22
- 2020Adapting Grad-CAM for Embedding Networkscited by 21
- 2016Local Similarity-Aware Deep Feature Embeddingcited by 15
- 2019Hybrid-Attention based Decoupled Metric Learning for Zero-Shot Image Retrievalcited by 15
- 2019Visual Explanation for Deep Metric Learningcited by 14
- 2018Hard-Aware Point-to-Set Deep Metric for Person Re-identificationcited by 12
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 4; 2025: 3.
12 papers.
- 2023Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-trainingcited by 36
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
- 2023Introspective Deep Metric Learningcited by 7
- 2024Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learningcited by 6
- 2022Supervised Metric Learning to Rank for Retrieval via Contextual Similarity Optimizationcited by 5
- 2024Globally Correlation-Aware Hard Negative Generationcited by 5
- 2025Homeomorphism Prior for False Positive and Negative Problem in Medical Image Dense Contrastive Representation Learningcited by 4
- 2024A Unified Deep Semantic Expansion Framework for Domain-Generalized Person Re-identificationcited by 3
- 2022Probabilistic Deep Metric Learning for Hyperspectral Image Classificationcited by 2
- 2025Enhancing Sample Utilization in Noise-Robust Deep Metric Learning With Subgroup-Based Positive-Pair Selectioncited by 1
- 2022Introspective Deep Metric Learning for Image Retrievalcited by 0
- 2024Explainable Metric Learning for Deflating Data Biascited by 0
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasing26 Sep 2025
- 2025Homeomorphism Prior for False Positive and Negative Problem in Medical Image Dense Contrastive Representation Learning7 Feb 2025
- 2025Enhancing Sample Utilization in Noise-Robust Deep Metric Learning With Subgroup-Based Positive-Pair Selection19 Jan 2025
- 2024Globally Correlation-Aware Hard Negative Generation20 Nov 2024
- 2024A Unified Deep Semantic Expansion Framework for Domain-Generalized Person Re-identification11 Oct 2024
- 2024Explainable Metric Learning for Deflating Data Bias5 Jul 2024
- 2024Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learning4 Feb 2024
- 2023Introspective Deep Metric Learning11 Sep 2023
- 2023Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-training2 Mar 2023
- 2022Probabilistic Deep Metric Learning for Hyperspectral Image Classification15 Nov 2022
- 2022Supervised Metric Learning to Rank for Retrieval via Contextual Similarity Optimization4 Oct 2022
- 2022Introspective Deep Metric Learning for Image Retrieval9 May 2022