Mining on Manifolds: Metric Learning without Labels
Not on the map. Why?
Abstract (arXiv)
In this work we present a novel unsupervised framework for hard training example mining. The only input to the method is a collection of images relevant to the target application and a meaningful initial representation, provided e.g. by pre-trained CNN. Positive examples are distant points on a single manifold, while negative examples are nearby points on different manifolds. Both types of examples are revealed by disagreements between Euclidean and manifold similarities. The discovered examples can be used in training with any discriminative loss. The method is applied to unsupervised fine-tuning of pre-trained networks for fine-grained classification and particular object retrieval. Our models are on par or are outperforming prior models that are fully or partially supervised.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 8; 2023: 7; 2024: 9; 2025: 1.
36 papers.
Sort:
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2022Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCocited by 52
- 2023Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Datacited by 44
- 2023Unicom: Universal and Compact Representation Learning for Image Retrievalcited by 36
- 2021Max-Margin Contrastive Learningcited by 27
- 2022Integrating Language Guidance into Vision-based Deep Metric Learningcited by 19
- 2022Contrastive Multi-view Hyperbolic Hierarchical Clusteringcited by 19
- 2021Knowledge Evolution in Neural Networkscited by 18
- 2023Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learningcited by 18
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applicationscited by 14
- 2022Self-Taught Metric Learning without Labelscited by 13
- 2021InsCLR: Improving Instance Retrieval with Self-Supervisioncited by 11
24 more
- 2022On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learningcited by 10
- 2021TLDR: Twin Learning for Dimensionality Reductioncited by 9
- 2022Contrastive Bayesian Analysis for Deep Metric Learningcited by 8
- 2021Improving Deep Metric Learning by Divide and Conquercited by 5
- 2022Global Contrastive Batch Sampling via Optimization on Sample Permutationscited by 5
- 2024SynCo: Synthetic Hard Negatives for Contrastive Visual Representation Learningcited by 5
- 2021Improving memory banks for unsupervised learning with large mini-batch, consistency and hard negative miningcited by 4
- 2021Exploring Instance Relations for Unsupervised Feature Embeddingcited by 4
- 2023Deep Metric Learning for the Hemodynamics Inference with Electrocardiogram Signalscited by 4
- 2023DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learningcited by 4
- 2024Piecewise-Linear Manifolds for Deep Metric Learningcited by 4
- 2024ROGPL: Robust Open-Set Graph Learning via Region-Based Prototype Learningcited by 2
- 2024Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimationcited by 2
- 2021DeepDiffusion: Unsupervised Learning of Retrieval-adapted Representations via Diffusion-based Ranking on Latent Feature Manifoldcited by 1
- 2022Instance Image Retrieval by Learning Purely From Within the Datasetcited by 1
- 2023Rank Flow Embedding for Unsupervised and Semi-Supervised Manifold Learningcited by 1
- 2023A survey of manifold learning and its applications for multimediacited by 1
- 2024Random Walk on Pixel Manifolds for Anomaly Segmentation of Complex Driving Scenescited by 1
- 2025Unsupervised Ground Metric Learningcited by 1
- 2021Unsupervised Embedding Learning from Uncertainty Momentum Modelingcited by 0
- 2021Towards noise robust trigger-word detection with contrastive learning pre-task for fast on-boarding of new trigger-wordscited by 0
- 2024Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairingcited by 0
- 2024GLRT-Based Metric Learning for Remote Sensing Object Retrievalcited by 0
- 2024Retrieval Augmented Image Harmonizationcited by 0
- 2025Unsupervised Ground Metric Learning17 Jul 2025
- 2024Retrieval Augmented Image Harmonization18 Dec 2024
- 2024GLRT-Based Metric Learning for Remote Sensing Object Retrieval8 Oct 2024
- 2024SynCo: Synthetic Hard Negatives for Contrastive Visual Representation Learning3 Oct 2024
- 2024Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation19 Aug 2024
- 2024Random Walk on Pixel Manifolds for Anomaly Segmentation of Complex Driving Scenes27 Apr 2024
- 2024Piecewise-Linear Manifolds for Deep Metric Learning22 Mar 2024
- 2024ROGPL: Robust Open-Set Graph Learning via Region-Based Prototype Learning28 Feb 2024
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applications27 Feb 2024
- 2024Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing11 Jan 2024
- 2023Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learning23 Sep 2023
- 2023DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning21 Sep 2023
24 more
- 2023A survey of manifold learning and its applications for multimedia8 Sep 2023
- 2023Deep Metric Learning for the Hemodynamics Inference with Electrocardiogram Signals9 Aug 2023
- 2023Rank Flow Embedding for Unsupervised and Semi-Supervised Manifold Learning24 Apr 2023
- 2023Unicom: Universal and Compact Representation Learning for Image Retrieval12 Apr 2023
- 2023Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Data23 Mar 2023
- 2022Global Contrastive Batch Sampling via Optimization on Sample Permutations23 Oct 2022
- 2022Contrastive Bayesian Analysis for Deep Metric Learning10 Oct 2022
- 2022Instance Image Retrieval by Learning Purely From Within the Dataset12 Aug 2022
- 2022On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning11 Aug 2022
- 2022Contrastive Multi-view Hyperbolic Hierarchical Clustering5 May 2022
- 2022Self-Taught Metric Learning without Labels4 May 2022
- 2022Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo30 Mar 2022
- 2022Integrating Language Guidance into Vision-based Deep Metric Learning16 Mar 2022
- 2021Max-Margin Contrastive Learning21 Dec 2021
- 2021DeepDiffusion: Unsupervised Learning of Retrieval-adapted Representations via Diffusion-based Ranking on Latent Feature Manifold14 Dec 2021
- 2021InsCLR: Improving Instance Retrieval with Self-Supervision2 Dec 2021
- 2021Towards noise robust trigger-word detection with contrastive learning pre-task for fast on-boarding of new trigger-words6 Nov 2021
- 2021TLDR: Twin Learning for Dimensionality Reduction18 Oct 2021
- 2021Improving Deep Metric Learning by Divide and Conquer9 Sep 2021
- 2021Unsupervised Embedding Learning from Uncertainty Momentum Modeling19 Jul 2021
- 2021Exploring Instance Relations for Unsupervised Feature Embedding7 May 2021
- 2021Knowledge Evolution in Neural Networks9 Mar 2021
- 2021Improving memory banks for unsupervised learning with large mini-batch, consistency and hard negative mining8 Feb 2021
- 2021Deep Learning for Instance Retrieval: A Survey27 Jan 2021
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2022Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCocited by 52
- 2023Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Datacited by 44
- 2023Unicom: Universal and Compact Representation Learning for Image Retrievalcited by 36
- 2021Max-Margin Contrastive Learningcited by 27
- 2022Integrating Language Guidance into Vision-based Deep Metric Learningcited by 19
- 2022Contrastive Multi-view Hyperbolic Hierarchical Clusteringcited by 19
- 2021Knowledge Evolution in Neural Networkscited by 18
- 2023Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learningcited by 18
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applicationscited by 14
- 2022Self-Taught Metric Learning without Labelscited by 13
- 2021InsCLR: Improving Instance Retrieval with Self-Supervisioncited by 11
12 most cited of 36 All 36 (JSON)
- 2025Unsupervised Ground Metric Learning17 Jul 2025
- 2024Retrieval Augmented Image Harmonization18 Dec 2024
- 2024GLRT-Based Metric Learning for Remote Sensing Object Retrieval8 Oct 2024
- 2024SynCo: Synthetic Hard Negatives for Contrastive Visual Representation Learning3 Oct 2024
- 2024Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation19 Aug 2024
- 2024Random Walk on Pixel Manifolds for Anomaly Segmentation of Complex Driving Scenes27 Apr 2024
- 2024Piecewise-Linear Manifolds for Deep Metric Learning22 Mar 2024
- 2024ROGPL: Robust Open-Set Graph Learning via Region-Based Prototype Learning28 Feb 2024
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applications27 Feb 2024
- 2024Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing11 Jan 2024
- 2023Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learning23 Sep 2023
- 2023DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning21 Sep 2023
12 newest of 36 All 36 (JSON)