mlsanityData to 14 Oct 2026

Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework

arXiv 2204.13207 ↗First posted 27 Apr 2022cs.CV cs.AI cs.LGcited by 59

Not on the map. Why?

Abstract (arXiv)

Current contrastive learning frameworks focus on leveraging a single supervisory signal to learn representations, which limits the efficacy on unseen data and downstream tasks. In this paper, we present a hierarchical multi-label representation learning framework that can leverage all available labels and preserve the hierarchical relationship between classes. We introduce novel hierarchy preserving losses, which jointly apply a hierarchical penalty to the contrastive loss, and enforce the hierarchy constraint. The loss function is data driven and automatically adapts to arbitrary multi-label structures. Experiments on several datasets show that our relationship-preserving embedding performs well on a variety of tasks and outperform the baseline supervised and self-supervised approaches. Code is available at https://github.com/salesforce/hierarchicalContrastiveLearning.

Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). Builds on 32 of its 52 references that are in the map. First posted on arXiv 27 Apr 2022.

Builds on

32 of 52 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  8. 2020Supervised Contrastive Learningcited by 2,829
  9. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  10. 2019Contrastive Multiview Codingcited by 1,301
  11. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  12. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
20 more
  1. 2016An overview of gradient descent optimization algorithmscited by 1,033
  2. 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 673
  3. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 640
  4. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  5. 2020A Metric Learning Reality Checkcited by 321
  6. 2019On Mutual Information Maximization for Representation Learningcited by 316
  7. 2017Sampling Matters in Deep Embedding Learningcited by 285
  8. 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
  9. 2021VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examplescited by 154
  10. 2019Making Better Mistakes: Leveraging Class Hierarchies with Deep Networkscited by 113
  11. 2018Deep Metric Learning with Hierarchical Triplet Losscited by 112
  12. 2020Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biasescited by 107
  13. 2019MultiGrain: a unified image embedding for classes and instancescited by 85
  14. 2019Ranked List Loss for Deep Metric Learningcited by 77
  15. 2020Coherent Hierarchical Multi-Label Classification Networkscited by 65
  16. 2017Do Convolutional Neural Networks Learn Class Hierarchy?cited by 61
  17. 2020Multi-Label Contrastive Learning for Abstract Visual Reasoningcited by 24
  18. 2020Leveraging Class Hierarchies with Metric-Guided Prototype Learningcited by 20
  19. 2020Exploit Clues from Views: Self-Supervised and Regularized Learning for Multiview Object Recognitioncited by 6
  20. 2021Multi-level Distance Regularization for Deep Metric Learningcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 5; 2023: 13; 2024: 14; 2025: 17; 2026: 10.

59 papers.

Sort:

By area:

  1. 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
  2. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  3. 2024SelEx: Self-Expertise in Fine-Grained Generalized Category Discoverycited by 34
  4. 2022OpenCon: Open-world Contrastive Learningcited by 33
  5. 2024Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretrainingcited by 28
  6. 2023MaskCon: Masked Contrastive Learning for Coarse-Labelled Datasetcited by 21
  7. 2023TransHP: Image Classification with Hierarchical Promptingcited by 16
  8. 2024Visually Consistent Hierarchical Image Classificationcited by 16
  9. 2023Hierarchical discriminative learning improves visual representations of biomedical microscopycited by 12
  10. 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
  11. 2024QUEEN: Query Unlearning against Model Extractioncited by 9
  12. 2022Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Predictioncited by 8
38 more
  1. 2023End-to-End Supervised Multilabel Contrastive Learningcited by 8
  2. 2023Joint Multiple Intent Detection and Slot Filling with Supervised Contrastive Learning and Self-Distillationcited by 7
  3. 2023Introspective Deep Metric Learningcited by 7
  4. 2024HEX: Hierarchical Emergence Exploitation in Self-Supervised Algorithmscited by 7
  5. 2025SEAL: Semantic-Aware Hierarchical Learning for Generalized Category Discoverycited by 7
  6. 2023Revisiting Logistic-softmax Likelihood in Bayesian Meta-Learning for Few-Shot Classificationcited by 6
  7. 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classificationcited by 4
  8. 2024Exploring Contrastive Learning for Long-Tailed Multi-Label Text Classificationcited by 4
  9. 2025Class Prototypes based Contrastive Learning for Classifying Multi-Label and Fine-Grained Educational Videoscited by 4
  10. 2023Incorporating Domain Knowledge Graph into Multimodal Movie Genre Classification with Self-Supervised Attention and Contrastive Learningcited by 3
  11. 2024ProbMCL: Simple Probabilistic Contrastive Learning for Multi-label Visual Classificationcited by 3
  12. 2024Learning Label Hierarchy with Supervised Contrastive Learningcited by 3
  13. 2024Language Model as Visual Explainercited by 3
  14. 2025Can we make NeRF-based visual localization privacy-preserving?cited by 3
  15. 2025Robult: Leveraging Redundancy and Modality Specific Features for Robust Multimodal Learningcited by 3
  16. 2025Free-Grained Hierarchical Visual Recognitioncited by 3
  17. 2023Multi-Similarity Contrastive Learningcited by 2
  18. 2024Acoustic identification of individual animals with hierarchical contrastive learningcited by 2
  19. 2024Similarity-Dissimilarity Loss for Multi-label Supervised Contrastive Learningcited by 2
  20. 2025Skin Lesion Phenotyping via Nested Multi-modal Contrastive Learningcited by 2
  21. 2025Generalized Fine-Grained Category Discovery with Multi-Granularity Conceptual Expertscited by 2
  22. 2025Boosting Medical Visual Understanding From Multi-Granular Language Learningcited by 2
  23. 2022TagRec++: Hierarchical Label Aware Attention Network for Question Categorizationcited by 1
  24. 2024Veri-Car: Towards Open-world Vehicle Information Retrievalcited by 1
  25. 2025Improving Multi-Label Contrastive Learning by Leveraging Label Distributioncited by 1
  26. 2025Multi-level Supervised Contrastive Learningcited by 1
  27. 2025Correcting Noisy Multilabel Predictions: Modeling Label Noise through Latent Space Shiftscited by 1
  28. 2025Multi-Grained Compositional Visual Clue Learning for Image Intent Recognitioncited by 1
  29. 2026MATANet: A Multi-context Attention and Taxonomy-Aware Network for Fine-Grained Underwater Recognition of Marine Speciescited by 1
  30. 2026Learning Hierarchical Knowledge in Text-Rich Networks with Taxonomy-Informed Representation Learningcited by 1
  31. 2026Hierarchical, Interpretable, Label-Free Concept Bottleneck Modelcited by 1
  32. 2026Cross-Layer Misalignment Detection in Agent Skills: A Progressive Loading-Aware Contrastive Learning Approachcited by 1
  33. 2022Large-Scale Product Retrieval with Weakly Supervised Representation Learningcited by 0
  34. 2023Contrastive Label Enhancementcited by 0
  35. 2024Computer User Interface Understanding. A New Dataset and a Learning Frameworkcited by 0
  36. 2024Automatic Alignment of Discourse Relations of Different Discourse Annotation Frameworkscited by 0
  37. 2025Hierarchical Multi-Label Contrastive Learning for Protein-Protein Interaction Prediction Across Organismscited by 0
  38. 2025ModAn-MulSupCon: Modality-and Anatomy-Aware Multi-Label Supervised Contrastive Pretraining for Medical Imagingcited by 0

50 most cited of 59 All 59 (JSON)