mlsanityData to 14 Oct 2026

Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification

arXiv 2203.03825 ↗First posted 8 Mar 2022cs.CLcited by 52

Not on the map. Why?

Abstract (arXiv)

Hierarchical text classification is a challenging subtask of multi-label classification due to its complex label hierarchy. Existing methods encode text and label hierarchy separately and mix their representations for classification, where the hierarchy remains unchanged for all input text. Instead of modeling them separately, in this work, we propose Hierarchy-guided Contrastive Learning (HGCLR) to directly embed the hierarchy into a text encoder. During training, HGCLR constructs positive samples for input text under the guidance of the label hierarchy. By pulling together the input text and its positive sample, the text encoder can learn to generate the hierarchy-aware text representation independently. Therefore, after training, the HGCLR enhanced text encoder can dispense with the redundant hierarchy. Extensive experiments on three benchmark datasets verify the effectiveness of HGCLR.

Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 23 of its 39 references that are in the map. First posted on arXiv 8 Mar 2022.

Builds on

23 of 39 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  6. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  7. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  8. 2018Generating Natural Language Adversarial Examplescited by 424
  9. 2020CLEAR: Contrastive Learning for Sentence Representationcited by 186
  10. 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
  11. 2021COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretrainingcited by 126
  12. 2017HDLTex: Hierarchical Deep Learning for Text Classificationcited by 106
11 more
  1. 2021Self-Guided Contrastive Learning for BERT Sentence Representationscited by 103
  2. 2020It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbationscited by 64
  3. 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
  4. 2019Hierarchical Text Classification with Reinforced Label Assignmentcited by 41
  5. 2014Effective Use of Word Order for Text Categorization with Convolutional Neural Networkscited by 40
  6. 2021Improved Text Classification via Contrastive Adversarial Trainingcited by 38
  7. 2019Learning to Learn and Predict: A Meta-Learning Approach for Multi-Label Classificationcited by 35
  8. 2019Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classificationcited by 32
  9. 2019Hyperbolic Interaction Model For Hierarchical Multi-Label Classificationcited by 30
  10. 2021HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximizationcited by 25
  11. 2020LA-HCN: Label-based Attention for Hierarchical Multi-label TextClassification Neural Networkcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 4; 2023: 9; 2024: 21; 2025: 9; 2026: 9.

52 papers.

Sort:

By area:

  1. 2022HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classificationcited by 31
  2. 2023The ACL OCL Corpus: Advancing Open Science in Computational Linguisticscited by 17
  3. 2023HiTIN: Hierarchy-aware Tree Isomorphism Network for Hierarchical Text Classificationcited by 17
  4. 2024Retrieval-style In-Context Learning for Few-shot Hierarchical Text Classificationcited by 16
  5. 2022Exploiting Global and Local Hierarchies for Hierarchical Text Classificationcited by 15
  6. 2023Hierarchical Verbalizer for Few-Shot Hierarchical Text Classificationcited by 11
  7. 2024Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognitioncited by 11
  8. 2024Why Misinformation is Created? Detecting them by Integrating Intent Featurescited by 11
  9. 2024Multi-stage Retrieve and Re-rank Model for Automatic Medical Coding Recommendationcited by 8
  10. 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Modelscited by 8
  11. 2023A Simple and Effective Framework for Strict Zero-Shot Hierarchical Classificationcited by 7
  12. 2024Revisiting Hierarchical Text Classification: Inference and Metricscited by 7
38 more
  1. 2025The LLM Bottleneck: Why Open-Source Vision LLMs Struggle with Hierarchical Visual Recognitioncited by 7
  2. 2024HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classificationcited by 6
  3. 2023Towards a Holistic Understanding of Mathematical Questions with Contrastive Pre-trainingcited by 5
  4. 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classificationcited by 4
  5. 2023Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understandingcited by 4
  6. 2024Exploring Contrastive Learning for Long-Tailed Multi-Label Text Classificationcited by 4
  7. 2026Taxonomy-Aware Representation Alignment for Hierarchical Visual Recognition with Large Multimodal Modelscited by 4
  8. 2024Learning Label Hierarchy with Supervised Contrastive Learningcited by 3
  9. 2024Utilizing Local Hierarchy with Adversarial Training for Hierarchical Text Classificationcited by 3
  10. 2023Co-guiding for Multi-intent Spoken Language Understandingcited by 2
  11. 2024FaultProfIT: Hierarchical Fault Profiling of Incident Tickets in Large-scale Cloud Systemscited by 2
  12. 2024Hierarchical Query Classification in E-commerce Searchcited by 2
  13. 2024Domain-Hierarchy Adaptation via Chain of Iterative Reasoning for Few-shot Hierarchical Text Classificationcited by 2
  14. 2024Your Extreme Multi-label Classifier is Secretly a Hierarchical Text Classifier for Freecited by 2
  15. 2026Hierarchical Text Classification with LLM-Refined Taxonomiescited by 2
  16. 2022Are We Really Making Much Progress in Text Classification? A Comparative Reviewcited by 1
  17. 2022Seeded Hierarchical Clustering for Expert-Crafted Taxonomiescited by 1
  18. 2023Text2Tree: Aligning Text Representation to the Label Tree Hierarchy for Imbalanced Medical Classificationcited by 1
  19. 2024Introducing Three New Benchmark Datasets for Hierarchical Text Classificationcited by 1
  20. 2024LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuningcited by 1
  21. 2026Learning Hierarchical Knowledge in Text-Rich Networks with Taxonomy-Informed Representation Learningcited by 1
  22. 2024Re-thinking Human Activity Recognition with Hierarchy-aware Label Relationship Modelingcited by 0
  23. 2024HC2L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understandingcited by 0
  24. 2024A Debiased Nearest Neighbors Framework for Multi-Label Text Classificationcited by 0
  25. 2024HiLight: A Hierarchy-aware Light Global Model with Hierarchical Local ConTrastive Learningcited by 0
  26. 2024Modeling Text-Label Alignment for Hierarchical Text Classificationcited by 0
  27. 2024NexusIndex: Integrating Advanced Vector Indexing and Multi-Model Embeddings for Robust Fake News Detectioncited by 0
  28. 2025A Transformer-based Autoregressive Decoder Architecture for Hierarchical Text Classificationcited by 0
  29. 2025Hierarchical Text Classification Using Contrastive Learning Informed Path Guided Hierarchycited by 0
  30. 2025Enhancing Text-Based Hierarchical Multilabel Classification for Mobile Applications via Contrastive Learningcited by 0
  31. 2025Hierarchical Job Classification with Similarity Graph Integrationcited by 0
  32. 2025Making Language Model a Hierarchical Classifiercited by 0
  33. 2025Combining Language and Topic Models for Hierarchical Text Classificationcited by 0
  34. 2025Adaptive Sparse Softmax: An Effective and Efficient Softmax Variantcited by 0
  35. 2026Taxon: Hierarchical Tax Code Prediction with Semantically Aligned LLM Expert Guidancecited by 0
  36. 2026FEAST: Retrieval-Augmented Multi-Hierarchical Food Classification for the FoodEx2 Systemcited by 0
  37. 2026Mastering the Minority: An Uncertainty-guided Multi-Expert Framework for Challenging-tailed Sequence Learningcited by 0
  38. 2026ViCLSR: A Supervised Contrastive Learning Framework with Natural Language Inference for Natural Language Understanding Taskscited by 0

50 most cited of 52 All 52 (JSON)