mlsanityData to 14 Oct 2026

HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification

arXiv 2204.13413 ↗First posted 28 Apr 2022cs.CLcited by 31

Not on the map. Why?

Abstract (arXiv)

Hierarchical text classification (HTC) is a challenging subtask of multi-label classification due to its complex label hierarchy. Recently, the pretrained language models (PLM)have been widely adopted in HTC through a fine-tuning paradigm. However, in this paradigm, there exists a huge gap between the classification tasks with sophisticated label hierarchy and the masked language model (MLM) pretraining tasks of PLMs and thus the potentials of PLMs can not be fully tapped. To bridge the gap, in this paper, we propose HPT, a Hierarchy-aware Prompt Tuning method to handle HTC from a multi-label MLM perspective. Specifically, we construct a dynamic virtual template and label words that take the form of soft prompts to fuse the label hierarchy knowledge and introduce a zero-bounded multi-label cross entropy loss to harmonize the objectives of HTC and MLM. Extensive experiments show HPT achieves state-of-the-art performances on 3 popular HTC datasets and is adept at handling the imbalance and low resource situations. Our code is available at https://github.com/wzh9969/HPT.

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 17 of its 32 references that are in the map. First posted on arXiv 28 Apr 2022.

Builds on

17 of 32 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
  4. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
  5. 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 403
  6. 2021Learning How to Ask: Querying LMs with Mixtures of Soft Promptscited by 377
  7. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 249
  8. 2021WARP: Word-level Adversarial ReProgrammingcited by 221
  9. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  10. 2017HDLTex: Hierarchical Deep Learning for Text Classificationcited by 106
  11. 2022Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classificationcited by 52
  12. 2019Hierarchical Text Classification with Reinforced Label Assignmentcited by 41
5 more
  1. 2014Effective Use of Word Order for Text Categorization with Convolutional Neural Networkscited by 40
  2. 2019Learning to Learn and Predict: A Meta-Learning Approach for Multi-Label Classificationcited by 35
  3. 2019Hyperbolic Interaction Model For Hierarchical Multi-Label Classificationcited by 30
  4. 2021HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximizationcited by 25
  5. 2020LA-HCN: Label-based Attention for Hierarchical Multi-label TextClassification Neural Networkcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 11; 2024: 11; 2025: 4; 2026: 5.

31 papers.

Sort:

By area:

  1. 2023Making Large Language Models Better Reasoners with Alignmentcited by 63
  2. 2023DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognitioncited by 23
  3. 2023HiTIN: Hierarchy-aware Tree Isomorphism Network for Hierarchical Text Classificationcited by 17
  4. 2024Retrieval-style In-Context Learning for Few-shot Hierarchical Text Classificationcited by 16
  5. 2024Propulsion: Steering LLM with Tiny Fine-Tuningcited by 14
  6. 2025DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learningcited by 12
  7. 2023Hierarchical Verbalizer for Few-Shot Hierarchical Text Classificationcited by 11
  8. 2023A Simple and Effective Framework for Strict Zero-Shot Hierarchical Classificationcited by 7
  9. 2024Revisiting Hierarchical Text Classification: Inference and Metricscited by 7
  10. 2023Recent Advances in Hierarchical Multi-label Text Classification: A Surveycited by 6
  11. 2024HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classificationcited by 6
  12. 2023DialogVCS: Robust Natural Language Understanding in Dialogue System Upgradecited by 4
19 more
  1. 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classificationcited by 4
  2. 2023Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understandingcited by 4
  3. 2024Leveraging Label Semantics and Meta-Label Refinement for Multi-Label Question Classificationcited by 4
  4. 2024Utilizing Local Hierarchy with Adversarial Training for Hierarchical Text Classificationcited by 3
  5. 2024Hierarchical Query Classification in E-commerce Searchcited by 2
  6. 2024Domain-Hierarchy Adaptation via Chain of Iterative Reasoning for Few-shot Hierarchical Text Classificationcited by 2
  7. 2024Your Extreme Multi-label Classifier is Secretly a Hierarchical Text Classifier for Freecited by 2
  8. 2023Text2Tree: Aligning Text Representation to the Label Tree Hierarchy for Imbalanced Medical Classificationcited by 1
  9. 2023Labels Need Prompts Too: Mask Matching for Natural Language Understanding Taskscited by 1
  10. 2024Introducing Three New Benchmark Datasets for Hierarchical Text Classificationcited by 1
  11. 2024LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuningcited by 1
  12. 2025Hierarchical Text Classification Using Black Box Large Language Modelscited by 1
  13. 2026EPPC-OASIS: Ontology-Aware Adaptation and Structured Inference Refinement for Electronic Patient-Provider Communication Mining in Secure Messagescited by 1
  14. 2025Making Language Model a Hierarchical Classifiercited by 0
  15. 2025Combining Language and Topic Models for Hierarchical Text Classificationcited by 0
  16. 2026Taxon: Hierarchical Tax Code Prediction with Semantically Aligned LLM Expert Guidancecited by 0
  17. 2026Mastering the Minority: An Uncertainty-guided Multi-Expert Framework for Challenging-tailed Sequence Learningcited by 0
  18. 2026SCHK-HTC: Sibling Contrastive Learning with Hierarchical Knowledge-Aware Prompt Tuning for Hierarchical Text Classificationcited by 0
  19. 2026Gripper-aware Vision Language Action Modelscited by 0