Hierarchical Text Classification with LLM-Refined Taxonomies
Not on the map. Why?
Abstract (arXiv)
Hierarchical text classification (HTC) depends on taxonomies that organize labels into structured hierarchies. However, many real-world taxonomies introduce ambiguities, such as identical leaf names under similar parent nodes, which prevent language models (LMs) from learning clear decision boundaries. In this paper, we present TaxMorph, a framework that uses large language models (LLMs) to transform entire taxonomies through operations such as renaming, merging, splitting, and reordering. Unlike prior work, our method revises the full hierarchy to better match the semantics encoded by LMs. Experiments across three HTC benchmarks show that LLM-refined taxonomies consistently outperform human-curated ones in various settings up to +2.9pp. in F1. To better understand these improvements, we compare how well LMs can assign leaf nodes to parent nodes and vice versa across human-curated and LLM-refined taxonomies. We find that human-curated taxonomies lead to more easily separable clusters in embedding space. However, the LLM-refined taxonomies align more closely with the model's actual confusion patterns during classification. In other words, even though they are harder to separate, they better reflect the model's inductive biases. These findings suggest that LLM-guided refinement creates taxonomies that are more compatible with how models learn, improving HTC performance.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 43 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
21 of 43 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2017HDLTex: Hierarchical Deep Learning for Text Classificationcited by 106
- 2019CrossWeigh: Training Named Entity Tagger from Imperfect Annotationscited by 60
- 2022Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classificationcited by 52
- 2024Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledgecited by 29
- 2023Language Model Analysis for Ontology Subsumption Inferencecited by 25
- 2019Every child should have parents: a taxonomy refinement algorithm based on hyperbolic term embeddingscited by 23
- 2020Constructing Taxonomies from Pretrained Language Modelscited by 21
9 more
- 2023Do PLMs Know and Understand Ontological Knowledge?cited by 13
- 2024HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classificationcited by 13
- 2023CleanCoNLL: A Nearly Noise-Free Named Entity Recognition Datasetcited by 11
- 2024BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language Modelscited by 11
- 2023A Simple and Effective Framework for Strict Zero-Shot Hierarchical Classificationcited by 7
- 2024HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classificationcited by 6
- 2021Information Extraction From Co-Occurring Similar Entitiescited by 5
- 2023Training Transitive and Commutative Multimodal Transformers with LoReTTacited by 4
- 2023FRACAS: A FRench Annotated Corpus of Attribution relations in newScited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.