Hierarchical information matters: Text classification via tree based graph neural network
Not on the map. Why?
Abstract (arXiv)
Text classification is a primary task in natural language processing (NLP). Recently, graph neural networks (GNNs) have developed rapidly and been applied to text classification tasks. As a special kind of graph data, the tree has a simpler data structure and can provide rich hierarchical information for text classification. Inspired by the structural entropy, we construct the coding tree of the graph by minimizing the structural entropy and propose HINT, which aims to make full use of the hierarchical information contained in the text for the task of text classification. Specifically, we first establish a dependency parsing graph for each text. Then we designed a structural entropy minimization algorithm to decode the key information in the graph and convert each graph to its corresponding coding tree. Based on the hierarchical structure of the coding tree, the representation of the entire graph is obtained by updating the representation of non-leaf nodes in the coding tree layer by layer. Finally, we present the effectiveness of hierarchical information in text classification. Experimental results show that HINT outperforms the state-of-the-art methods on popular benchmarks while having a simple structure and few parameters.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 5 Oct 2021.
Builds on
14 of 25 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2016Bag of Tricks for Efficient Text Classificationcited by 869
- 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 212
- 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
- 2018AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classificationcited by 101
- 2020Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networkscited by 77
- 2021BertGCN: Transductive Text Classification by Combining GCN and BERTcited by 74
- 2019Text Level Graph Neural Network for Text Classificationcited by 60
- 2018Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanismscited by 53
- 2020Tensor Graph Convolutional Networks for Text Classificationcited by 49
- 2019Universal Dependency Parsing from Scratchcited by 46
Built on by
Citing papers per year: 2023: 2.
2 papers.