mlsanityData to 14 Oct 2026

BertGCN: Transductive Text Classification by Combining GCN and BERT

arXiv 2105.05727 ↗First posted 12 May 2021cs.CLcited by 74

Not on the map. Why?

Abstract (arXiv)

In this work, we propose BertGCN, a model that combines large scale pretraining and transductive learning for text classification. BertGCN constructs a heterogeneous graph over the dataset and represents documents as nodes using BERT representations. By jointly training the BERT and GCN modules within BertGCN, the proposed model is able to leverage the advantages of both worlds: large-scale pretraining which takes the advantage of the massive amount of raw data and transductive learning which jointly learns representations for both training data and unlabeled test data by propagating label influence through graph convolution. Experiments show that BertGCN achieves SOTA performances on a wide range of text classification datasets. Code is available at https://github.com/ZeroRin/BertGCN.

Key facts. Cited by 74 papers in the map (data through 14 Oct 2026). Builds on 34 of its 50 references that are in the map. First posted on arXiv 12 May 2021.

Builds on

34 of 50 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2017Graph Attention Networkscited by 8,923
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2017Inductive Representation Learning on Large Graphscited by 6,320
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  9. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  10. 2019Simplifying Graph Convolutional Networkscited by 1,477
  11. 2016Variational Graph Auto-Encoderscited by 1,382
  12. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
22 more
  1. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  2. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
  3. 2018MolGAN: An implicit generative model for small molecular graphscited by 393
  4. 2018Graph Convolutional Networks for Text Classificationcited by 345
  5. 2018Learning Deep Generative Models of Graphscited by 229
  6. 2018GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphscited by 165
  7. 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
  8. 2017Encoding Sentences with Graph Convolutional Networks for Semantic Role Labelingcited by 137
  9. 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
  10. 2017Geometric Matrix Completion with Recurrent Multi-Graph Neural Networkscited by 88
  11. 2017Graph Convolutional Encoders for Syntax-aware Neural Machine Translationcited by 70
  12. 2018Joint Embedding of Words and Labels for Text Classificationcited by 69
  13. 2019Text Level Graph Neural Network for Text Classificationcited by 60
  14. 2018Question Answering by Reasoning Across Documents with Graph Convolutional Networkscited by 56
  15. 2015A C-LSTM Neural Network for Text Classificationcited by 54
  16. 2020Tensor Graph Convolutional Networks for Text Classificationcited by 49
  17. 2020VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classificationcited by 35
  18. 2018Deep Graph Convolutional Encoders for Structured Data to Text Generationcited by 27
  19. 2020Description Based Text Classification with Reinforcement Learningcited by 27
  20. 2018GILE: A Generalized Input-Label Embedding for Text Classificationcited by 22
  21. 2020Uncertainty-aware Self-training for Text Classification with Few Labelscited by 20
  22. 2020Comprehensive Information Integration Modeling Framework for Video Titlingcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 8; 2022: 13; 2023: 23; 2024: 16; 2025: 9; 2026: 5.

74 papers.

Sort:

By area:

  1. 2023Text Classification via Large Language Modelscited by 106
  2. 2022How would Stance Detection Techniques Evolve after the Launch of ChatGPT?cited by 76
  3. 2021OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across Languagescited by 31
  4. 2024Pushing The Limit of LLM Capacity for Text Classificationcited by 28
  5. 2021GNN-LM: Language Modeling based on Global Contexts via GNNcited by 27
  6. 2023ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphscited by 27
  7. 2024Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrievalcited by 26
  8. 2023Investigating Chain-of-thought with ChatGPT for Stance Detection on Social Mediacited by 23
  9. 2022Infusing Knowledge from Wikipedia to Enhance Stance Detectioncited by 20
  10. 2021Layer-wise Model Pruning based on Mutual Informationcited by 19
  11. 2021Interpreting Deep Learning Models in Natural Language Processing: A Reviewcited by 19
  12. 2023Neural Additive Models for Location Scale and Shape: A Framework for Interpretable Neural Regression Beyond the Meancited by 18
38 more
  1. 2022A Corpus for Understanding and Generating Moral Storiescited by 16
  2. 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classificationcited by 15
  3. 2023Graph Neural Networks for Text Classification: A Surveycited by 15
  4. 2022Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasetscited by 12
  5. 2023Sentiment Analysis through LLM Negotiationscited by 11
  6. 2021kFolden: k-Fold Ensemble for Out-Of-Distribution Detectioncited by 10
  7. 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networkscited by 9
  8. 2024Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Modelscited by 9
  9. 2021Faster Nearest Neighbor Machine Translationcited by 8
  10. 2024Ethereum Fraud Detection via Joint Transaction Language Model and Graph Representation Learningcited by 8
  11. 2024Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classificationcited by 8
  12. 2022Team Yao at Factify 2022: Utilizing Pre-trained Models and Co-attention Networks for Multi-Modal Fact Verificationcited by 6
  13. 2022kNN-NER: Named Entity Recognition with Nearest Neighbor Searchcited by 6
  14. 2023Localize, Retrieve and Fuse: A Generalized Framework for Free-Form Question Answering over Tablescited by 6
  15. 2024Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classificationcited by 5
  16. 2022Graph Learning and Its Advancements on Large Language Models: A Holistic Surveycited by 4
  17. 2023Continual Graph Convolutional Network for Text Classificationcited by 4
  18. 2023Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detectioncited by 4
  19. 2023TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddingscited by 4
  20. 2024Collaborative Knowledge Infusion for Low-resource Stance Detectioncited by 4
  21. 2024Putting Context in Context: the Impact of Discussion Structure on Text Classificationcited by 3
  22. 2024Predictive Insights into LGBTQ+ Minority Stress: A Transductive Exploration of Social Media Discoursecited by 3
  23. 2024Graph-Guided Textual Explanation Generation Frameworkcited by 3
  24. 2025Integrating Structural and Semantic Signals in Text-Attributed Graphs with BiGTexcited by 3
  25. 2021Hierarchical information matters: Text classification via tree based graph neural networkcited by 2
  26. 2024Watermark Text Pattern Spotting in Document Imagescited by 2
  27. 2024Low-Resource Fast Text Classification Based on Intra-Class and Inter-Class Distance Calculationcited by 2
  28. 2024A Method for Enhancing Generalization of Adam by Multiple Integrationscited by 2
  29. 2025Advancing Minority Stress Detection with Transformers: Insights from the Social Media Datasetscited by 2
  30. 2025Jensen-Shannon Divergence Message-Passing for Rich-Text Graph Representation Learningcited by 2
  31. 2021TextRGNN: Residual Graph Neural Networks for Text Classificationcited by 1
  32. 2022Are We Really Making Much Progress in Text Classification? A Comparative Reviewcited by 1
  33. 2022CNN-Trans-Enc: A CNN-Enhanced Transformer-Encoder On Top Of Static BERT representations for Document Classificationcited by 1
  34. 2022A semantic hierarchical graph neural network for text classificationcited by 1
  35. 2023Attention is Not Always What You Need: Towards Efficient Classification of Domain-Specific Textcited by 1
  36. 2023Enriching language models with graph-based context information to better understand textual datacited by 1
  37. 2023LTCR: Long-Text Chinese Rumor Detection Datasetcited by 1
  38. 2023ViCGCN: Graph Convolutional Network with Contextualized Language Models for Social Media Mining in Vietnamesecited by 1

50 most cited of 74 All 74 (JSON)