Who Should Teach? Confidence-Aware Dual-Teacher Learning for Few-Shot Node Classification on Text-Attributed Graphs
Not on the map. Why?
Abstract (arXiv)
Text-Attributed Graphs (TAGs) integrate graph structures and node-associated textual attributes, and recent studies have increasingly leveraged Large Language Models (LLMs) to improve TAG learning in few-shot settings. However, existing approaches typically utilize LLM-derived information uniformly across all nodes, despite substantial variations in its reliability, while also incurring considerable monetary costs. We argue that the most appropriate source of supervision may differ across nodes, as Graph Neural Networks (GNNs) and LLMs exhibit complementary strengths in exploiting structural and semantic information, respectively. To this end, we propose CoTeach, a Confidence-aware dual-teacher learning framework that dynamically selects the more reliable teacher for each node. Experimental results demonstrate that CoTeach consistently improves few-shot node classification performance while reducing unnecessary LLM utilization and associated monetary costs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
15 of 23 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2018Deep Graph Infomaxcited by 1,106
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
- 2024A Survey of Large Language Models for Graphscited by 72
- 2024DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphscited by 27
3 more
- 2023Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed Graphscited by 23
- 2024Leveraging Large Language Models for Effective Label-free Node Classification in Text-Attributed Graphscited by 6
- 2024Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Processcited by 3
Built on by
Not cited yet.