Efficient Text-Attributed Graph Learning through Selective Annotation and Graph Alignment
Not on the map. Why?
Abstract (arXiv)
In the realm of Text-attributed Graphs (TAGs), traditional graph neural networks (GNNs) often fall short due to the complex textual information associated with each node. Recent methods have improved node representations by leveraging large language models (LLMs) to enhance node text features, but these approaches typically require extensive annotations or fine-tuning across all nodes, which is both time-consuming and costly. To overcome these challenges, we introduce GAGA, an efficient framework for TAG representation learning. GAGA reduces annotation time and cost by focusing on annotating only representative nodes and edges. It constructs an annotation graph that captures the topological relationships among these annotations. Furthermore, GAGA employs a two-level alignment module to effectively integrate the annotation graph with the TAG, aligning their underlying structures. Experiments show that GAGA achieves classification accuracies on par with or surpassing state-of-the-art methods while requiring only 1% of the data to be annotated, demonstrating its high efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 65 of its 92 references that are in the map. First posted on arXiv 8 Jun 2025.
Builds on
65 of 92 references.
References · 65
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017Neural Discrete Representation Learningcited by 4,712
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
38 more
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 274
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2023Language is All a Graph Needscited by 220
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
- 2020Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learningcited by 149
- 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
- 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 133
- 2020Learning to Faithfully Rationalize by Constructioncited by 113
- 2016Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?cited by 111
- 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 107
- 2019GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verificationcited by 100
- 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
- 2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
- 2023SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learningcited by 73
- 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
- 2023Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarkingcited by 69
- 2021Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text Classificationcited by 67
- 2023Neural Common Neighbor with Completion for Link Predictioncited by 64
- 2017Active Learning for Graph Embeddingcited by 54
- 2018Deriving Machine Attention from Human Rationalescited by 54
- 2021TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Searchcited by 54
- 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
- 2024Efficient Tuning and Inference for Large Language Models on Textual Graphscited by 54
- 2017Exploring Human-like Attention Supervision in Visual Question Answeringcited by 36
- 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learningcited by 36
- 2023Disentangled Representation Learning with Large Language Models for Text-Attributed Graphscited by 36
- 2019Embedding Human Knowledge into Deep Neural Network via Attention Mapcited by 33
- 2019Do Human Rationales Improve Machine Explanations?cited by 33
- 2023Inductive Graph Unlearningcited by 31
- 2021Supervising Model Attention with Human Explanations for Robust Natural Language Inferencecited by 29
- 2023Revisiting Link Prediction: A Data Perspectivecited by 29
- 2018Interpretable Visual Question Answering by Visual Grounding from Attention Supervision Miningcited by 28
- 2023Large Language Models as Topological Structure Enhancers for Text-Attributed Graphscited by 27
50 most cited of 65 All 65 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ERAlign: Energy-based Representation Alignment of GNNs and LLMs on Text-attributed Graphs
- 2024Bridging Local Details and Global Context in Text-Attributed Graphs
- 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs
- 2026TAG-DLM: Diffusion Language Models for Text-Attributed Graph Learning
- 2024Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Process
- 2026TemporalGraphLLM: Temporal Graph Neural Networks with Large Language Models for Dynamic Text-Attributed Graphs
- 2024Similarity-based Neighbor Selection for Graph LLMs
- 2025Quantizing Text-attributed Graphs for Semantic-Structural Integration