mlsanityData to 14 Oct 2026

Efficient Text-Attributed Graph Learning through Selective Annotation and Graph Alignment

arXiv 2506.07168 ↗First posted 8 Jun 2025cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In the realm of Text-attributed Graphs (TAGs), traditional graph neural networks (GNNs) often fall short due to the complex textual information associated with each node. Recent methods have improved node representations by leveraging large language models (LLMs) to enhance node text features, but these approaches typically require extensive annotations or fine-tuning across all nodes, which is both time-consuming and costly. To overcome these challenges, we introduce GAGA, an efficient framework for TAG representation learning. GAGA reduces annotation time and cost by focusing on annotating only representative nodes and edges. It constructs an annotation graph that captures the topological relationships among these annotations. Furthermore, GAGA employs a two-level alignment module to effectively integrate the annotation graph with the TAG, aligning their underlying structures. Experiments show that GAGA achieves classification accuracies on par with or surpassing state-of-the-art methods while requiring only 1% of the data to be annotated, demonstrating its high efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 65 of its 92 references that are in the map. First posted on arXiv 8 Jun 2025.

Builds on

65 of 92 references.

References · 65

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2017Neural Discrete Representation Learningcited by 4,712
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  8. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  9. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  10. 2016Variational Graph Auto-Encoderscited by 1,382
  11. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
  12. 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
38 more
  1. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
  2. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 274
  3. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  4. 2023Language is All a Graph Needscited by 220
  5. 2021Training Graph Neural Networks with 1000 Layerscited by 169
  6. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  7. 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
  8. 2020Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learningcited by 149
  9. 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
  10. 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
  11. 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 133
  12. 2020Learning to Faithfully Rationalize by Constructioncited by 113
  13. 2016Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?cited by 111
  14. 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 107
  15. 2019GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verificationcited by 100
  16. 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
  17. 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
  18. 2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
  19. 2023SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learningcited by 73
  20. 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
  21. 2023Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarkingcited by 69
  22. 2021Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text Classificationcited by 67
  23. 2023Neural Common Neighbor with Completion for Link Predictioncited by 64
  24. 2017Active Learning for Graph Embeddingcited by 54
  25. 2018Deriving Machine Attention from Human Rationalescited by 54
  26. 2021TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Searchcited by 54
  27. 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
  28. 2024Efficient Tuning and Inference for Large Language Models on Textual Graphscited by 54
  29. 2017Exploring Human-like Attention Supervision in Visual Question Answeringcited by 36
  30. 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learningcited by 36
  31. 2023Disentangled Representation Learning with Large Language Models for Text-Attributed Graphscited by 36
  32. 2019Embedding Human Knowledge into Deep Neural Network via Attention Mapcited by 33
  33. 2019Do Human Rationales Improve Machine Explanations?cited by 33
  34. 2023Inductive Graph Unlearningcited by 31
  35. 2021Supervising Model Attention with Human Explanations for Robust Natural Language Inferencecited by 29
  36. 2023Revisiting Link Prediction: A Data Perspectivecited by 29
  37. 2018Interpretable Visual Question Answering by Visual Grounding from Attention Supervision Miningcited by 28
  38. 2023Large Language Models as Topological Structure Enhancers for Text-Attributed Graphscited by 27

50 most cited of 65 All 65 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ERAlign: Energy-based Representation Alignment of GNNs and LLMs on Text-attributed Graphs
  2. 2024Bridging Local Details and Global Context in Text-Attributed Graphs
  3. 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs
  4. 2026TAG-DLM: Diffusion Language Models for Text-Attributed Graph Learning
  5. 2024Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Process
  6. 2026TemporalGraphLLM: Temporal Graph Neural Networks with Large Language Models for Dynamic Text-Attributed Graphs
  7. 2024Similarity-based Neighbor Selection for Graph LLMs
  8. 2025Quantizing Text-attributed Graphs for Semantic-Structural Integration