mlsanityData to 14 Oct 2026

Can LLMs Convert Graphs to Text-Attributed Graphs?

arXiv 2412.10136 ↗First posted 13 Dec 2024cs.CL cs.AI cs.LGcited by 19

Not on the map. Why?

Abstract (arXiv)

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool. However, existing GNN architectures encounter challenges in cross-graph learning where multiple graphs have different feature spaces. To address this, recent approaches introduce text-attributed graphs (TAGs), where each node is associated with a textual description, which can be projected into a unified feature space using textual encoders. While promising, this method relies heavily on the availability of text-attributed graph data, which is difficult to obtain in practice. To bridge this gap, we propose a novel method named Topology-Aware Node description Synthesis (TANS), leveraging large language models (LLMs) to convert existing graphs into text-attributed graphs. The key idea is to integrate topological information into LLMs to explain how graph topology influences node semantics. We evaluate our TANS on text-rich, text-limited, and text-free graphs, demonstrating its applicability. Notably, on text-free graphs, our method significantly outperforms existing approaches that manually design node features, showcasing the potential of LLMs for preprocessing graph-structured data in the absence of textual information. The code and data are available at https://github.com/Zehong-Wang/TANS.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 13 Dec 2024.

Builds on

25 of 43 references.

References · 25

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  7. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  9. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  10. 2019Heterogeneous Graph Attention Networkcited by 734
  11. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
  12. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 274
13 more
  1. 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 244
  2. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  3. 2017struc2vec: Learning Node Representations from Structural Identitycited by 215
  4. 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 210
  5. 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
  6. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 154
  7. 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
  8. 2019Graph Transfer Learning via Adversarial Domain Adaptation with Graph Convolutioncited by 67
  9. 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 42
  10. 2022MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initializationcited by 31
  11. 2024Subgraph Pooling: Tackling Negative Transfer on Graphscited by 17
  12. 2024Diet-ODIN: A Novel Framework for Opioid Misuse Detection with Interpretable Dietary Patternscited by 14
  13. 2024Training MLPs on Graphs without Supervisioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 10.

19 papers.

Sort:

By area:

  1. 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
  2. 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 32
  3. 2025Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Modelscited by 26
  4. 2025AutoData: A Multi-Agent System for Open Web Data Collectioncited by 25
  5. 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
  6. 2026Graph is a Substrate Across Data Modalitiescited by 14
  7. 2025LLM-Empowered Class Imbalanced Graph Prompt Learning for Online Drug Trafficking Detectioncited by 11
  8. 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answeringcited by 10
  9. 2025Semantic Refinement with LLMs for Graph Representationscited by 6
  10. 2025Dynamic Bundling with Large Language Models for Zero-Shot Inference on Text-Attributed Graphscited by 3
  11. 2026Temporal Graph Pattern Machinecited by 3
  12. 2026BHyGNN+: Unsupervised Representation Learning for Heterophilic Hypergraphscited by 2
7 more
  1. 2026OPBench: A Graph Benchmark to Combat the Opioid Crisiscited by 1
  2. 2026Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Modelscited by 1
  3. 2026Let Relations Speak: An End-to-End LLM-GNN Soft Prompt Framework for Fraud Detectioncited by 1
  4. 2026DuConTE: Dual-Granularity Text Encoder with Topology-Constrained Attention for Text-attributed Graphscited by 0
  5. 2026Where LLM Annotators Fail: Label-Free Learning on Graphs with LLMscited by 0
  6. 2026TAG-DLM: Diffusion Language Models for Text-Attributed Graph Learningcited by 0
  7. 2026Semi-Supervised Text-Attributed Graph Distillationcited by 0