Can LLMs Convert Graphs to Text-Attributed Graphs?
Not on the map. Why?
Abstract (arXiv)
Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool. However, existing GNN architectures encounter challenges in cross-graph learning where multiple graphs have different feature spaces. To address this, recent approaches introduce text-attributed graphs (TAGs), where each node is associated with a textual description, which can be projected into a unified feature space using textual encoders. While promising, this method relies heavily on the availability of text-attributed graph data, which is difficult to obtain in practice. To bridge this gap, we propose a novel method named Topology-Aware Node description Synthesis (TANS), leveraging large language models (LLMs) to convert existing graphs into text-attributed graphs. The key idea is to integrate topological information into LLMs to explain how graph topology influences node semantics. We evaluate our TANS on text-rich, text-limited, and text-free graphs, demonstrating its applicability. Notably, on text-free graphs, our method significantly outperforms existing approaches that manually design node features, showcasing the potential of LLMs for preprocessing graph-structured data in the absence of textual information. The code and data are available at https://github.com/Zehong-Wang/TANS.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 13 Dec 2024.
Builds on
25 of 43 references.
References · 25
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2019Heterogeneous Graph Attention Networkcited by 734
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 274
13 more
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 244
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2017struc2vec: Learning Node Representations from Structural Identitycited by 215
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 210
- 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
- 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 154
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2019Graph Transfer Learning via Adversarial Domain Adaptation with Graph Convolutioncited by 67
- 2024Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Modelscited by 42
- 2022MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initializationcited by 31
- 2024Subgraph Pooling: Tackling Negative Transfer on Graphscited by 17
- 2024Diet-ODIN: A Novel Framework for Opioid Misuse Detection with Interpretable Dietary Patternscited by 14
- 2024Training MLPs on Graphs without Supervisioncited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 10.
19 papers.
Sort:
By area:
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 32
- 2025Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Modelscited by 26
- 2025AutoData: A Multi-Agent System for Open Web Data Collectioncited by 25
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2026Graph is a Substrate Across Data Modalitiescited by 14
- 2025LLM-Empowered Class Imbalanced Graph Prompt Learning for Online Drug Trafficking Detectioncited by 11
- 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answeringcited by 10
- 2025Semantic Refinement with LLMs for Graph Representationscited by 6
- 2025Dynamic Bundling with Large Language Models for Zero-Shot Inference on Text-Attributed Graphscited by 3
- 2026Temporal Graph Pattern Machinecited by 3
- 2026BHyGNN+: Unsupervised Representation Learning for Heterophilic Hypergraphscited by 2
7 more
- 2026OPBench: A Graph Benchmark to Combat the Opioid Crisiscited by 1
- 2026Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Modelscited by 1
- 2026Let Relations Speak: An End-to-End LLM-GNN Soft Prompt Framework for Fraud Detectioncited by 1
- 2026DuConTE: Dual-Granularity Text Encoder with Topology-Constrained Attention for Text-attributed Graphscited by 0
- 2026Where LLM Annotators Fail: Label-Free Learning on Graphs with LLMscited by 0
- 2026TAG-DLM: Diffusion Language Models for Text-Attributed Graph Learningcited by 0
- 2026Semi-Supervised Text-Attributed Graph Distillationcited by 0
- 2026TAG-DLM: Diffusion Language Models for Text-Attributed Graph Learning30 Jun 2026
- 2026Semi-Supervised Text-Attributed Graph Distillation27 May 2026
- 2026Let Relations Speak: An End-to-End LLM-GNN Soft Prompt Framework for Fraud Detection27 May 2026
- 2026Where LLM Annotators Fail: Label-Free Learning on Graphs with LLMs27 May 2026
- 2026DuConTE: Dual-Granularity Text Encoder with Topology-Constrained Attention for Text-attributed Graphs19 Apr 2026
- 2026Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Models3 Mar 2026
- 2026BHyGNN+: Unsupervised Representation Learning for Heterophilic Hypergraphs16 Feb 2026
- 2026OPBench: A Graph Benchmark to Combat the Opioid Crisis16 Feb 2026
- 2026Temporal Graph Pattern Machine30 Jan 2026
- 2026Graph is a Substrate Across Data Modalities29 Jan 2026
- 2025Semantic Refinement with LLMs for Graph Representations24 Dec 2025
- 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering10 Oct 2025
7 more
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering6 Oct 2025
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora29 May 2025
- 2025Dynamic Bundling with Large Language Models for Zero-Shot Inference on Text-Attributed Graphs23 May 2025
- 2025AutoData: A Multi-Agent System for Open Web Data Collection21 May 2025
- 2025LLM-Empowered Class Imbalanced Graph Prompt Learning for Online Drug Trafficking Detection28 Feb 2025
- 2025Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models21 Feb 2025
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Trees21 Dec 2024
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2026Graph is a Substrate Across Data Modalitiescited by 14
- 2025LLM-Empowered Class Imbalanced Graph Prompt Learning for Online Drug Trafficking Detectioncited by 11
- 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answeringcited by 10
- 2025Semantic Refinement with LLMs for Graph Representationscited by 6
- 2025Dynamic Bundling with Large Language Models for Zero-Shot Inference on Text-Attributed Graphscited by 3
- 2026Temporal Graph Pattern Machinecited by 3
- 2026BHyGNN+: Unsupervised Representation Learning for Heterophilic Hypergraphscited by 2
- 2026OPBench: A Graph Benchmark to Combat the Opioid Crisiscited by 1
- 2026Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Modelscited by 1
- 2026Let Relations Speak: An End-to-End LLM-GNN Soft Prompt Framework for Fraud Detectioncited by 1
12 most cited of 15 All 15 (JSON)
- 2026Semi-Supervised Text-Attributed Graph Distillation27 May 2026
- 2026Let Relations Speak: An End-to-End LLM-GNN Soft Prompt Framework for Fraud Detection27 May 2026
- 2026Where LLM Annotators Fail: Label-Free Learning on Graphs with LLMs27 May 2026
- 2026DuConTE: Dual-Granularity Text Encoder with Topology-Constrained Attention for Text-attributed Graphs19 Apr 2026
- 2026Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Models3 Mar 2026
- 2026BHyGNN+: Unsupervised Representation Learning for Heterophilic Hypergraphs16 Feb 2026
- 2026OPBench: A Graph Benchmark to Combat the Opioid Crisis16 Feb 2026
- 2026Temporal Graph Pattern Machine30 Jan 2026
- 2026Graph is a Substrate Across Data Modalities29 Jan 2026
- 2025Semantic Refinement with LLMs for Graph Representations24 Dec 2025
- 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering10 Oct 2025
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora29 May 2025
12 newest of 15 All 15 (JSON)