mlsanityData to 14 Oct 2026

GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environments

arXiv 2504.00711 ↗First posted 1 Apr 2025cs.LGcited by 19

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

The era of foundation models has revolutionized AI research, yet Graph Foundation Models (GFMs) remain constrained by the scarcity of large-scale graph corpora. Traditional graph data synthesis techniques primarily focus on simplistic structural operations, lacking the capacity to generate semantically rich nodes with meaningful textual attributes: a critical limitation for real-world applications. While large language models (LLMs) demonstrate exceptional text generation capabilities, their direct application to graph synthesis is impeded by context window limitations, hallucination phenomena, and structural consistency challenges. To address these issues, we introduce GraphMaster, the first multi-agent framework specifically designed for graph data synthesis in data-limited environments. GraphMaster orchestrates four specialized LLM agents (Manager, Perception, Enhancement, and Evaluation) that collaboratively optimize the synthesis process through iterative refinement, ensuring both semantic coherence and structural integrity. To rigorously evaluate our approach, we create new data-limited "Sub" variants of six standard graph benchmarks, specifically designed to test synthesis capabilities under realistic constraints. Additionally, we develop a novel interpretability assessment framework that combines human evaluation with a principled Grassmannian manifold-based analysis, providing both qualitative and quantitative measures of semantic coherence. Experimental results demonstrate that GraphMaster significantly outperforms traditional synthesis methods across multiple datasets, establishing a strong foundation for advancing GFMs in data-scarce environments.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 68 references that are in the map. First posted on arXiv 1 Apr 2025.

Builds on

39 of 68 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering23 Apr

Other references · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2017Graph Attention Networkscited by 8,923
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2017Inductive Representation Learning on Large Graphscited by 6,320
  8. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  11. 2020Benchmarking Graph Neural Networkscited by 680
  12. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
26 more
  1. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
  2. 2020Data Augmentation for Graph Neural Networkscited by 203
  3. 2023Sources of Hallucination by Large Language Models on Inference Taskscited by 169
  4. 2021GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networkscited by 147
  5. 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 146
  6. 2024Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Mapscited by 142
  7. 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
  8. 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 133
  9. 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
  10. 2021Knowledge Graph Reasoning with Relational Digraphcited by 92
  11. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
  12. 2024Position: Graph Foundation Models are Already Herecited by 86
  13. 2024GraphEdit: Large Language Models for Graph Structure Learningcited by 33
  14. 2022AdaProp: Learning Adaptive Propagation for Graph Neural Network based Knowledge Graph Reasoningcited by 28
  15. 2023Emerging Drug Interaction Prediction Enabled by Flow-based Graph Neural Network with Biomedical Networkcited by 24
  16. 2023Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed Graphscited by 23
  17. 2024Can Large Language Models Improve the Adversarial Robustness of Graph Neural Networks?cited by 23
  18. 2020Data Augmentation for Graph Classificationcited by 22
  19. 2024Very Large-Scale Multi-Agent Simulation in AgentScopecited by 18
  20. 2024LLM-Based Multi-Agent Systems are Scalable Graph Generative Modelscited by 11
  21. 2024Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Taskscited by 10
  22. 2022KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learningcited by 7
  23. 2024AGMixup: Adaptive Graph Mixup for Semi-supervised Node Classificationcited by 5
  24. 2025Democratizing Large Language Model-Based Graph Data Augmentation via Latent Knowledge Graphscited by 5
  25. 2024IntraMix: Intra-Class Mixup Generation for Accurate Labels and Neighborscited by 4
  26. 2025ScaDyG:A New Paradigm for Large-scale Dynamic Graph Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 11; 2026: 8.

19 papers.

Sort:

By area:

  1. 2025Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systemscited by 43
  2. 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
  3. 2026RealMem: Benchmarking LLMs in Real-World Memory-Driven Interactioncited by 20
  4. 2025Model Unlearning via Sparse Autoencoder Subspace Guided Projectionscited by 18
  5. 2025Octopus: Agentic Multimodal Reasoning with Six-Capability Orchestrationcited by 9
  6. 2025GraphOracle: Efficient Fully-Inductive Knowledge Graph Reasoning via Relation-Dependency Graphscited by 7
  7. 2025Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimizationcited by 6
  8. 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applicationscited by 6
  9. 2025VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learningcited by 6
  10. 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Datacited by 6
  11. 2025Mixture of Length and Pruning Experts for Knowledge Graphs Reasoningcited by 5
  12. 2026LEDGERMIND: Provenance-Constrained Multimodal Agentic Reasoning with a Structured Evidence Ledgercited by 5
7 more
  1. 2025MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarioscited by 3
  2. 2026SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactionscited by 2
  3. 2025ScEdit: Script-based Assessment of Knowledge Editingcited by 1
  4. 2026Multi-Agent Agentic Graph Learning via Structural Signaturescited by 1
  5. 2026Can LLM Agents Simulate Dynamic Networks? A Case Study on Email Networks with Phishing Synthesiscited by 0
  6. 2026LLM4Trust: Exploring the Capabilities of Large Language Models for Trust Evaluationcited by 0
  7. 2026No-Free-Graph: Learning When Multimodal Data Should Be Graphifiedcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Scalable and Accurate Graph Reasoning with LLM-based Multi-Agents
  2. 2026Are Large Language Models Suitable for Graph Computation? Progress and Prospects
  3. 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs
  4. 2024Exploring the Potential of Large Language Models in Graph Generation
  5. 2025AMAS: Adaptively Determining Communication Topology for LLM-based Multi-Agent System
  6. 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrieval
  7. 2024GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration
  8. 2026GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning