Position: Graph Condensation Needs a Reset -- Move Beyond Full-dataset Training and Model-Dependence
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) are powerful tools for learning from graph-structured data, but their scalability is increasingly strained by the size of real-world graphs in domains like recommender systems, fraud detection, and molecular biology. Graph condensation -- the task of generating a smaller synthetic graph that retains the performance of models trained on the original -- has emerged as a promising solution. However, the dominant approach of gradient matching introduces a fundamental contradiction: it requires training on the full dataset to create the compressed version, thereby undermining the goal of efficiency. Worse still, these methods suffer from high computational overhead, poor generalization across GNN architectures, and brittle reliance on specific model configurations. Equally concerning is the community's reliance on misleading evaluation protocols such as node compression ratios, which fail to reflect true resource savings, condensation overhead, and illusory application to neural architecture search. These shortcomings are not incidental -- they are systemic, and they obstruct meaningful progress. In this position paper, we argue that graph condensation, in its current form, needs a reset. We call for moving beyond full-dataset training and model-dependent design, and instead advocate for methods that are lightweight, architecture-agnostic, and practically deployable. By identifying key methodological flaws and outlining concrete research directions, we aim to reorient the field toward approaches that deliver on the true promise of condensation: efficient, generalizable, and usable GNN training at scale.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 62 of its 88 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
62 of 88 references.
References · 62
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
- 2020Benchmarking Graph Neural Networkscited by 680
- 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
- 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 584
- 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 541
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
38 more
- 2022Dataset Distillation by Matching Training Trajectoriescited by 442
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 329
- 2019Gradient Descent with Early Stopping is Provably Robust to Label Noise for Overparameterized Neural Networkscited by 159
- 2021Graph Condensation for Graph Neural Networkscited by 150
- 2022Condensing Graphs via One-Step Gradient Matchingcited by 100
- 2023Efficient Dataset Distillation via Minimax Diffusioncited by 83
- 2024D4M: Dataset Distillation via Disentangled Diffusion Modelcited by 77
- 2023Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Datacited by 71
- 2020GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph Generationcited by 66
- 2022Graph Condensation via Receptive Field Distribution Matchingcited by 60
- 2024A Comprehensive Survey on Graph Reduction: Sparsification, Coarsening, and Condensationcited by 57
- 2020A Large-Scale Database for Graph Representation Learningcited by 55
- 2023CaT: Balanced Continual Graph Learning with Graph Condensationcited by 52
- 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Modelscited by 52
- 2023Does Graph Distillation See Like Vision Dataset Counterpart?cited by 45
- 2022Tree Mover's Distance: Bridging Graph Metrics and Stability of Graph Neural Networkscited by 41
- 2023Fast Graph Condensation with Structure-based Neural Tangent Kernelcited by 36
- 2023Graph Condensation for Inductive Node Representation Learningcited by 31
- 2024Navigating Complexity: Toward Lossless Graph Condensation via Expanding Window Matchingcited by 28
- 2024Graph Condensation: A Surveycited by 23
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensationcited by 20
- 2024Graph Data Condensation via Self-expressive Graph Structure Reconstructioncited by 18
- 2018Graph Partition Neural Networks for Semi-Supervised Classificationcited by 17
- 2023Graph Distillation with Eigenbasis Matchingcited by 16
- 2020GraphReach: Position-Aware Graph Neural Network using Reachability Estimationscited by 14
- 2022You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Ticketscited by 14
- 2023FRIGATE: Frugal Spatio-temporal Forecasting on Road Networkscited by 14
- 2024Sketch-GNN: Scalable Graph Neural Networks with Sublinear Training Complexitycited by 14
- 2023Mirage: Model-Agnostic Graph Distillation for Graph Classificationcited by 13
- 2024GC-Bench: An Open and Unified Benchmark for Graph Condensationcited by 12
- 2024Disentangled Condensation for Large-scale Graphscited by 10
- 2023Attend Who is Weak: Enhancing Graph Condensation via Cross-Free Adversarial Trainingcited by 9
- 2023PUMA: Efficient Continual Graph Learning for Node Classification with Graph Condensationcited by 9
- 2024A Survey on Graph Condensationcited by 9
- 2024Graph Condensation for Open-World Graph Learningcited by 9
- 2024Two Trades is not Baffled: Condensing Graph via Crafting Rational Gradient Matchingcited by 8
- 2024Federated Graph Condensation with Information Bottleneck Principlescited by 8
- 2023GRAFENNE: Learning on Graphs with Heterogeneous and Dynamic Feature Setscited by 7
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.