mlsanityData to 14 Oct 2026

Position: Graph Condensation Needs a Reset -- Move Beyond Full-dataset Training and Model-Dependence

arXiv 2605.18893 ↗First posted 17 May 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) are powerful tools for learning from graph-structured data, but their scalability is increasingly strained by the size of real-world graphs in domains like recommender systems, fraud detection, and molecular biology. Graph condensation -- the task of generating a smaller synthetic graph that retains the performance of models trained on the original -- has emerged as a promising solution. However, the dominant approach of gradient matching introduces a fundamental contradiction: it requires training on the full dataset to create the compressed version, thereby undermining the goal of efficiency. Worse still, these methods suffer from high computational overhead, poor generalization across GNN architectures, and brittle reliance on specific model configurations. Equally concerning is the community's reliance on misleading evaluation protocols such as node compression ratios, which fail to reflect true resource savings, condensation overhead, and illusory application to neural architecture search. These shortcomings are not incidental -- they are systemic, and they obstruct meaningful progress. In this position paper, we argue that graph condensation, in its current form, needs a reset. We call for moving beyond full-dataset training and model-dependent design, and instead advocate for methods that are lightweight, architecture-agnostic, and practically deployable. By identifying key methodological flaws and outlining concrete research directions, we aim to reorient the field toward approaches that deliver on the true promise of condensation: efficient, generalizable, and usable GNN training at scale.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 62 of its 88 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

62 of 88 references.

References · 62

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2018How Powerful are Graph Neural Networks?cited by 4,393
  5. 2019Simplifying Graph Convolutional Networkscited by 1,477
  6. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  7. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
  8. 2020Benchmarking Graph Neural Networkscited by 680
  9. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  10. 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 584
  11. 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 541
  12. 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
38 more
  1. 2022Dataset Distillation by Matching Training Trajectoriescited by 442
  2. 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 329
  3. 2019Gradient Descent with Early Stopping is Provably Robust to Label Noise for Overparameterized Neural Networkscited by 159
  4. 2021Graph Condensation for Graph Neural Networkscited by 150
  5. 2022Condensing Graphs via One-Step Gradient Matchingcited by 100
  6. 2023Efficient Dataset Distillation via Minimax Diffusioncited by 83
  7. 2024D4M: Dataset Distillation via Disentangled Diffusion Modelcited by 77
  8. 2023Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Datacited by 71
  9. 2020GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph Generationcited by 66
  10. 2022Graph Condensation via Receptive Field Distribution Matchingcited by 60
  11. 2024A Comprehensive Survey on Graph Reduction: Sparsification, Coarsening, and Condensationcited by 57
  12. 2020A Large-Scale Database for Graph Representation Learningcited by 55
  13. 2023CaT: Balanced Continual Graph Learning with Graph Condensationcited by 52
  14. 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Modelscited by 52
  15. 2023Does Graph Distillation See Like Vision Dataset Counterpart?cited by 45
  16. 2022Tree Mover's Distance: Bridging Graph Metrics and Stability of Graph Neural Networkscited by 41
  17. 2023Fast Graph Condensation with Structure-based Neural Tangent Kernelcited by 36
  18. 2023Graph Condensation for Inductive Node Representation Learningcited by 31
  19. 2024Navigating Complexity: Toward Lossless Graph Condensation via Expanding Window Matchingcited by 28
  20. 2024Graph Condensation: A Surveycited by 23
  21. 2024EXGC: Bridging Efficiency and Explainability in Graph Condensationcited by 20
  22. 2024Graph Data Condensation via Self-expressive Graph Structure Reconstructioncited by 18
  23. 2018Graph Partition Neural Networks for Semi-Supervised Classificationcited by 17
  24. 2023Graph Distillation with Eigenbasis Matchingcited by 16
  25. 2020GraphReach: Position-Aware Graph Neural Network using Reachability Estimationscited by 14
  26. 2022You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Ticketscited by 14
  27. 2023FRIGATE: Frugal Spatio-temporal Forecasting on Road Networkscited by 14
  28. 2024Sketch-GNN: Scalable Graph Neural Networks with Sublinear Training Complexitycited by 14
  29. 2023Mirage: Model-Agnostic Graph Distillation for Graph Classificationcited by 13
  30. 2024GC-Bench: An Open and Unified Benchmark for Graph Condensationcited by 12
  31. 2024Disentangled Condensation for Large-scale Graphscited by 10
  32. 2023Attend Who is Weak: Enhancing Graph Condensation via Cross-Free Adversarial Trainingcited by 9
  33. 2023PUMA: Efficient Continual Graph Learning for Node Classification with Graph Condensationcited by 9
  34. 2024A Survey on Graph Condensationcited by 9
  35. 2024Graph Condensation for Open-World Graph Learningcited by 9
  36. 2024Two Trades is not Baffled: Condensing Graph via Crafting Rational Gradient Matchingcited by 8
  37. 2024Federated Graph Condensation with Information Bottleneck Principlescited by 8
  38. 2023GRAFENNE: Learning on Graphs with Heterogeneous and Dynamic Feature Setscited by 7

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.