mlsanityData to 7 Oct 2026

SPARC: Spectral Architectures Tackling the Cold-Start Problem in Graph Learning

arXiv 2411.01532 ↗First posted 3 Nov 2024cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Graphs play a central role in modeling complex relationships in data, yet most graph learning methods falter when faced with cold-start nodes--new nodes lacking initial connections--due to their reliance on adjacency information. To tackle this, we propose SPARC, a groundbreaking framework that introduces a novel approach to graph learning by utilizing generalizable spectral embeddings. With a simple yet powerful enhancement, SPARC empowers state-of-the-art methods to make predictions on cold-start nodes effectively. By eliminating the need for adjacency information during inference and effectively capturing the graph's structure, we make these methods suitable for real-world scenarios where new nodes frequently appear. Experimental results demonstrate that our framework outperforms existing models on cold-start nodes across tasks such as node classification, node clustering, and link prediction. SPARC provides a solution to the cold-start problem, advancing the field of graph learning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 3 Nov 2024.

Builds on

26 of 43 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  9. 2019Simplifying Graph Convolutional Networkscited by 1,470
  10. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  11. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  12. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
14 more
  1. 2020A Generalization of Transformer Networks to Graphscited by 653
  2. 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 540
  3. 2018Graph Convolutional Networks for Text Classificationcited by 345
  4. 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 320
  5. 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
  6. 2018SpectralNet: Spectral Clustering using Deep Neural Networkscited by 94
  7. 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 84
  8. 2021Graph-MLP: Node Classification without Message Passing in Graphcited by 73
  9. 2021Learning from Counterfactual Links for Link Predictioncited by 69
  10. 2021Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoodscited by 57
  11. 2022Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminatingcited by 57
  12. 2022Linkless Link Prediction via Relational Distillationcited by 39
  13. 2021Rethinking Graph Auto-Encoder Models for Attributed Graph Clusteringcited by 37
  14. 2024VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connectionscited by 34

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.