mlsanityData to 14 Oct 2026

Enhancing Spectral Graph Neural Networks with LLM-Predicted Homophily

arXiv 2506.14220 ↗First posted 17 Jun 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Spectral Graph Neural Networks (SGNNs) have achieved remarkable performance in tasks such as node classification due to their ability to learn flexible filters. Typically, these filters are learned under the supervision of downstream tasks, enabling SGNNs to adapt to diverse structural patterns. However, in scenarios with limited labeled data, SGNNs often struggle to capture the optimal filter shapes, resulting in degraded performance, especially on graphs with heterophily. Meanwhile, the rapid progress of Large Language Models (LLMs) has opened new possibilities for enhancing graph learning without modifying graph structure or requiring task-specific training. In this work, we propose a novel framework that leverages LLMs to estimate the homophily level of a graph and uses this global structural prior to guide the construction of spectral filters. Specifically, we design a lightweight and plug-and-play pipeline where a small set of labeled node pairs is formatted as natural language prompts for the LLM, which then predicts the graph's homophily ratio. This estimated value informs the spectral filter basis, enabling SGNNs to adapt more effectively to both homophilic and heterophilic structures. Extensive experiments on multiple benchmark datasets demonstrate that our LLM-assisted spectral framework consistently improves performance over strong SGNN baselines. Importantly, this enhancement incurs negligible computational and monetary cost, making it a practical solution for real-world graph applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

23 of 35 references.

References · 23

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  5. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
  6. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  7. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  8. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
  9. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
  10. 2021Graph Neural Network for Traffic Forecasting: A Surveycited by 261
  11. 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
  12. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
11 more
  1. 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
  2. 2024A Survey of Large Language Models for Graphscited by 72
  3. 2022A Survey of Graph Neural Networks for Social Recommender Systemscited by 65
  4. 2024GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Taskscited by 63
  5. 2023GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detectioncited by 58
  6. 2023Graph-Aware Language Model Pre-Training on a Large Graph Corpus Can Help Multiple Graph Applicationscited by 33
  7. 2024GraphEdit: Large Language Models for Graph Structure Learningcited by 33
  8. 2024How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashingcited by 24
  9. 2022HP-GMN: Graph Memory Networks for Heterophilous Graphscited by 13
  10. 2024SmoothGNN: Smoothing-aware GNN for Unsupervised Node Anomaly Detectioncited by 11
  11. 2024Exploring the Potential of Large Language Models for Heterophilic Graphscited by 10

Built on by

Not cited yet.