mlsanityData to 7 Oct 2026

Learnable Spectral Wavelets on Dynamic Graphs to Capture Global Interactions

arXiv 2211.11979 ↗First posted 22 Nov 2022cs.LG cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Learning on evolving(dynamic) graphs has caught the attention of researchers as static methods exhibit limited performance in this setting. The existing methods for dynamic graphs learn spatial features by local neighborhood aggregation, which essentially only captures the low pass signals and local interactions. In this work, we go beyond current approaches to incorporate global features for effectively learning representations of a dynamically evolving graph. We propose to do so by capturing the spectrum of the dynamic graph. Since static methods to learn the graph spectrum would not consider the history of the evolution of the spectrum as the graph evolves with time, we propose a novel approach to learn the graph wavelets to capture this evolving spectra. Further, we propose a framework that integrates the dynamically captured spectra in the form of these learnable wavelets into spatial features for incorporating local and global interactions. Experiments on eight standard datasets show that our method significantly outperforms related methods on various tasks for dynamic graphs.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 22 Nov 2022.

Builds on

26 of 44 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2020A Generalization of Transformer Networks to Graphscited by 653
  7. 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
  8. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
  9. 2021Bottleneck Transformers for Visual Recognitioncited by 364
  10. 2021Do Transformers Really Perform Bad for Graph Representation?cited by 318
  11. 2016Structured Sequence Modeling with Graph Convolutional Recurrent Networkscited by 273
  12. 2019Representation Learning for Dynamic Graphs: A Surveycited by 260
14 more
  1. 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
  2. 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 193
  3. 2022Vision GNN: An Image is Worth Graph of Nodescited by 185
  4. 2022EquiBind: Geometric Deep Learning for Drug Binding Structure Predictioncited by 143
  5. 2019Graph Wavelet Neural Networkcited by 131
  6. 2018DynGEM: Deep Embedding Method for Dynamic Graphscited by 100
  7. 2021Learnable Fourier Features for Multi-Dimensional Spatial Positional Encodingcited by 93
  8. 2018dyngraph2vec: Capturing Network Dynamics using Dynamic Graph Representation Learningcited by 88
  9. 2017Dynamic Graph Convolutional Networkscited by 83
  10. 2022A Survey on Graph Representation Learning Methodscited by 66
  11. 2021A New Perspective on the Effects of Spectrum in Graph Neural Networkscited by 24
  12. 2022How Expressive are Transformers in Spectral Domain for Graphs?cited by 15
  13. 2021DynG2G: An Efficient Stochastic Graph Embedding Method for Temporal Graphscited by 8
  14. 2021Learning to Evolve on Dynamic Graphscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 2; 2026: 1.

10 papers.