mlsanityData to 7 Oct 2026

G-Signatures: Global Graph Propagation With Randomized Signatures

arXiv 2302.08811 ↗First posted 17 Feb 2023cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Graph neural networks (GNNs) have evolved into one of the most popular deep learning architectures. However, GNNs suffer from over-smoothing node information and, therefore, struggle to solve tasks where global graph properties are relevant. We introduce G-Signatures, a novel graph learning method that enables global graph propagation via randomized signatures. G-Signatures use a new graph conversion concept to embed graph structured information which can be interpreted as paths in latent space. We further introduce the idea of latent space path mapping. This allows us to iteratively traverse latent space paths, and, thus globally process information. G-Signatures excel at extracting and processing global graph properties, and effectively scale to large graph problems. Empirically, we confirm the advantages of G-Signatures at several classification and regression tasks.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 59 of its 97 references that are in the map. First posted on arXiv 17 Feb 2023.

Builds on

59 of 97 references.

References · 59

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2016Layer Normalizationcited by 5,579
  8. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  9. 2018How Powerful are Graph Neural Networks?cited by 4,355
  10. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  11. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  12. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
38 more
  1. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  2. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  3. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  4. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  5. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  6. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  7. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  8. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  9. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  10. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  11. 2020Simple and Deep Graph Convolutional Networkscited by 857
  12. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  13. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  14. 2020Benchmarking Graph Neural Networkscited by 672
  15. 2019Large Batch Optimization for Deep Learning: Training BERT in 76 minutescited by 671
  16. 2020A Generalization of Transformer Networks to Graphscited by 653
  17. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  18. 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
  19. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
  20. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  21. 2022Message Passing Neural PDE Solverscited by 368
  22. 2017Residual Gated Graph ConvNetscited by 341
  23. 2020Towards Deeper Graph Neural Networkscited by 296
  24. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
  25. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
  26. 2022Long Range Graph Benchmarkcited by 258
  27. 2015Highway Networkscited by 257
  28. 2017Learning to Represent Programs with Graphscited by 219
  29. 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
  30. 2022Forecasting Global Weather with Graph Neural Networkscited by 165
  31. 2019Relational Pooling for Graph Representationscited by 150
  32. 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
  33. 2022Graph-Coupled Oscillator Networkscited by 123
  34. 2016A Primer on the Signature Method in Machine Learningcited by 100
  35. 2020Implicit Graph Neural Networkscited by 98
  36. 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
  37. 2019Deep Signature Transformscited by 75
  38. 2021Graph Neural Networks Inspired by Classical Iterative Algorithmscited by 60

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 2.

4 papers.