mlsanityData to 14 Oct 2026

Positional Encoding meets Persistent Homology on Graphs

arXiv 2506.05814 ↗First posted 6 Jun 2025cs.LG cs.AI cs.ETcited by 1

Not on the map. Why?

Abstract (arXiv)

The local inductive bias of message-passing graph neural networks (GNNs) hampers their ability to exploit key structural information (e.g., connectivity and cycles). Positional encoding (PE) and Persistent Homology (PH) have emerged as two promising approaches to mitigate this issue. PE schemes endow GNNs with location-aware features, while PH methods enhance GNNs with multiresolution topological features. However, a rigorous theoretical characterization of the relative merits and shortcomings of PE and PH has remained elusive. We bridge this gap by establishing that neither paradigm is more expressive than the other, providing novel constructions where one approach fails but the other succeeds. Our insights inform the design of a novel learnable method, PiPE (Persistence-informed Positional Encoding), which is provably more expressive than both PH and PE. PiPE demonstrates strong performance across a variety of tasks (e.g., molecule property prediction, graph classification, and out-of-distribution generalization), thereby advancing the frontiers of graph representation learning. Code is available at https://github.com/Aalto-QuML/PIPE.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 69 references that are in the map. First posted on arXiv 6 Jun 2025.

Builds on

46 of 69 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  9. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  10. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  11. 2018Self-Attention with Relative Position Representationscited by 1,120
  12. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
34 more
  1. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  2. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  3. 2020Benchmarking Graph Neural Networkscited by 680
  4. 2017Convolutional Sequence to Sequence Learningcited by 552
  5. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
  6. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
  7. 2021Do Transformers Really Perform Bad for Graph Representation?cited by 320
  8. 2019Position-aware Graph Neural Networkscited by 203
  9. 2020Random Features Strengthen Graph Neural Networkscited by 186
  10. 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 179
  11. 2019PersLay: A Neural Network Layer for Persistence Diagrams and New Graph Topological Signaturescited by 126
  12. 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 122
  13. 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
  14. 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
  15. 2021Topological Graph Neural Networkscited by 87
  16. 2019Learning Symbolic Physics with Graph Networkscited by 53
  17. 2022A Short Tutorial on The Weisfeiler-Lehman Test And Its Variantscited by 52
  18. 2019Alchemy: A Quantum Chemistry Dataset for Benchmarking AI Modelscited by 36
  19. 2019Optimizing Generalized PageRank Methods for Seed-Expansion Community Detectioncited by 35
  20. 2023An Empirical Study of Realized GNN Expressivenesscited by 33
  21. 2023Graph Positional Encoding via Random Feature Propagationcited by 31
  22. 2023Going beyond persistent homology using persistent homologycited by 22
  23. 2022Generalized Laplacian Positional Encoding for Graph Representation Learningcited by 21
  24. 2023On the Expressivity of Persistent Homology in Graph Learningcited by 19
  25. 2024Topological Neural Networks go Persistent, Equivariant, and Continuouscited by 17
  26. 2023Asynchronous Algorithmic Alignment with Cocyclescited by 13
  27. 2024Attending to Topological Spaces: The Cellular Transformercited by 11
  28. 2023Algebraic Positional Encodingscited by 10
  29. 2023Recursive Algorithmic Reasoningcited by 9
  30. 2025Enhancing Graph Representation Learning with Localized Topological Featurescited by 6
  31. 2018Homology-Preserving Multi-Scale Graph Skeletonization Using Mapper on Graphscited by 5
  32. 2021Persistent Homology and Graphs Representation Learningcited by 5
  33. 2023What Do GNNs Actually Learn? Towards Understanding their Representationscited by 4
  34. 2023Algebraic Topological Networks via the Persistent Local Homology Sheafcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.