Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Prediction
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) are effective for learning node and link embeddings through permutation-equivariant aggregation. However, standard GNNs collapse automorphic nodes, i.e., those with identical structural roles (or orbits) into indistinguishable representations, leading to the node automorphism problem. This collapse limits their expressive power and degrades link prediction performance. Existing approaches to characterize GNN expressiveness rely primarily on Weisfeiler-Lehman (WL) analyses, but these methods are typically qualitative and often misaligned with empirical results. To address this gap, we begin by introducing a novel quantitative framework to assess GNN expressiveness for link prediction. We first formalize edge-level automorphism through edge orbits, which capture the set of structural role pairs for nodes that share a link. Then, we introduce the edge automorphism ratio (EAR), a scalar metric that quantifies a GNN's ability to distinguish links in a given graph. We empirically demonstrate that EAR correlates strongly with performance, validating its practical benefit. Building on this insight, we design EDGE-ORBIT EQUIVARIANT GRAPH NEURAL NETWORK (EO-GNN), a GNN architecture that addresses automorphism collapse while preserving equivariance and incurring minimal computational overhead. EO-GNN accomplishes this through two core designs combined with WL-based node hashes: (i) automorphism-aware dropouts and (ii) subgraph orbit-biased aggregation. Empirical evaluations on synthetic and real graphs show improvements of up to 42.36% and 28.44%, respectively, in predicting links in scenarios with high automorphism.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
37 of 50 references.
References · 37
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2018Invariant and Equivariant Graph Networkscited by 339
25 more
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 328
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
- 2019On the equivalence between graph isomorphism testing and function approximation with GNNscited by 172
- 2019On the Universality of Invariant Networkscited by 151
- 2020Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learningcited by 148
- 2019Wasserstein Weisfeiler-Lehman Graph Kernelscited by 104
- 2013Dropout Training as Adaptive Regularizationcited by 89
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
- 2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
- 2023Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarkingcited by 69
- 2023Neural Common Neighbor with Completion for Link Predictioncited by 64
- 2023A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Testscited by 64
- 2024Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressivenesscited by 38
- 2023Fine-grained Expressivity of Graph Neural Networkscited by 25
- 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 25
- 2023LPFormer: An Adaptive Graph Transformer for Link Predictioncited by 17
- 2023Expressive Sign Equivariant Networks for Spectral Geometric Learningcited by 15
- 2024ADEdgeDrop: Adversarial Edge Dropping for Robust Graph Neural Networkscited by 7
- 2022Two-Dimensional Weisfeiler-Lehman Graph Neural Networks for Link Predictioncited by 6
- 2020Automorphic Equivalence-aware Graph Neural Networkcited by 5
- 2025Learning Laplacian Positional Encodings for Heterophilous Graphscited by 4
- 2025Bridging Theory and Practice in Link Representation with Graph Neural Networkscited by 4
- 2025Understanding Generalization in Node and Link Predictioncited by 2
Built on by
Not cited yet.