Random Features Strengthen Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some non-isomorphic graphs and they cannot learn efficient graph algorithms. In this paper, we demonstrate that GNNs become powerful just by adding a random feature to each node. We prove that the random features enable GNNs to learn almost optimal polynomial-time approximation algorithms for the minimum dominating set problem and maximum matching problem in terms of approximation ratios. The main advantage of our method is that it can be combined with off-the-shelf GNN models with slight modifications. Through experiments, we show that the addition of random features enables GNNs to solve various problems that normal GNNs, including the graph convolutional networks (GCNs) and graph isomorphism networks (GINs), cannot solve.
Key facts. Cited by 184 papers in the map (data through 13 Oct 2026). First posted on arXiv 8 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 39; 2023: 45; 2024: 37; 2025: 22; 2026: 16.
184 papers.
Sort:
By area:
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,147
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2023Exphormer: Sparse Transformers for Graphscited by 169
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 154
- 2021Nested Graph Neural Networkscited by 136
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 121
- 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 117
- 2023Randomized Positional Encodings Boost Length Generalization of Transformerscited by 116
38 more
- 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
- 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
- 2022How Powerful are K-hop Message Passing Graph Neural Networkscited by 90
- 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 86
- 2021The Logic of Graph Neural Networkscited by 84
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
- 2022A Survey on Graph Representation Learning Methodscited by 66
- 2021Reconstruction for Powerful Graph Representationscited by 65
- 2022Benchmarking Graphormer on Large-Scale Molecular Modeling Datasetscited by 63
- 2021On the Unreasonable Effectiveness of Feature propagation in Learning on Graphs with Missing Node Featurescited by 62
- 2022Theory of Graph Neural Networks: Representation and Learningcited by 61
- 2022Ordered Subgraph Aggregation Networkscited by 57
- 2022Provably expressive temporal graph networkscited by 56
- 2021Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depthcited by 55
- 2021Graph Neural Networks with Local Graph Parameterscited by 51
- 2023InGram: Inductive Knowledge Graph Embedding via Relation Graphscited by 50
- 2021On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphscited by 49
- 2021Walking Out of the Weisfeiler Leman Hierarchy: Graph Learning Beyond Message Passingcited by 47
- 2022A Theoretical Comparison of Graph Neural Network Extensionscited by 47
- 2022Message passing all the way upcited by 47
- 2022Shortest Path Networks for Graph Property Predictioncited by 46
- 2021Simple GNN Regularisation for 3D Molecular Property Prediction & Beyondcited by 44
- 2024GOAL: A Generalist Combinatorial Optimization Agent Learnercited by 40
- 2021Learning General Optimal Policies with Graph Neural Networks: Expressive Power, Transparency, and Limitscited by 38
- 2023Equivariant Polynomials for Graph Neural Networkscited by 38
- 2022SpeqNets: Sparsity-aware Permutation-equivariant Graph Networkscited by 37
- 2023Cooperative Graph Neural Networkscited by 36
- 2023The expressive power of pooling in Graph Neural Networkscited by 35
- 2023Graph Positional and Structural Encodercited by 33
- 2023Fractional Denoising for 3D Molecular Pre-trainingcited by 33
- 2023A Theory of Link Prediction via Relational Weisfeiler-Leman on Knowledge Graphscited by 32
- 2023Path Neural Networks: Expressive and Accurate Graph Neural Networkscited by 32
- 2025Relational Graph Transformercited by 32
- 2023WL meet VCcited by 30
- 2023Graph Positional Encoding via Random Feature Propagationcited by 30
- 2022One Model, Any CSP: Graph Neural Networks as Fast Global Search Heuristics for Constraint Satisfactioncited by 27
- 2023The Expressive Power of Graph Neural Networks: A Surveycited by 27
- 2021On the Universality of Graph Neural Networks on Large Random Graphscited by 26
50 most cited of 184 All 184 (JSON)
- 2026Training Graph Foundation Models on The Web Graph25 Sep 2026
- 2026Finite-Time Node Separation in Recurrent Graph Neural Networks with Persistent Gaussian Perturbations12 Sep 2026
- 2026Inductive Correlation Clustering with Graph Neural Networks27 Aug 2026
- 2026Persistent Gaussian Perturbations Prevent Oversmoothing in Recurrent Graph Neural Networks30 Jul 2026
- 2026CondPSE: A Polynomial-Filtered Structural Encoder with Conditional Modulation for Graphs28 Jul 2026
- 2026A Weisfeiler-Leman Characterization of Global-Attention Graph Transformers for Mixed-Integer Linear Programs20 Jul 2026
- 2026Placing Degree Scales After LayerNorm12 Jun 2026
- 2026On the Expressive Power of GNNs to Solve Linear SDPs30 Apr 2026
- 2026The Logical Expressiveness of Topological Neural Networks21 Apr 2026
- 2026k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS4 Apr 2026
- 2026Any-Subgroup Equivariant Networks via Symmetry Breaking19 Mar 2026
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs10 Feb 2026
38 more
- 2026Property-Driven Evaluation of GNN Expressiveness at Scale: Datasets, Framework, and Study9 Feb 2026
- 2026Plain Transformers are Surprisingly Powerful Link Predictors2 Feb 2026
- 2026ASEHybrid: When Geometry Matters Beyond Homophily in Graph Neural Networks26 Jan 2026
- 2026mHC-GNN: Manifold-Constrained Hyper-Connections for Graph Neural Networks5 Jan 2026
- 2025Enhancing Graph Representations with Neighborhood-Contextualized Message-Passing14 Nov 2025
- 2025Enhancing Logical Expressiveness in Graph Neural Networks via Path-Neighbor Aggregation11 Nov 2025
- 2025Sketch-Augmented Features Improve Learning Long-Range Dependencies in Graph Neural Networks5 Nov 2025
- 2025On The Expressive Power of GNN Derivatives2 Oct 2025
- 2025GraphPFN: A Prior-Data Fitted Graph Foundation Model25 Sep 2025
- 2025Feature Augmentation of GNNs for ILPs: Local Uniqueness Suffices25 Sep 2025
- 2025Invariant Graph Transformer for Out-of-Distribution Generalization1 Aug 2025
- 2025MILP-SAT-GNN: Yet Another Neural SAT Solver2 Jul 2025
- 2025Logical Expressiveness of Graph Neural Networks with Hierarchical Node Individualization16 Jun 2025
- 2025Flow-Attentional Graph Neural Networks6 Jun 2025
- 2025Positional Encoding meets Persistent Homology on Graphs6 Jun 2025
- 2025Graph Neural Networks for Jamming Source Localization1 Jun 2025
- 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?16 May 2025
- 2025Relational Graph Transformer16 May 2025
- 2025Improving Equivariant Networks with Probabilistic Symmetry Breaking27 Mar 2025
- 2025Graph Self-Supervised Learning with Learnable Structural and Positional Encodings22 Feb 2025
- 2025Towards Invariance to Node Identifiers in Graph Neural Networks19 Feb 2025
- 2025Using Random Noise Equivariantly to Boost Graph Neural Networks Universally4 Feb 2025
- 2025Learning Efficient Positional Encodings with Graph Neural Networks3 Feb 2025
- 2025Integrating Causality with Neurochaos Learning: Proposed Approach and Research Agenda23 Jan 2025
- 2025Training Hybrid Neural Networks with Multimode Optical Nonlinearities Using Digital Twins14 Jan 2025
- 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centrality6 Jan 2025
- 2024LASE: Learned Adjacency Spectral Embeddings23 Dec 2024
- 2024GNN Applied to Ego-nets for Friend Suggestions16 Dec 2024
- 2024Towards Graph Foundation Models: A Study on the Generalization of Positional and Structural Encodings10 Dec 2024
- 2024Benchmarking Positional Encodings for GNNs and Graph Transformers19 Nov 2024
- 2024On the Utilization of Unique Node Identifiers in Graph Neural Networks4 Nov 2024
- 2024Homomorphism Counts as Structural Encodings for Graph Learning24 Oct 2024
- 2024Harnessing the Power of Noise: A Survey of Techniques and Applications8 Oct 2024
- 2024Preventing Representational Rank Collapse in MPNNs by Splitting the Computational Graph17 Sep 2024
- 2024CliquePH: Higher-Order Information for Graph Neural Networks through Persistent Homology on Clique Graphs12 Sep 2024
- 2024Pre-training with Fractional Denoising to Enhance Molecular Property Prediction14 Jul 2024
- 2024Foundations and Frontiers of Graph Learning Theory3 Jul 2024
- 2024Revisiting Random Walks for Learning on Graphs1 Jul 2024
50 newest of 184 All 184 (JSON)
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,147
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2023Exphormer: Sparse Transformers for Graphscited by 169
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 154
- 2021Nested Graph Neural Networkscited by 136
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 121
- 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 117
- 2023Randomized Positional Encodings Boost Length Generalization of Transformerscited by 116
12 most cited of 183 All 183 (JSON)
- 2026Training Graph Foundation Models on The Web Graph25 Sep 2026
- 2026Finite-Time Node Separation in Recurrent Graph Neural Networks with Persistent Gaussian Perturbations12 Sep 2026
- 2026Inductive Correlation Clustering with Graph Neural Networks27 Aug 2026
- 2026Persistent Gaussian Perturbations Prevent Oversmoothing in Recurrent Graph Neural Networks30 Jul 2026
- 2026CondPSE: A Polynomial-Filtered Structural Encoder with Conditional Modulation for Graphs28 Jul 2026
- 2026A Weisfeiler-Leman Characterization of Global-Attention Graph Transformers for Mixed-Integer Linear Programs20 Jul 2026
- 2026Placing Degree Scales After LayerNorm12 Jun 2026
- 2026On the Expressive Power of GNNs to Solve Linear SDPs30 Apr 2026
- 2026The Logical Expressiveness of Topological Neural Networks21 Apr 2026
- 2026k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS4 Apr 2026
- 2026Any-Subgroup Equivariant Networks via Symmetry Breaking19 Mar 2026
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs10 Feb 2026
12 newest of 183 All 183 (JSON)