Fast and Deep Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
We address the efficiency issue for the construction of a deep graph neural network (GNN). The approach exploits the idea of representing each input graph as a fixed point of a dynamical system (implemented through a recurrent neural network), and leverages a deep architectural organization of the recurrent units. Efficiency is gained by many aspects, including the use of small and very sparse networks, where the weights of the recurrent units are left untrained under the stability condition introduced in this work. This can be viewed as a way to study the intrinsic power of the architecture of a deep GNN, and also to provide insights for the set-up of more complex fully-trained models. Through experimental results, we show that even without training of the recurrent connections, the architecture of small deep GNN is surprisingly able to achieve or improve the state-of-the-art performance on a significant set of tasks in the field of graphs classification.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 12; 2023: 7; 2024: 4; 2025: 3; 2026: 1.
35 papers.
Sort:
- 2022ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networkscited by 31
- 2022Optimization-Induced Graph Implicit Nonlinear Diffusioncited by 28
- 2021VACA: Design of Variational Graph Autoencoders for Interventional and Counterfactual Queriescited by 19
- 2022MGNNI: Multiscale Graph Neural Networks with Implicit Layerscited by 19
- 2022Encoder-Decoder Architecture for Supervised Dynamic Graph Learning: A Surveycited by 14
- 2022Leave Graphs Alone: Addressing Over-Squashing without Rewiringcited by 14
- 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networkscited by 14
- 2021Implicit vs Unfolded Graph Neural Networkscited by 13
- 2021Convergent Graph Solverscited by 12
- 2022Transforming PageRank into an Infinite-Depth Graph Neural Networkcited by 11
- 2021Pyramidal Reservoir Graph Neural Networkcited by 10
- 2022Towards Quantum Graph Neural Networks: An Ego-Graph Learning Approachcited by 8
23 more
- 2021Continuous-Depth Neural Models for Dynamic Graph Predictioncited by 7
- 2022Weisfeiler and Leman go Hyperbolic: Learning Distance Preserving Node Representationscited by 7
- 2021Dynamic Graph Echo State Networkscited by 6
- 2023Few-shot Message-Enhanced Contrastive Learning for Graph Anomaly Detectioncited by 6
- 2024Training-free Graph Neural Networks and the Power of Labels as Featurescited by 5
- 2022Binary Graph Convolutional Network with Capacity Explorationcited by 4
- 2023What Do GNNs Actually Learn? Towards Understanding their Representationscited by 4
- 2023Addressing Heterophily in Node Classification with Graph Echo State Networkscited by 4
- 2023Edge of stability echo state networkscited by 4
- 2021Permute Me Softly: Learning Soft Permutations for Graph Representationscited by 3
- 2024IGNN-Solver: A Graph Neural Solver for Implicit Graph Neural Networkscited by 3
- 2022Beyond Homophily with Graph Echo State Networkscited by 2
- 2023An Empirical Evaluation of Rewiring Approaches in Graph Neural Networkscited by 2
- 2025Rapid training of Hamiltonian graph networks using random featurescited by 2
- 2025Adaptive Initial Residual Connections for GNNs with Theoretical Guaranteescited by 2
- 2022Euler State Networks: Non-dissipative Reservoir Computingcited by 1
- 2023Modeling Edge Features with Deep Bayesian Graph Networkscited by 1
- 2025Efficient quantification on large-scale networkscited by 1
- 2021Phase Transition Adaptationcited by 0
- 2022Density-Aware Hyper-Graph Neural Networks for Graph-based Semi-supervised Node Classificationcited by 0
- 2023Provably Convergent Subgraph-wise Sampling for Fast GNN Trainingcited by 0
- 2024Graph in Graph Neural Networkcited by 0
- 2026Reservoir-Based Graph Convolutional Networkscited by 0
- 2026Reservoir-Based Graph Convolutional Networks25 Mar 2026
- 2025Adaptive Initial Residual Connections for GNNs with Theoretical Guarantees10 Nov 2025
- 2025Rapid training of Hamiltonian graph networks using random features6 Jun 2025
- 2025Efficient quantification on large-scale networks19 Mar 2025
- 2024IGNN-Solver: A Graph Neural Solver for Implicit Graph Neural Networks11 Oct 2024
- 2024Graph in Graph Neural Network30 Jun 2024
- 2024Training-free Graph Neural Networks and the Power of Labels as Features30 Apr 2024
- 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networks24 Jan 2024
- 2023Few-shot Message-Enhanced Contrastive Learning for Graph Anomaly Detection17 Nov 2023
- 2023Modeling Edge Features with Deep Bayesian Graph Networks17 Aug 2023
- 2023Edge of stability echo state networks5 Aug 2023
- 2023An Empirical Evaluation of Rewiring Approaches in Graph Neural Networks31 May 2023
23 more
- 2023Addressing Heterophily in Node Classification with Graph Echo State Networks14 May 2023
- 2023What Do GNNs Actually Learn? Towards Understanding their Representations21 Apr 2023
- 2023Provably Convergent Subgraph-wise Sampling for Fast GNN Training17 Mar 2023
- 2022Leave Graphs Alone: Addressing Over-Squashing without Rewiring13 Dec 2022
- 2022Weisfeiler and Leman go Hyperbolic: Learning Distance Preserving Node Representations4 Nov 2022
- 2022Beyond Homophily with Graph Echo State Networks27 Oct 2022
- 2022Binary Graph Convolutional Network with Capacity Exploration24 Oct 2022
- 2022MGNNI: Multiscale Graph Neural Networks with Implicit Layers15 Oct 2022
- 2022Transforming PageRank into an Infinite-Depth Graph Neural Network1 Jul 2022
- 2022Optimization-Induced Graph Implicit Nonlinear Diffusion29 Jun 2022
- 2022ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networks11 Jun 2022
- 2022Encoder-Decoder Architecture for Supervised Dynamic Graph Learning: A Survey20 Mar 2022
- 2022Euler State Networks: Non-dissipative Reservoir Computing17 Mar 2022
- 2022Density-Aware Hyper-Graph Neural Networks for Graph-based Semi-supervised Node Classification27 Jan 2022
- 2022Towards Quantum Graph Neural Networks: An Ego-Graph Learning Approach13 Jan 2022
- 2021Implicit vs Unfolded Graph Neural Networks12 Nov 2021
- 2021VACA: Design of Variational Graph Autoencoders for Interventional and Counterfactual Queries27 Oct 2021
- 2021Dynamic Graph Echo State Networks16 Oct 2021
- 2021Permute Me Softly: Learning Soft Permutations for Graph Representations5 Oct 2021
- 2021Continuous-Depth Neural Models for Dynamic Graph Prediction22 Jun 2021
- 2021Convergent Graph Solvers3 Jun 2021
- 2021Phase Transition Adaptation20 Apr 2021
- 2021Pyramidal Reservoir Graph Neural Network10 Apr 2021
- 2022ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networkscited by 31
- 2022Optimization-Induced Graph Implicit Nonlinear Diffusioncited by 28
- 2021VACA: Design of Variational Graph Autoencoders for Interventional and Counterfactual Queriescited by 19
- 2022MGNNI: Multiscale Graph Neural Networks with Implicit Layerscited by 19
- 2022Encoder-Decoder Architecture for Supervised Dynamic Graph Learning: A Surveycited by 14
- 2022Leave Graphs Alone: Addressing Over-Squashing without Rewiringcited by 14
- 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networkscited by 14
- 2021Implicit vs Unfolded Graph Neural Networkscited by 13
- 2021Convergent Graph Solverscited by 12
- 2022Transforming PageRank into an Infinite-Depth Graph Neural Networkcited by 11
- 2021Pyramidal Reservoir Graph Neural Networkcited by 10
- 2022Towards Quantum Graph Neural Networks: An Ego-Graph Learning Approachcited by 8
12 most cited of 35 All 35 (JSON)
- 2026Reservoir-Based Graph Convolutional Networks25 Mar 2026
- 2025Adaptive Initial Residual Connections for GNNs with Theoretical Guarantees10 Nov 2025
- 2025Rapid training of Hamiltonian graph networks using random features6 Jun 2025
- 2025Efficient quantification on large-scale networks19 Mar 2025
- 2024IGNN-Solver: A Graph Neural Solver for Implicit Graph Neural Networks11 Oct 2024
- 2024Graph in Graph Neural Network30 Jun 2024
- 2024Training-free Graph Neural Networks and the Power of Labels as Features30 Apr 2024
- 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networks24 Jan 2024
- 2023Few-shot Message-Enhanced Contrastive Learning for Graph Anomaly Detection17 Nov 2023
- 2023Modeling Edge Features with Deep Bayesian Graph Networks17 Aug 2023
- 2023Edge of stability echo state networks5 Aug 2023
- 2023An Empirical Evaluation of Rewiring Approaches in Graph Neural Networks31 May 2023
12 newest of 35 All 35 (JSON)