mlsanityData to 7 Oct 2026

Feature Transportation Improves Graph Neural Networks

arXiv 2307.16092 ↗First posted 29 Jul 2023cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Graph neural networks (GNNs) have shown remarkable success in learning representations for graph-structured data. However, GNNs still face challenges in modeling complex phenomena that involve feature transportation. In this paper, we propose a novel GNN architecture inspired by Advection-Diffusion-Reaction systems, called ADR-GNN. Advection models feature transportation, while diffusion captures the local smoothing of features, and reaction represents the non-linear transformation between feature channels. We provide an analysis of the qualitative behavior of ADR-GNN, that shows the benefit of combining advection, diffusion, and reaction. To demonstrate its efficacy, we evaluate ADR-GNN on real-world node classification and spatio-temporal datasets, and show that it improves or offers competitive performance compared to state-of-the-art networks.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 51 of its 101 references that are in the map. First posted on arXiv 29 Jul 2023.

Builds on

51 of 101 references.

References · 51

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  5. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  6. 2020Simple and Deep Graph Convolutional Networkscited by 857
  7. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  8. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  9. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  10. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
  11. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  12. 2019Multi-scale Attributed Node Embeddingcited by 543
38 more
  1. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  2. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
  3. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
  4. 2019Diffusion Improves Graph Learningcited by 414
  5. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
  6. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
  7. 2017Stable Architectures for Deep Neural Networkscited by 340
  8. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
  9. 2017PDE-Net: Learning PDEs from Datacited by 304
  10. 2016Structured Sequence Modeling with Graph Convolutional Recurrent Networkscited by 273
  11. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
  12. 2021GRAND: Graph Neural Diffusioncited by 258
  13. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 245
  14. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  15. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 208
  16. 2020Combining Label Propagation and Simple Models Out-performs Graph Neural Networkscited by 199
  17. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  18. 2021Discrete Graph Structure Learning for Forecasting Multiple Time Seriescited by 169
  19. 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
  20. 2021PyTorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Modelscited by 118
  21. 2019Hamiltonian Graph Networks with ODE Integratorscited by 107
  22. 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
  23. 2020Implicit Graph Neural Networkscited by 98
  24. 2021Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patternscited by 95
  25. 2023DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusioncited by 85
  26. 2021New Benchmarks for Learning on Non-Homophilous Graphscited by 81
  27. 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
  28. 2020Mat'ern Gaussian Processes on Graphscited by 65
  29. 2022Understanding convolution on graphs via energiescited by 58
  30. 2022Anti-Symmetric DGN: a stable architecture for Deep Graph Networkscited by 58
  31. 2022Gradient Gating for Deep Multi-Rate Learning on Graphscited by 49
  32. 2018Neural Proximal Gradient Descent for Compressive Imagingcited by 46
  33. 2023A Fractional Graph Laplacian Approach to Oversmoothingcited by 45
  34. 2019Linked Dynamic Graph CNN: Learning on Point Cloud via Linking Hierarchical Featurescited by 31
  35. 2023Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone Graphscited by 25
  36. 2019IMEXnet: A Forward Stable Deep Neural Networkcited by 22
  37. 2022Complete the Missing Half: Augmenting Aggregation Filtering with Diversification for Graph Convolutional Neural Networkscited by 19
  38. 2023Exploring the Approximation Capabilities of Multiplicative Neural Networks for Smooth Functionscited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 7; 2026: 4.

15 papers.

Sort: