mlsanityData to 7 Oct 2026

Rethinking Message Passing Neural Networks with Diffusion Distance-guided Stress Majorization

arXiv 2511.19984 ↗First posted 25 Nov 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Message passing neural networks (MPNNs) have emerged as go-to models for learning on graph-structured data in the past decade. Despite their effectiveness, most of such models still incur severe issues such as over-smoothing and -correlation, due to their underlying objective of minimizing the Dirichlet energy and the derived neighborhood aggregation operations. In this paper, we propose the DDSM, a new MPNN model built on an optimization framework that includes the stress majorization and orthogonal regularization for overcoming the above issues. Further, we introduce the diffusion distances for nodes into the framework to guide the new message passing operations and develop efficient algorithms for distance approximations, both backed by rigorous theoretical analyses. Our comprehensive experiments showcase that DDSM consistently and considerably outperforms 15 strong baselines on both homophilic and heterophilic graphs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 92 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

54 of 92 references.

References · 54

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  9. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  10. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  11. 2019Simplifying Graph Convolutional Networkscited by 1,470
  12. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
38 more
  1. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  2. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  3. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  4. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  5. 2020Simple and Deep Graph Convolutional Networkscited by 857
  6. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  7. 2019Graph Neural Networks for Social Recommendationcited by 711
  8. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
  9. 2019Multi-scale Attributed Node Embeddingcited by 543
  10. 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 540
  11. 2019Diffusion Improves Graph Learningcited by 414
  12. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 332
  13. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  14. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
  15. 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
  16. 2020Towards Deeper Graph Neural Networkscited by 296
  17. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
  18. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 245
  19. 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
  20. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  21. 2021Training Graph Neural Networks with 1000 Layerscited by 169
  22. 2022Revisiting Heterophily For Graph Neural Networkscited by 169
  23. 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
  24. 2020Towards Deeper Graph Neural Networks with Differentiable Group Normalizationcited by 113
  25. 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
  26. 2019Constant Curvature Graph Convolutional Networkscited by 106
  27. 2017Learning Structural Node Embeddings Via Diffusion Waveletscited by 97
  28. 2021Dirichlet Energy Constrained Learning for Deep Graph Neural Networkscited by 97
  29. 2022Understanding convolution on graphs via energiescited by 58
  30. 2022GREAD: Graph Neural Reaction-Diffusion Networkscited by 54
  31. 2016A note on the triangle inequality for the Jaccard distancecited by 32
  32. 2022Feature Overcorrelation in Deep Graph Neural Networks: A New Perspectivecited by 19
  33. 2022TIDE: Time Derivative Diffusion for Deep Learning on Graphscited by 17
  34. 2023Node-wise Diffusion for Scalable Graph Learningcited by 17
  35. 2023A Generalized Neural Diffusion Framework on Graphscited by 13
  36. 2024Bundle Neural Networks for message diffusion on graphscited by 13
  37. 2024SlotGAT: Slot-based Message Passing for Heterogeneous Graph Neural Networkcited by 11
  38. 2022MGNN: Graph Neural Networks Inspired by Distance Geometry Problemcited by 8

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.