mlsanityData to 7 Oct 2026

Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channel

arXiv 2311.01276 ↗First posted 2 Nov 2023cs.LG q-bio.QMcited by 10

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) have been widely adopted for drug discovery with molecular graphs. Nevertheless, current GNNs mainly excel in leveraging short-range interactions (SRI) but struggle to capture long-range interactions (LRI), both of which are crucial for determining molecular properties. To tackle this issue, we propose a method to abstract the collective information of atomic groups into a few textitNeural Atoms by implicitly projecting the atoms of a molecular. Specifically, we explicitly exchange the information among neural atoms and project them back to the atoms' representations as an enhancement. With this mechanism, neural atoms establish the communication channels among distant nodes, effectively reducing the interaction scope of arbitrary node pairs into a single hop. To provide an inspection of our method from a physical perspective, we reveal its connection to the traditional LRI calculation method, Ewald Summation. The Neural Atom can enhance GNNs to capture LRI by approximating the potential LRI of the molecular. We conduct extensive experiments on four long-range graph benchmarks, covering graph-level and link-level tasks on molecular graphs. We achieve up to a 27.32% and 38.27% improvement in the 2D and 3D scenarios, respectively. Empirically, our method can be equipped with an arbitrary GNN to help capture LRI. Code and datasets are publicly available in https://github.com/tmlr-group/NeuralAtom.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 48 of its 72 references that are in the map. First posted on arXiv 2 Nov 2023.

Builds on

48 of 72 references.

References · 48

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2016Layer Normalizationcited by 5,579
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  9. 2020Rethinking Attention with Performerscited by 1,584
  10. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  11. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  12. 2019Strategies for Pre-training Graph Neural Networkscited by 964
36 more
  1. 2020Simple and Deep Graph Convolutional Networkscited by 857
  2. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
  3. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  4. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  5. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
  6. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  7. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
  8. 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 471
  9. 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
  10. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
  11. 2019Diffusion Improves Graph Learningcited by 414
  12. 2017Residual Gated Graph ConvNetscited by 341
  13. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
  14. 2022Long Range Graph Benchmarkcited by 258
  15. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
  16. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  17. 2019ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representationscited by 156
  18. 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
  19. 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
  20. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
  21. 2022Transformer for Graphs: An Overview from Architecture Perspectivecited by 107
  22. 2019Graph Convolutional Networks with EigenPoolingcited by 94
  23. 2023On the Connection Between MPNN and Graph Transformercited by 60
  24. 2021Local Augmentation for Graph Neural Networkscited by 52
  25. 2023Ewald-based Long-Range Message Passing for Molecular Graphscited by 46
  26. 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44
  27. 2023Out-of-distribution Detection with Implicit Outlier Transformationcited by 42
  28. 2023Does Invariant Graph Learning via Environment Augmentation Learn Invariance?cited by 42
  29. 2023Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolationcited by 38
  30. 2020On Self-Distilling Graph Neural Networkcited by 35
  31. 2022AdaProp: Learning Adaptive Propagation for Graph Neural Network based Knowledge Graph Reasoningcited by 28
  32. 2022Graph Neural Networks Designed for Different Graph Types: A Surveycited by 21
  33. 2023On Strengthening and Defending Graph Reconstruction Attack with Markov Chain Approximationcited by 16
  34. 2022FusionRetro: Molecule Representation Fusion via In-Context Learning for Retrosynthetic Planningcited by 14
  35. 2022KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learningcited by 7
  36. 2023Towards out-of-distribution generalizable predictions of chemical kinetics propertiescited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 3.

10 papers.