Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication Channel
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have been widely adopted for drug discovery with molecular graphs. Nevertheless, current GNNs mainly excel in leveraging short-range interactions (SRI) but struggle to capture long-range interactions (LRI), both of which are crucial for determining molecular properties. To tackle this issue, we propose a method to abstract the collective information of atomic groups into a few textitNeural Atoms by implicitly projecting the atoms of a molecular. Specifically, we explicitly exchange the information among neural atoms and project them back to the atoms' representations as an enhancement. With this mechanism, neural atoms establish the communication channels among distant nodes, effectively reducing the interaction scope of arbitrary node pairs into a single hop. To provide an inspection of our method from a physical perspective, we reveal its connection to the traditional LRI calculation method, Ewald Summation. The Neural Atom can enhance GNNs to capture LRI by approximating the potential LRI of the molecular. We conduct extensive experiments on four long-range graph benchmarks, covering graph-level and link-level tasks on molecular graphs. We achieve up to a 27.32% and 38.27% improvement in the 2D and 3D scenarios, respectively. Empirically, our method can be equipped with an arbitrary GNN to help capture LRI. Code and datasets are publicly available in https://github.com/tmlr-group/NeuralAtom.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 48 of its 72 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
48 of 72 references.
References · 48
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Layer Normalizationcited by 5,579
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2020Rethinking Attention with Performerscited by 1,584
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
36 more
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 471
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
- 2019Diffusion Improves Graph Learningcited by 414
- 2017Residual Gated Graph ConvNetscited by 341
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
- 2022Long Range Graph Benchmarkcited by 258
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2019ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representationscited by 156
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
- 2022Transformer for Graphs: An Overview from Architecture Perspectivecited by 107
- 2019Graph Convolutional Networks with EigenPoolingcited by 94
- 2023On the Connection Between MPNN and Graph Transformercited by 60
- 2021Local Augmentation for Graph Neural Networkscited by 52
- 2023Ewald-based Long-Range Message Passing for Molecular Graphscited by 46
- 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44
- 2023Out-of-distribution Detection with Implicit Outlier Transformationcited by 42
- 2023Does Invariant Graph Learning via Environment Augmentation Learn Invariance?cited by 42
- 2023Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolationcited by 38
- 2020On Self-Distilling Graph Neural Networkcited by 35
- 2022AdaProp: Learning Adaptive Propagation for Graph Neural Network based Knowledge Graph Reasoningcited by 28
- 2022Graph Neural Networks Designed for Different Graph Types: A Surveycited by 21
- 2023On Strengthening and Defending Graph Reconstruction Attack with Markov Chain Approximationcited by 16
- 2022FusionRetro: Molecule Representation Fusion via In-Context Learning for Retrosynthetic Planningcited by 14
- 2022KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learningcited by 7
- 2023Towards out-of-distribution generalizable predictions of chemical kinetics propertiescited by 7
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 3.
10 papers.
- 2024E(n) Equivariant Topological Neural Networkscited by 22
- 2025From Passive to Active Reasoning: Can Large Language Models Ask the Right Questions under Incomplete Information?cited by 21
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2025DualEquiNet: A Dual-Space Hierarchical Equivariant Network for Large Biomoleculescited by 5
- 2026Reference-guided Policy Optimization for Molecular Optimization via LLM Reasoningcited by 5
- 2025Natural Language-Assisted Multi-modal Medication Recommendationcited by 4
- 2026XIMP: Cross Graph Inter-Message Passing for Molecular Property Predictioncited by 1
- 2024ReHub: Linear Complexity Graph Transformers with Adaptive Hub-Spoke Reassignmentcited by 0
- 2025MCGM: Multi-stage Clustered Global Modeling for Long-range Interactions in Moleculescited by 0
- 2026MEGA-CL: A Molecular Foundation Model for Generalizable ADMET Prediction through Graph External Attention and Contrastive Learningcited by 0
- 2026MEGA-CL: A Molecular Foundation Model for Generalizable ADMET Prediction through Graph External Attention and Contrastive Learning27 Jul 2026
- 2026Reference-guided Policy Optimization for Molecular Optimization via LLM Reasoning6 Mar 2026
- 2026XIMP: Cross Graph Inter-Message Passing for Molecular Property Prediction26 Jan 2026
- 2025MCGM: Multi-stage Clustered Global Modeling for Long-range Interactions in Molecules26 Sep 2025
- 2025DualEquiNet: A Dual-Space Hierarchical Equivariant Network for Large Biomolecules10 Jun 2025
- 2025From Passive to Active Reasoning: Can Large Language Models Ask the Right Questions under Incomplete Information?9 Jun 2025
- 2025Natural Language-Assisted Multi-modal Medication Recommendation13 Jan 2025
- 2024ReHub: Linear Complexity Graph Transformers with Adaptive Hub-Spoke Reassignment2 Dec 2024
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasures15 Nov 2024
- 2024E(n) Equivariant Topological Neural Networks24 May 2024