Spherical Message Passing for 3D Graph Networks
Not on the map. Why?
Abstract (arXiv)
We consider representation learning of 3D molecular graphs in which each atom is associated with a spatial position in 3D. This is an under-explored area of research, and a principled message passing framework is currently lacking. In this work, we conduct analyses in the spherical coordinate system (SCS) for the complete identification of 3D graph structures. Based on such observations, we propose the spherical message passing (SMP) as a novel and powerful scheme for 3D molecular learning. SMP dramatically reduces training complexity, enabling it to perform efficiently on large-scale molecules. In addition, SMP is capable of distinguishing almost all molecular structures, and the uncovered cases may not exist in practice. Based on meaningful physically-based representations of 3D information, we further propose the SphereNet for 3D molecular learning. Experimental results demonstrate that the use of meaningful 3D information in SphereNet leads to significant performance improvements in prediction tasks. Our results also demonstrate the advantages of SphereNet in terms of capability, efficiency, and scalability. Our code is publicly available as part of the DIG library (https://github.com/divelab/DIG).
Key facts. Cited by 166 papers in the map (data through 7 Oct 2026). Builds on 40 of its 62 references that are in the map. First posted on arXiv 9 Feb 2021.
Builds on
40 of 62 references.
References · 40
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
28 more
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2019Graph U-Netscited by 489
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
- 2019Provably Powerful Graph Networkscited by 385
- 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 384
- 2017Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphscited by 307
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 262
- 2019Cormorant: Covariant Molecular Neural Networkscited by 262
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
- 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 238
- 2020Generalization and Representational Limits of Graph Neural Networkscited by 217
- 2018Large-Scale Learnable Graph Convolutional Networkscited by 113
- 2020Building powerful and equivariant graph neural networks with structural message-passingcited by 95
- 2018N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Moleculescited by 93
- 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 90
- 2019Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspectivecited by 73
- 2020OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Featurescited by 63
- 2018DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applicationscited by 61
- 2020Reinforcement Learning for Molecular Design Guided by Quantum Mechanicscited by 51
- 2020Advanced Graph and Sequence Neural Networks for Molecular Property Prediction and Drug Discoverycited by 46
- 2020Topology-Aware Graph Pooling Networkscited by 44
- 2019Point Cloud Oversegmentation with Graph-Structured Deep Metric Learningcited by 42
- 2018End-to-End Learning on 3D Protein Structure for Interface Predictioncited by 32
- 2020Deep Learning of High-Order Interactions for Protein Interface Predictioncited by 22
Built on by
Citing papers per year: 2021: 3; 2022: 38; 2023: 43; 2024: 31; 2025: 33; 2026: 18.
166 papers.
Sort:
By area:
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 140
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
- 2022Generating 3D Molecules for Target Protein Bindingcited by 104
- 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulationscited by 92
- 2023On the Expressive Power of Geometric Graph Neural Networkscited by 89
- 2022Periodic Graph Transformers for Crystal Material Property Predictioncited by 87
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
38 more
- 2022One Transformer Can Understand Both 2D & 3D Molecular Datacited by 77
- 2022Conditional Antibody Design as 3D Equivariant Graph Translationcited by 75
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systemscited by 65
- 2022DiffBP: Generative Diffusion of 3D Molecules for Target Protein Bindingcited by 58
- 2022Geometrically Equivariant Graph Neural Networks: A Surveycited by 55
- 2022Learning Hierarchical Protein Representations via Complete 3D Graph Networkscited by 54
- 2022Graph-based Molecular Representation Learningcited by 51
- 2023A new perspective on building efficient and expressive 3D equivariant graph neural networkscited by 46
- 2021Simple GNN Regularisation for 3D Molecular Property Prediction & Beyondcited by 44
- 2023Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Spacecited by 40
- 2024The Importance of Being Scalable: Improving the Speed and Accuracy of Neural Network Interatomic Potentials Across Chemical Domainscited by 40
- 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltoniancited by 38
- 2022Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrastcited by 37
- 2022Energy-Motivated Equivariant Pretraining for 3D Molecular Graphscited by 37
- 2023Efficient Approximations of Complete Interatomic Potentials for Crystal Property Predictioncited by 37
- 2023SE(3) Equivariant Augmented Coupling Flowscited by 37
- 2024Equivariant Graph Neural Operator for Modeling 3D Dynamicscited by 37
- 2024Complete and Efficient Graph Transformers for Crystal Material Property Predictioncited by 34
- 2023Fractional Denoising for 3D Molecular Pre-trainingcited by 33
- 2022GraphFM: Improving Large-Scale GNN Training via Feature Momentumcited by 31
- 2024Cartesian atomic cluster expansion for machine learning interatomic potentialscited by 31
- 2023Functional-Group-Based Diffusion for Pocket-Specific Molecule Generation and Elaborationcited by 30
- 2021Learning 3D Representations of Molecular Chirality with Invariance to Bond Rotationscited by 29
- 2023A Latent Diffusion Model for Protein Structure Generationcited by 28
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applicationscited by 28
- 2023Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generationcited by 27
- 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Moleculescited by 26
- 2022Towards Training Billion Parameter Graph Neural Networks for Atomic Simulationscited by 25
- 2023Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Sciencecited by 25
- 2023Towards Symmetry-Aware Generation of Periodic Materialscited by 25
- 2023Automated 3D Pre-Training for Molecular Property Predictioncited by 24
- 2022Molecular Representation Learning via Heterogeneous Motif Graph Neural Networkscited by 23
- 2023Towards Fair Graph Neural Networks via Graph Counterfactualcited by 23
- 2023Highly Accurate Quantum Chemical Property Prediction with Uni-Mol+cited by 22
- 2022Graph Neural Networks for Moleculescited by 21
- 2022FlowX: Towards Explainable Graph Neural Networks via Message Flowscited by 20
50 most cited of 166 All 166 (JSON)
- 2026GSF-chi: Global Stereochemical Fields for Chiral Graph Transformers11 Sep 2026
- 2026Why Multi-Layer Message Passing Works: Completeness Theory for Graph Neural Network Interatomic Potentials1 Sep 2026
- 2026Rotational Equivariance in Machine Learning: A Comprehensive Tutorial31 Aug 2026
- 2026TopoFormer: Topology Meets Attention for Graph Learning30 Jul 2026
- 2026Dual-Level Atomic and Coordination Geometry Learning for Crystal Property Prediction Using Graph Neural Networks17 Jul 2026
- 2026Spin-Weighted Spherical Harmonics Enable Complete and Scalable E(3)-Equivariant Networks1 Jul 2026
- 2026Protein Representation Learning with Secondary-Structure and Energy-Filtered Hydrogen-Bond Graphs12 Jun 2026
- 2026Are Common Substructures Transferable? Riemannian Graph Foundation Model with Neural Vector Bundles2 Jun 2026
- 2026h-MINT: Modeling Pocket-Ligand Binding with Hierarchical Molecular Interaction Network25 Apr 2026
- 2026Sheaf Neural Networks on SPD Manifolds: Second-Order Geometric Representation Learning22 Apr 2026
- 2026A Systematic Survey and Benchmark of Deep Learning for Molecular Property Prediction in the Foundation Model Era17 Apr 2026
- 2026MatRIS: Toward Reliable and Efficient Pretrained Machine Learning Interatomic Potentials2 Mar 2026
38 more
- 2026SphUnc: Hyperspherical Uncertainty Decomposition and Causal Identification via Information Geometry1 Mar 2026
- 2026Multi-Domain Riemannian Graph Gluing for Building Graph Foundation Models28 Feb 2026
- 2026Enhancing Molecular Property Predictions by Learning from Bond Modelling and Interactions28 Feb 2026
- 2026Zatom-1: Towards a Multimodal Foundation Model for 3D Molecules and Materials24 Feb 2026
- 2026Learning Molecular Chirality via Chiral Determinant Kernels7 Feb 2026
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fields29 Jan 2026
- 2025Multi-Scale Protein Structure Modelling with Geometric Graph U-Nets7 Dec 2025
- 2025VS-Graph: Scalable and Efficient Graph Classification Using Hyperdimensional Computing3 Dec 2025
- 2025Toward bilipshiz geometric models13 Nov 2025
- 2025Universally Invariant Learning in Equivariant GNNs15 Oct 2025
- 2025MolGA: Molecular Graph Adaptation with Pre-trained 2D Graph Encoder8 Oct 2025
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modeling5 Oct 2025
- 2025Platonic Transformers: A Solid Choice For Equivariance3 Oct 2025
- 2025HIP: Hessian Interatomic Potentials without derivatives25 Sep 2025
- 2025DEQuify your force field: More efficient simulations using deep equilibrium models10 Sep 2025
- 2025Challenges in Non-Polymeric Crystal Structure Prediction: Why a Geometric, Permutation-Invariant Loss is Needed31 Aug 2025
- 2025Data-driven particle dynamics: Structure-preserving coarse-graining for emergent behavior in non-equilibrium systems18 Aug 2025
- 2025GAGA: Gaussianity-Aware Gaussian Approximation for Efficient 3D Molecular Generation11 Jul 2025
- 2025Tensor Decomposition Networks for Fast Machine Learning Interatomic Potential Computations1 Jul 2025
- 2025Augmenting Molecular Graphs with Geometries via Machine Learning Interatomic Potentials1 Jul 2025
- 2025A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools25 Jun 2025
- 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Frames11 Jun 2025
- 2025DualEquiNet: A Dual-Space Hierarchical Equivariant Network for Large Biomolecules10 Jun 2025
- 2025NeurIPS 2024 ML4CFD Competition: Results and Retrospective Analysis10 Jun 2025
- 2025AlphaFold Database Debiasing for Robust Inverse Folding10 Jun 2025
- 2025UniMate: A Unified Model for Mechanical Metamaterial Generation, Property Prediction, and Condition Confirmation5 Jun 2025
- 2025Recent Developments in GNNs for Drug Discovery2 Jun 2025
- 2025ModuLM: Enabling Modular and Multimodal Molecular Relational Learning with Large Language Models1 Jun 2025
- 2025EDBench: Large-Scale Electron Density Data for Molecular Modeling14 May 2025
- 2025MetamatBench: Integrating Heterogeneous Data, Computational Tools, and Visual Interface for Metamaterial Discovery8 May 2025
- 2025RISE: Radius of Influence based Subgraph Extraction for 3D Molecular Graph Explanation4 May 2025
- 2025Universal Collection of Euclidean Invariants between Pairs of Position-Orientations4 Apr 2025
- 2025Beyond Atoms: Enhancing Molecular Pretrained Representations with 3D Space Modeling13 Mar 2025
- 2025Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems26 Feb 2025
- 2025A Materials Foundation Model via Hybrid Invariant-Equivariant Architectures25 Feb 2025
- 2025MolSpectra: Pre-training 3D Molecular Representation with Multi-modal Energy Spectra22 Feb 2025
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction17 Feb 2025
- 2025Graph-structured Small Molecule Drug Discovery Through Deep Learning: Progress, Challenges, and Opportunities13 Feb 2025
50 newest of 166 All 166 (JSON)
- 2023A Latent Diffusion Model for Protein Structure Generationcited by 28
- 2023Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generationcited by 27
- 2024Stealing Training Graphs from Graph Neural Networkscited by 3
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fieldscited by 3
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fields29 Jan 2026
- 2024Stealing Training Graphs from Graph Neural Networks17 Nov 2024
- 2023Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generation21 May 2023
- 2023A Latent Diffusion Model for Protein Structure Generation6 May 2023
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 140
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
- 2022Generating 3D Molecules for Target Protein Bindingcited by 104
- 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulationscited by 92
- 2023On the Expressive Power of Geometric Graph Neural Networkscited by 89
- 2022Periodic Graph Transformers for Crystal Material Property Predictioncited by 87
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
12 most cited of 161 All 161 (JSON)
- 2026GSF-chi: Global Stereochemical Fields for Chiral Graph Transformers11 Sep 2026
- 2026Why Multi-Layer Message Passing Works: Completeness Theory for Graph Neural Network Interatomic Potentials1 Sep 2026
- 2026Rotational Equivariance in Machine Learning: A Comprehensive Tutorial31 Aug 2026
- 2026TopoFormer: Topology Meets Attention for Graph Learning30 Jul 2026
- 2026Dual-Level Atomic and Coordination Geometry Learning for Crystal Property Prediction Using Graph Neural Networks17 Jul 2026
- 2026Spin-Weighted Spherical Harmonics Enable Complete and Scalable E(3)-Equivariant Networks1 Jul 2026
- 2026Protein Representation Learning with Secondary-Structure and Energy-Filtered Hydrogen-Bond Graphs12 Jun 2026
- 2026Are Common Substructures Transferable? Riemannian Graph Foundation Model with Neural Vector Bundles2 Jun 2026
- 2026h-MINT: Modeling Pocket-Ligand Binding with Hierarchical Molecular Interaction Network25 Apr 2026
- 2026Sheaf Neural Networks on SPD Manifolds: Second-Order Geometric Representation Learning22 Apr 2026
- 2026A Systematic Survey and Benchmark of Deep Learning for Molecular Property Prediction in the Foundation Model Era17 Apr 2026
- 2026MatRIS: Toward Reliable and Efficient Pretrained Machine Learning Interatomic Potentials2 Mar 2026
12 newest of 161 All 161 (JSON)