SE3Set: Harnessing equivariant hypergraph neural networks for molecular representation learning
Not on the map. Why?
Abstract (arXiv)
In this paper, we develop SE3Set, an SE(3) equivariant hypergraph neural network architecture tailored for advanced molecular representation learning. Hypergraphs are not merely an extension of traditional graphs; they are pivotal for modeling high-order relationships, a capability that conventional equivariant graph-based methods lack due to their inherent limitations in representing intricate many-body interactions. To achieve this, we first construct hypergraphs via proposing a new fragmentation method that considers both chemical and three-dimensional spatial information of molecular system. We then design SE3Set, which incorporates equivariance into the hypergragh neural network. This ensures that the learned molecular representations are invariant to spatial transformations, thereby providing robustness essential for accurate prediction of molecular properties. SE3Set has shown performance on par with state-of-the-art (SOTA) models for small molecule datasets like QM9 and MD17. It excels on the MD22 dataset, achieving a notable improvement of approximately 20% in accuracy across all molecules, which highlights the prevalence of complex many-body interactions in larger molecules. This exceptional performance of SE3Set across diverse molecular structures underscores its transformative potential in computational chemistry, offering a route to more accurate and physically nuanced modeling.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 82 references that are in the map. First posted on arXiv 26 May 2024.
Builds on
39 of 82 references.
References · 39
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2017Deep Setscited by 1,421
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2020Directional Message Passing for Molecular Graphscited by 561
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
27 more
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 343
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
- 2019Cormorant: Covariant Molecular Neural Networkscited by 263
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 256
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 255
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 182
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2021You are AllSet: A Multiset Function Framework for Hypergraph Neural Networkscited by 127
- 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
- 2018Molecular Hypergraph Grammar with its Application to Molecular Optimizationcited by 56
- 2018Graph Transformation Policy Network for Chemical Reaction Predictioncited by 56
- 2023A new perspective on building efficient and expressive 3D equivariant graph neural networkscited by 47
- 2023Ewald-based Long-Range Message Passing for Molecular Graphscited by 46
- 2021Transformers Generalize DeepSets and Can be Extended to Graphs and Hypergraphscited by 35
- 2020Nonlinear Higher-Order Label Spreadingcited by 20
- 2023Fragment-based Pretraining and Finetuning on Molecular Graphscited by 20
- 2022Equivariant Hypergraph Neural Networkscited by 14
- 2016The Spacey Random Walk: a Stochastic Process for Higher-order Datacited by 13
- 2021Hypergraph Pre-training with Graph Neural Networkscited by 9
- 2023Molecular Hypergraph Neural Networkscited by 7
- 2022Rxn Hypergraph: a Hypergraph Attention Model for Chemical Reaction Representationcited by 6
- 2020Molecule Property Prediction and Classification with Graph Hypernetworkscited by 5
- 2019Landing Probabilities of Random Walks for Seed-Set Expansion in Hypergraphscited by 4
- 2022FunQG: Molecular Representation Learning Via Quotient Graphscited by 2
Built on by
Citing papers per year: 2025: 2.
2 papers.