SE(3) Equivariant Graph Neural Networks with Complete Local Frames
Not on the map. Why?
Abstract (arXiv)
Group equivariance (e.g. SE(3) equivariance) is a critical physical symmetry in science, from classical and quantum physics to computational biology. It enables robust and accurate prediction under arbitrary reference transformations. In light of this, great efforts have been put on encoding this symmetry into deep neural networks, which has been shown to improve the generalization performance and data efficiency for downstream tasks. Constructing an equivariant neural network generally brings high computational costs to ensure expressiveness. Therefore, how to better trade-off the expressiveness and computational efficiency plays a core role in the design of the equivariant deep learning models. In this paper, we propose a framework to construct SE(3) equivariant graph neural networks that can approximate the geometric quantities efficiently. Inspired by differential geometry and physics, we introduce equivariant local complete frames to graph neural networks, such that tensor information at given orders can be projected onto the frames. The local frame is constructed to form an orthonormal basis that avoids direction degeneration and ensure completeness. Since the frames are built only by cross product operations, our method is computationally efficient. We evaluate our method on two tasks: Newton mechanics modeling and equilibrium molecule conformation generation. Extensive experimental results demonstrate that our model achieves the best or competitive performance in two types of datasets.
Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). Builds on 53 of its 75 references that are in the map. First posted on arXiv 26 Oct 2021.
Builds on
53 of 75 references.
References · 53
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2015Deep Learning and the Information Bottleneck Principlecited by 802
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
38 more
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2020Directional Message Passing for Molecular Graphscited by 561
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
- 2018Spherical CNNscited by 456
- 2019General E(2)-Equivariant Steerable CNNscited by 446
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
- 2018Invariant and Equivariant Graph Networkscited by 346
- 2016Steerable CNNscited by 305
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 300
- 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
- 2019Cormorant: Covariant Molecular Neural Networkscited by 263
- 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 243
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
- 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 194
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 183
- 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 171
- 2021Learning Gradient Fields for Molecular Conformation Generationcited by 163
- 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 121
- 2021GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensemblescited by 107
- 2020LieTransformer: Equivariant self-attention for Lie Groupscited by 100
- 2019B-Spline CNNs on Lie Groupscited by 97
- 2016Exploiting Cyclic Symmetry in Convolutional Neural Networkscited by 91
- 2021Learning Neural Generative Dynamics for Molecular Conformation Generationcited by 88
- 2020On the Universality of Rotation Equivariant Point Cloud Networkscited by 80
- 2020Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODEcited by 76
- 2019A Generative Model for Molecular Distance Geometrycited by 73
- 2020On Second Order Behaviour in Augmented Neural ODEscited by 68
- 2020Attentive Group Equivariant Convolutional Networkscited by 63
- 2018CubeNet: Equivariance to 3D Rotation and Translationcited by 59
- 2019Equivariant Flows: sampling configurations for multi-body systems with symmetric energiescited by 57
- 2020Spin-Weighted Spherical CNNscited by 50
- 2019Equivariant Multi-View Networkscited by 45
- 2020PDO-eConvs: Partial Differential Operator Based Equivariant Convolutionscited by 34
- 2019A Simple Proof of the Universality of Invariant/Equivariant Graph Neural Networkscited by 19
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2022: 9; 2023: 16; 2024: 24; 2025: 19; 2026: 8.
76 papers.
Sort:
By area:
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
- 2022Equivariance with Learned Canonicalization Functionscited by 109
- 2023On the Expressive Power of Geometric Graph Neural Networkscited by 90
- 2023Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulationcited by 52
- 2023A new perspective on building efficient and expressive 3D equivariant graph neural networkscited by 47
- 2024Equivariant Frames and the Impossibility of Continuous Canonicalizationcited by 43
- 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generationcited by 43
- 2024Equivariant Graph Neural Operator for Modeling 3D Dynamicscited by 38
- 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimizationcited by 37
- 2022A Systematic Survey of Chemical Pre-trained Modelscited by 34
- 2023A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretrainingcited by 32
38 more
- 2022Direct Molecular Conformation Generationcited by 30
- 2023Accurate transition state generation with an object-aware equivariant elementary reaction diffusion modelcited by 30
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applicationscited by 28
- 2024Doob's Lagrangian: A Sample-Efficient Variational Approach to Transition Path Samplingcited by 27
- 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamicscited by 23
- 2023Uncovering Neural Scaling Laws in Molecular Representation Learningcited by 23
- 2023Symmetry-Informed Geometric Representation for Molecules, Proteins, and Crystalline Materialscited by 22
- 2024Equivariance via Minimal Frame Averaging for More Symmetries and Efficiencycited by 19
- 2024Are High-Degree Representations Really Unnecessary in Equivariant Graph Neural Networks?cited by 18
- 2022Geometry-Complete Perceptron Networks for 3D Molecular Graphscited by 16
- 2025FEAT: Free energy Estimators with Adaptive Transportcited by 16
- 2024Beyond Canonicalization: How Tensorial Messages Improve Equivariant Message Passingcited by 15
- 2024Geometric Trajectory Diffusion Modelscited by 15
- 2022Graph Neural Network with Local Frame for Molecular Potential Energy Surfacecited by 14
- 2025Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systemscited by 14
- 2025E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Productscited by 12
- 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsitycited by 11
- 2022A Flexible Diffusion Modelcited by 10
- 2023Molecule Joint Auto-Encoding: Trajectory Pretraining with 2D and 3D Diffusioncited by 10
- 2024Weisfeiler Leman for Euclidean Equivariant Machine Learningcited by 10
- 2024AI-driven inverse design of materials: Past, present and futurecited by 10
- 2023Learning Over Molecular Conformer Ensembles: Datasets and Benchmarkscited by 9
- 2023M2Hub: Unlocking the Potential of Machine Learning for Materials Discoverycited by 8
- 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fieldscited by 7
- 2024On the Expressive Power of Sparse Geometric MPNNscited by 7
- 2025Unsupervised deep learning for semantic segmentation of multispectral LiDAR forest point cloudscited by 7
- 2024Equivariant Graph Network Approximations of High-Degree Polynomials for Force Field Predictioncited by 6
- 2024A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamicscited by 5
- 2024Morphological-Symmetry-Equivariant Heterogeneous Graph Neural Network for Robotic Dynamics Learningcited by 5
- 2023Xtal2DoS: Attention-based Crystal to Sequence Learning for Density of States Predictioncited by 4
- 2023Neural approximation of Wasserstein distance via a universal architecture for symmetric and factorwise group invariant functionscited by 4
- 2024Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networkscited by 4
- 2022Unifying O(3) Equivariant Neural Networks Design with Tensor-Network Formalismcited by 3
- 2023Why Deep Models Often cannot Beat Non-deep Counterparts on Molecular Property Prediction?cited by 3
- 2024Equivariant Blurring Diffusion for Hierarchical Molecular Conformer Generationcited by 3
- 2025Dynami-CAL GraphNet: A Physics-Informed Graph Neural Network Conserving Linear and Angular Momentum for Dynamical Systemscited by 3
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networkscited by 3
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fieldscited by 3
50 most cited of 76 All 76 (JSON)
- 2026EMERGE: Resolution-Agnostic Point Cloud Generation with Equivariant Graph-Based Diffusion22 Sep 2026
- 2026Rotational Equivariance in Machine Learning: A Comprehensive Tutorial31 Aug 2026
- 2026Temporal Sheaf Neural Networks with Dynamic Orthogonal Transport8 Jun 2026
- 2026A meshfree exterior calculus for generalizable and data-efficient learning of physics from point clouds8 May 2026
- 2026Metriplector: From Field Theory to Neural Architecture31 Mar 2026
- 2026HyQuRP: Hybrid quantum-classical neural network with rotational and permutational equivariance6 Feb 2026
- 2026Towards Multiscale Graph-based Protein Learning with Geometric Secondary Structural Motifs31 Jan 2026
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fields29 Jan 2026
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modeling5 Oct 2025
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks29 Sep 2025
- 2025Equi-RO: A 4D mmWave Radar Odometry via Equivariant Networks25 Sep 2025
- 2025Local-Canonicalization Equivariant Graph Neural Networks for Sample-Efficient and Generalizable Swarm Robot Control17 Sep 2025
38 more
- 2025Rapid training of Hamiltonian graph networks using random features6 Jun 2025
- 2025ModuLM: Enabling Modular and Multimodal Molecular Relational Learning with Large Language Models1 Jun 2025
- 2025Thickness-aware E(3)-Equivariant 3D Mesh Neural Networks27 May 2025
- 2025Equivariant Eikonal Neural Networks: Grid-Free, Scalable Travel-Time Prediction on Homogeneous Spaces21 May 2025
- 2025FEAT: Free energy Estimators with Adaptive Transport15 Apr 2025
- 2025CrystalFramer: Rethinking the Role of Frames for SE(3)-Invariant Crystal Structure Modeling4 Mar 2025
- 2025Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems26 Feb 2025
- 2025Unsupervised deep learning for semantic segmentation of multispectral LiDAR forest point clouds10 Feb 2025
- 2025Diagonal Symmetrization of Neural Network Solvers for the Many-Electron Schr"odinger Equation7 Feb 2025
- 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsity3 Feb 2025
- 2025E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Products31 Jan 2025
- 2025SIDDA: SInkhorn Dynamic Domain Adaptation for Image Classification with Equivariant Neural Networks23 Jan 2025
- 2025Dynami-CAL GraphNet: A Physics-Informed Graph Neural Network Conserving Linear and Angular Momentum for Dynamical Systems13 Jan 2025
- 2025AlphaNet: Scaling Up Local-frame-based Atomistic Interatomic Potential13 Jan 2025
- 2025TransPlace: Transferable Circuit Global Placement via Graph Neural Network10 Jan 2025
- 20243D Interaction Geometric Pre-training for Molecular Relational Learning4 Dec 2024
- 2024Morphological-Symmetry-Equivariant Heterogeneous Graph Neural Network for Robotic Dynamics Learning2 Dec 2024
- 2024AI-driven inverse design of materials: Past, present and future14 Nov 2024
- 2024Equivariant Graph Network Approximations of High-Degree Polynomials for Force Field Prediction6 Nov 2024
- 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generation29 Oct 2024
- 2024Equivariant Blurring Diffusion for Hierarchical Molecular Conformer Generation26 Oct 2024
- 2024Geometric Trajectory Diffusion Models16 Oct 2024
- 2024Are High-Degree Representations Really Unnecessary in Equivariant Graph Neural Networks?15 Oct 2024
- 2024Doob's Lagrangian: A Sample-Efficient Variational Approach to Transition Path Sampling10 Oct 2024
- 2024Equi-GSPR: Equivariant SE(3) Graph Network Model for Sparse Point Cloud Registration8 Oct 2024
- 2024On the Expressive Power of Sparse Geometric MPNNs2 Jul 2024
- 2024Equivariance via Minimal Frame Averaging for More Symmetries and Efficiency11 Jun 2024
- 2024Beyond Canonicalization: How Tensorial Messages Improve Equivariant Message Passing24 May 2024
- 2024A Survey on Vision-Language-Action Models for Embodied AI23 May 2024
- 2024Approximating invariant functions with the sorting trick is theoretically justified4 Mar 2024
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applications1 Mar 2024
- 2024Equivariant Frames and the Impossibility of Continuous Canonicalization25 Feb 2024
- 2024Weisfeiler Leman for Euclidean Equivariant Machine Learning4 Feb 2024
- 2024Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks3 Feb 2024
- 2024Diffusion-based Graph Generative Methods28 Jan 2024
- 2024A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamics26 Jan 2024
- 2024Accelerating Material Property Prediction using Generically Complete Isometry Invariants22 Jan 2024
- 2024Equivariant Graph Neural Operator for Modeling 3D Dynamics19 Jan 2024
50 newest of 76 All 76 (JSON)
- 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
- 2023Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulationcited by 52
- 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimizationcited by 37
- 2024Geometric Trajectory Diffusion Modelscited by 15
- 2022A Flexible Diffusion Modelcited by 10
- 2024Equivariant Blurring Diffusion for Hierarchical Molecular Conformer Generationcited by 3
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fieldscited by 3
- 2024Diffusion-based Graph Generative Methodscited by 2
- 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fields29 Jan 2026
- 2024Equivariant Blurring Diffusion for Hierarchical Molecular Conformer Generation26 Oct 2024
- 2024Geometric Trajectory Diffusion Models16 Oct 2024
- 2024Diffusion-based Graph Generative Methods28 Jan 2024
- 2023Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulation6 Sep 2023
- 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimization8 Feb 2023
- 2022Structure-based Drug Design with Equivariant Diffusion Models24 Oct 2022
- 2022A Flexible Diffusion Model17 Jun 2022
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2024A Survey on Vision-Language-Action Models for Embodied AI23 May 2024
- 2022Equivariance with Learned Canonicalization Functionscited by 109
- 2023On the Expressive Power of Geometric Graph Neural Networkscited by 90
- 2023A new perspective on building efficient and expressive 3D equivariant graph neural networkscited by 47
- 2024Equivariant Frames and the Impossibility of Continuous Canonicalizationcited by 43
- 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generationcited by 43
- 2024Equivariant Graph Neural Operator for Modeling 3D Dynamicscited by 38
- 2022A Systematic Survey of Chemical Pre-trained Modelscited by 34
- 2023A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretrainingcited by 32
- 2022Direct Molecular Conformation Generationcited by 30
- 2023Accurate transition state generation with an object-aware equivariant elementary reaction diffusion modelcited by 30
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applicationscited by 28
- 2024Doob's Lagrangian: A Sample-Efficient Variational Approach to Transition Path Samplingcited by 27
12 most cited of 66 All 66 (JSON)
- 2026EMERGE: Resolution-Agnostic Point Cloud Generation with Equivariant Graph-Based Diffusion22 Sep 2026
- 2026Rotational Equivariance in Machine Learning: A Comprehensive Tutorial31 Aug 2026
- 2026Temporal Sheaf Neural Networks with Dynamic Orthogonal Transport8 Jun 2026
- 2026A meshfree exterior calculus for generalizable and data-efficient learning of physics from point clouds8 May 2026
- 2026Metriplector: From Field Theory to Neural Architecture31 Mar 2026
- 2026HyQuRP: Hybrid quantum-classical neural network with rotational and permutational equivariance6 Feb 2026
- 2026Towards Multiscale Graph-based Protein Learning with Geometric Secondary Structural Motifs31 Jan 2026
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modeling5 Oct 2025
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks29 Sep 2025
- 2025Equi-RO: A 4D mmWave Radar Odometry via Equivariant Networks25 Sep 2025
- 2025Rapid training of Hamiltonian graph networks using random features6 Jun 2025
- 2025ModuLM: Enabling Modular and Multimodal Molecular Relational Learning with Large Language Models1 Jun 2025
12 newest of 66 All 66 (JSON)