mlsanityData to 14 Oct 2026

SE(3) Equivariant Graph Neural Networks with Complete Local Frames

arXiv 2110.14811 ↗First posted 26 Oct 2021cs.CE cs.AI cs.LGcited by 76

Not on the map. Why?

Abstract (arXiv)

Group equivariance (e.g. SE(3) equivariance) is a critical physical symmetry in science, from classical and quantum physics to computational biology. It enables robust and accurate prediction under arbitrary reference transformations. In light of this, great efforts have been put on encoding this symmetry into deep neural networks, which has been shown to improve the generalization performance and data efficiency for downstream tasks. Constructing an equivariant neural network generally brings high computational costs to ensure expressiveness. Therefore, how to better trade-off the expressiveness and computational efficiency plays a core role in the design of the equivariant deep learning models. In this paper, we propose a framework to construct SE(3) equivariant graph neural networks that can approximate the geometric quantities efficiently. Inspired by differential geometry and physics, we introduce equivariant local complete frames to graph neural networks, such that tensor information at given orders can be projected onto the frames. The local frame is constructed to form an orthonormal basis that avoids direction degeneration and ensure completeness. Since the frames are built only by cross product operations, our method is computationally efficient. We evaluate our method on two tasks: Newton mechanics modeling and equilibrium molecule conformation generation. Extensive experimental results demonstrate that our model achieves the best or competitive performance in two types of datasets.

Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). Builds on 53 of its 75 references that are in the map. First posted on arXiv 26 Oct 2021.

Builds on

53 of 75 references.

References · 53

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2018How Powerful are Graph Neural Networks?cited by 4,393
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  8. 2016Group Equivariant Convolutional Networkscited by 1,165
  9. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  10. 2021E(n) Equivariant Graph Neural Networkscited by 965
  11. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  12. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
38 more
  1. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
  2. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
  3. 2020Directional Message Passing for Molecular Graphscited by 561
  4. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  5. 2018Spherical CNNscited by 456
  6. 2019General E(2)-Equivariant Steerable CNNscited by 446
  7. 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
  8. 2018Invariant and Equivariant Graph Networkscited by 346
  9. 2016Steerable CNNscited by 305
  10. 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
  11. 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 300
  12. 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
  13. 2019Cormorant: Covariant Molecular Neural Networkscited by 263
  14. 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
  15. 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 243
  16. 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
  17. 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
  18. 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 194
  19. 2019Universal Invariant and Equivariant Graph Neural Networkscited by 183
  20. 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 171
  21. 2021Learning Gradient Fields for Molecular Conformation Generationcited by 163
  22. 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 121
  23. 2021GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensemblescited by 107
  24. 2020LieTransformer: Equivariant self-attention for Lie Groupscited by 100
  25. 2019B-Spline CNNs on Lie Groupscited by 97
  26. 2016Exploiting Cyclic Symmetry in Convolutional Neural Networkscited by 91
  27. 2021Learning Neural Generative Dynamics for Molecular Conformation Generationcited by 88
  28. 2020On the Universality of Rotation Equivariant Point Cloud Networkscited by 80
  29. 2020Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODEcited by 76
  30. 2019A Generative Model for Molecular Distance Geometrycited by 73
  31. 2020On Second Order Behaviour in Augmented Neural ODEscited by 68
  32. 2020Attentive Group Equivariant Convolutional Networkscited by 63
  33. 2018CubeNet: Equivariance to 3D Rotation and Translationcited by 59
  34. 2019Equivariant Flows: sampling configurations for multi-body systems with symmetric energiescited by 57
  35. 2020Spin-Weighted Spherical CNNscited by 50
  36. 2019Equivariant Multi-View Networkscited by 45
  37. 2020PDO-eConvs: Partial Differential Operator Based Equivariant Convolutionscited by 34
  38. 2019A Simple Proof of the Universality of Invariant/Equivariant Graph Neural Networkscited by 19

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 9; 2023: 16; 2024: 24; 2025: 19; 2026: 8.

76 papers.

Sort:

By area:

  1. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
  2. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
  3. 2022Equivariance with Learned Canonicalization Functionscited by 109
  4. 2023On the Expressive Power of Geometric Graph Neural Networkscited by 90
  5. 2023Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulationcited by 52
  6. 2023A new perspective on building efficient and expressive 3D equivariant graph neural networkscited by 47
  7. 2024Equivariant Frames and the Impossibility of Continuous Canonicalizationcited by 43
  8. 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generationcited by 43
  9. 2024Equivariant Graph Neural Operator for Modeling 3D Dynamicscited by 38
  10. 2023Geometry-Complete Diffusion for 3D Molecule Generation and Optimizationcited by 37
  11. 2022A Systematic Survey of Chemical Pre-trained Modelscited by 34
  12. 2023A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretrainingcited by 32
38 more
  1. 2022Direct Molecular Conformation Generationcited by 30
  2. 2023Accurate transition state generation with an object-aware equivariant elementary reaction diffusion modelcited by 30
  3. 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applicationscited by 28
  4. 2024Doob's Lagrangian: A Sample-Efficient Variational Approach to Transition Path Samplingcited by 27
  5. 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamicscited by 23
  6. 2023Uncovering Neural Scaling Laws in Molecular Representation Learningcited by 23
  7. 2023Symmetry-Informed Geometric Representation for Molecules, Proteins, and Crystalline Materialscited by 22
  8. 2024Equivariance via Minimal Frame Averaging for More Symmetries and Efficiencycited by 19
  9. 2024Are High-Degree Representations Really Unnecessary in Equivariant Graph Neural Networks?cited by 18
  10. 2022Geometry-Complete Perceptron Networks for 3D Molecular Graphscited by 16
  11. 2025FEAT: Free energy Estimators with Adaptive Transportcited by 16
  12. 2024Beyond Canonicalization: How Tensorial Messages Improve Equivariant Message Passingcited by 15
  13. 2024Geometric Trajectory Diffusion Modelscited by 15
  14. 2022Graph Neural Network with Local Frame for Molecular Potential Energy Surfacecited by 14
  15. 2025Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systemscited by 14
  16. 2025E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Productscited by 12
  17. 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsitycited by 11
  18. 2022A Flexible Diffusion Modelcited by 10
  19. 2023Molecule Joint Auto-Encoding: Trajectory Pretraining with 2D and 3D Diffusioncited by 10
  20. 2024Weisfeiler Leman for Euclidean Equivariant Machine Learningcited by 10
  21. 2024AI-driven inverse design of materials: Past, present and futurecited by 10
  22. 2023Learning Over Molecular Conformer Ensembles: Datasets and Benchmarkscited by 9
  23. 2023M2Hub: Unlocking the Potential of Machine Learning for Materials Discoverycited by 8
  24. 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fieldscited by 7
  25. 2024On the Expressive Power of Sparse Geometric MPNNscited by 7
  26. 2025Unsupervised deep learning for semantic segmentation of multispectral LiDAR forest point cloudscited by 7
  27. 2024Equivariant Graph Network Approximations of High-Degree Polynomials for Force Field Predictioncited by 6
  28. 2024A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamicscited by 5
  29. 2024Morphological-Symmetry-Equivariant Heterogeneous Graph Neural Network for Robotic Dynamics Learningcited by 5
  30. 2023Xtal2DoS: Attention-based Crystal to Sequence Learning for Density of States Predictioncited by 4
  31. 2023Neural approximation of Wasserstein distance via a universal architecture for symmetric and factorwise group invariant functionscited by 4
  32. 2024Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networkscited by 4
  33. 2022Unifying O(3) Equivariant Neural Networks Design with Tensor-Network Formalismcited by 3
  34. 2023Why Deep Models Often cannot Beat Non-deep Counterparts on Molecular Property Prediction?cited by 3
  35. 2024Equivariant Blurring Diffusion for Hierarchical Molecular Conformer Generationcited by 3
  36. 2025Dynami-CAL GraphNet: A Physics-Informed Graph Neural Network Conserving Linear and Angular Momentum for Dynamical Systemscited by 3
  37. 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networkscited by 3
  38. 2026Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fieldscited by 3

50 most cited of 76 All 76 (JSON)