mlsanityData to 7 Oct 2026

Higher-Rank Irreducible Cartesian Tensors for Equivariant Message Passing

arXiv 2405.14253 ↗First posted 23 May 2024cs.LG physics.comp-phcited by 13

Not on the map. Why?

Abstract (arXiv)

The ability to perform fast and accurate atomistic simulations is crucial for advancing the chemical sciences. By learning from high-quality data, machine-learned interatomic potentials achieve accuracy on par with ab initio and first-principles methods at a fraction of their computational cost. The success of machine-learned interatomic potentials arises from integrating inductive biases such as equivariance to group actions on an atomic system, e.g., equivariance to rotations and reflections. In particular, the field has notably advanced with the emergence of equivariant message passing. Most of these models represent an atomic system using spherical tensors, tensor products of which require complicated numerical coefficients and can be computationally demanding. Cartesian tensors offer a promising alternative, though state-of-the-art methods lack flexibility in message-passing mechanisms, restricting their architectures and expressive power. This work explores higher-rank irreducible Cartesian tensors to address these limitations. We integrate irreducible Cartesian tensor products into message-passing neural networks and prove the equivariance and traceless property of the resulting layers. Through empirical evaluations on various benchmark data sets, we consistently observe on-par or better performance than that of state-of-the-art spherical and Cartesian models.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 40 of its 92 references that are in the map. First posted on arXiv 23 May 2024.

Builds on

40 of 92 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  3. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  4. 2021E(n) Equivariant Graph Neural Networkscited by 951
  5. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  6. 2019On the Convergence of Adam and Beyondcited by 834
  7. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  8. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  9. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  10. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
  11. 2020Directional Message Passing for Molecular Graphscited by 556
  12. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
28 more
  1. 2017Representation Learning on Graphs: Methods and Applicationscited by 456
  2. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
  3. 2018Deep Learning on Graphs: A Surveycited by 393
  4. 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
  5. 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
  6. 2019Cormorant: Covariant Molecular Neural Networkscited by 262
  7. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
  8. 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
  9. 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
  10. 2020Machine Learning Force Fieldscited by 204
  11. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
  12. 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
  13. 2021Spherical Message Passing for 3D Graph Networkscited by 166
  14. 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
  15. 2019A Gentle Introduction to Deep Learning for Graphscited by 107
  16. 2022The Design Space of E(3)-Equivariant Atom-Centered Interatomic Potentialscited by 100
  17. 2023On the Expressive Power of Geometric Graph Neural Networkscited by 89
  18. 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systemscited by 65
  19. 2023TensorNet: Cartesian Tensor Representations for Efficient Learning of Molecular Potentialscited by 53
  20. 2020An Introduction to Electrocatalyst Design using Machine Learning for Renewable Energy Storagecited by 45
  21. 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
  22. 2024Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Productscited by 35
  23. 2024Cartesian atomic cluster expansion for machine learning interatomic potentialscited by 31
  24. 2023Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Sciencecited by 25
  25. 2021Gaussian Moments as Physically Inspired Molecular Descriptors for Accurate and Scalable Machine Learning Potentialscited by 15
  26. 2020Representations of molecules and materials for interpolation of quantum-mechanical simulations via machine learningcited by 11
  27. 2021Fast and Sample-Efficient Interatomic Neural Network Potentials for Molecules and Materials Based on Gaussian Momentscited by 9
  28. 2024Energy-conserving equivariant GNN for elasticity of lattice architected metamaterialscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 10; 2026: 2.

13 papers.

Sort:

By area: