Higher-Rank Irreducible Cartesian Tensors for Equivariant Message Passing
Not on the map. Why?
Abstract (arXiv)
The ability to perform fast and accurate atomistic simulations is crucial for advancing the chemical sciences. By learning from high-quality data, machine-learned interatomic potentials achieve accuracy on par with ab initio and first-principles methods at a fraction of their computational cost. The success of machine-learned interatomic potentials arises from integrating inductive biases such as equivariance to group actions on an atomic system, e.g., equivariance to rotations and reflections. In particular, the field has notably advanced with the emergence of equivariant message passing. Most of these models represent an atomic system using spherical tensors, tensor products of which require complicated numerical coefficients and can be computationally demanding. Cartesian tensors offer a promising alternative, though state-of-the-art methods lack flexibility in message-passing mechanisms, restricting their architectures and expressive power. This work explores higher-rank irreducible Cartesian tensors to address these limitations. We integrate irreducible Cartesian tensor products into message-passing neural networks and prove the equivariance and traceless property of the resulting layers. Through empirical evaluations on various benchmark data sets, we consistently observe on-par or better performance than that of state-of-the-art spherical and Cartesian models.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 40 of its 92 references that are in the map. First posted on arXiv 23 May 2024.
Builds on
40 of 92 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2019On the Convergence of Adam and Beyondcited by 834
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
28 more
- 2017Representation Learning on Graphs: Methods and Applicationscited by 456
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
- 2018Deep Learning on Graphs: A Surveycited by 393
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2019Cormorant: Covariant Molecular Neural Networkscited by 262
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2020Machine Learning Force Fieldscited by 204
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
- 2021Spherical Message Passing for 3D Graph Networkscited by 166
- 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
- 2019A Gentle Introduction to Deep Learning for Graphscited by 107
- 2022The Design Space of E(3)-Equivariant Atom-Centered Interatomic Potentialscited by 100
- 2023On the Expressive Power of Geometric Graph Neural Networkscited by 89
- 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systemscited by 65
- 2023TensorNet: Cartesian Tensor Representations for Efficient Learning of Molecular Potentialscited by 53
- 2020An Introduction to Electrocatalyst Design using Machine Learning for Renewable Energy Storagecited by 45
- 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
- 2024Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Productscited by 35
- 2024Cartesian atomic cluster expansion for machine learning interatomic potentialscited by 31
- 2023Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Sciencecited by 25
- 2021Gaussian Moments as Physically Inspired Molecular Descriptors for Accurate and Scalable Machine Learning Potentialscited by 15
- 2020Representations of molecules and materials for interpolation of quantum-mechanical simulations via machine learningcited by 11
- 2021Fast and Sample-Efficient Interatomic Neural Network Potentials for Molecules and Materials Based on Gaussian Momentscited by 9
- 2024Energy-conserving equivariant GNN for elasticity of lattice architected metamaterialscited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 10; 2026: 2.
13 papers.
Sort:
By area:
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarkscited by 52
- 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Productscited by 14
- 2025Learning (Approximately) Equivariant Networks via Constrained Optimizationcited by 10
- 2024High-Rank Irreducible Cartesian Tensor Decomposition and Bases of Equivariant Spacescited by 6
- 2025Spectral/Spatial Tensor Atomic Cluster Expansion with Universal Embeddings in Cartesian Spacecited by 5
- 2025Rao-Blackwell Gradient Estimators for Equivariant Denoising Diffusioncited by 4
- 2025Geometric Kolmogorov-Arnold Superposition Theoremcited by 2
- 2025Fast, Modular, and Differentiable Framework for Machine Learning-Enhanced Molecular Simulationscited by 2
- 2025A Cartesian-3j Framework for Machine Learning Interatomic Potentialscited by 2
- 2026Geometric Algebra Meets Cartesian Tensors: Higher-Order Equivariance for Interatomic Potentialscited by 1
- 2025Performance of universal machine-learned potentials with explicit long-range interactions in biomolecular simulationscited by 0
- 2025Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modelingcited by 0
1 more
- 2026The parity gap in crystal tensor predictioncited by 0
- 2026The parity gap in crystal tensor prediction19 Aug 2026
- 2026Geometric Algebra Meets Cartesian Tensors: Higher-Order Equivariance for Interatomic Potentials28 Jun 2026
- 2025A Cartesian-3j Framework for Machine Learning Interatomic Potentials18 Dec 2025
- 2025Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modeling25 Oct 2025
- 2025Spectral/Spatial Tensor Atomic Cluster Expansion with Universal Embeddings in Cartesian Space18 Sep 2025
- 2025Performance of universal machine-learned potentials with explicit long-range interactions in biomolecular simulations14 Aug 2025
- 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products16 Jun 2025
- 2025Learning (Approximately) Equivariant Networks via Constrained Optimization19 May 2025
- 2025Fast, Modular, and Differentiable Framework for Machine Learning-Enhanced Molecular Simulations26 Mar 2025
- 2025Geometric Kolmogorov-Arnold Superposition Theorem23 Feb 2025
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks20 Feb 2025
- 2025Rao-Blackwell Gradient Estimators for Equivariant Denoising Diffusion14 Feb 2025
1 more
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarkscited by 52
- 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Productscited by 14
- 2025Learning (Approximately) Equivariant Networks via Constrained Optimizationcited by 10
- 2024High-Rank Irreducible Cartesian Tensor Decomposition and Bases of Equivariant Spacescited by 6
- 2025Spectral/Spatial Tensor Atomic Cluster Expansion with Universal Embeddings in Cartesian Spacecited by 5
- 2025Geometric Kolmogorov-Arnold Superposition Theoremcited by 2
- 2025Fast, Modular, and Differentiable Framework for Machine Learning-Enhanced Molecular Simulationscited by 2
- 2025A Cartesian-3j Framework for Machine Learning Interatomic Potentialscited by 2
- 2026Geometric Algebra Meets Cartesian Tensors: Higher-Order Equivariance for Interatomic Potentialscited by 1
- 2025Performance of universal machine-learned potentials with explicit long-range interactions in biomolecular simulationscited by 0
- 2025Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modelingcited by 0
- 2026The parity gap in crystal tensor predictioncited by 0
- 2026The parity gap in crystal tensor prediction19 Aug 2026
- 2026Geometric Algebra Meets Cartesian Tensors: Higher-Order Equivariance for Interatomic Potentials28 Jun 2026
- 2025A Cartesian-3j Framework for Machine Learning Interatomic Potentials18 Dec 2025
- 2025Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modeling25 Oct 2025
- 2025Spectral/Spatial Tensor Atomic Cluster Expansion with Universal Embeddings in Cartesian Space18 Sep 2025
- 2025Performance of universal machine-learned potentials with explicit long-range interactions in biomolecular simulations14 Aug 2025
- 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products16 Jun 2025
- 2025Learning (Approximately) Equivariant Networks via Constrained Optimization19 May 2025
- 2025Fast, Modular, and Differentiable Framework for Machine Learning-Enhanced Molecular Simulations26 Mar 2025
- 2025Geometric Kolmogorov-Arnold Superposition Theorem23 Feb 2025
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks20 Feb 2025
- 2024High-Rank Irreducible Cartesian Tensor Decomposition and Bases of Equivariant Spaces24 Dec 2024