LunaTP: Enabling Efficient and Scalable Tensor Product for Equivariant MLIPs
Not on the map. Why?
Abstract (arXiv)
Equivariant machine learning interatomic potentials (MLIPs) promise atomistic simulations with accuracy approaching that of quantum-mechanical calculations. However, the high computational cost of their core Clebsch--Gordan tensor product (CGTP) convolutions severely limits model scalability and efficiency. In this paper, we rethink the parallel execution of CGTP convolutions and introduce LunaTP. Built on node-centric execution, LunaTP exploits path-group parallelism and multi-level reuse to accelerate CGTP convolutions and higher-order derivative computation while preserving the underlying mathematical formulation. On an NVIDIA H100 GPU, LunaTP achieves kernel speedups of up to 250.0× over e3nn and 17.1× over OpenEquivariance. It also delivers end-to-end training throughput gains of up to 28.7× over e3nn and 3.11× over OpenEquivariance. Finally, LunaTP demonstrates scalability and robust performance across models, workload scales, and GPUs, delivering substantial acceleration for training and atomistic simulation with high-accuracy equivariant MLIPs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
16 of 26 references.
References · 16
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
- 2020Directional Message Passing for Molecular Graphscited by 561
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 117
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 84
- 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Modelscited by 52
- 2024Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Productscited by 36
- 2025An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networkscited by 22
- 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Productscited by 15
4 more
- 2026MatRIS: Toward Reliable and Efficient Pretrained Machine Learning Interatomic Potentialscited by 7
- 2025Spectral/Spatial Tensor Atomic Cluster Expansion with Universal Embeddings in Cartesian Spacecited by 6
- 2026PFT: Phonon Fine-tuning for Machine Learned Interatomic Potentialscited by 6
- 2025Bayesian E(3)-Equivariant Interatomic Potential with Iterative Restratification of Many-body Message Passingcited by 3
Built on by
Not cited yet.