Training a Foundation Model for Materials on a Budget
Not on the map. Why?
Abstract (arXiv)
Foundation models for materials modeling are advancing quickly, but their training remains expensive, often placing state-of-the-art methods out of reach for many research groups. We introduce Nequix, a compact E(3)-equivariant potential that pairs a simplified NequIP design with modern training practices, including equivariant root-mean-square layer normalization and the Muon optimizer, to retain accuracy while substantially reducing compute requirements. Nequix has 700K parameters and was trained in 100 A100 GPU-hours. On the Matbench-Discovery and MDR Phonon benchmarks, Nequix ranks third overall while requiring a 20 times lower training cost than most other methods, and it delivers two orders of magnitude faster inference speed than the current top-ranked model. We release model weights and fully reproducible codebase at https://github.com/atomicarchitects/nequix.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 22 Aug 2025.
Builds on
9 of 30 references.
References · 9
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2021Equinox: neural networks in JAX via callable PyTrees and filtered transformationscited by 143
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
- 2024Orb: A Fast, Scalable Neural Network Potentialcited by 63
- 2025An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networkscited by 19
- 2025High-performance training and inference for deep equivariant interatomic potentialscited by 17
- 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Productscited by 14
- 2025A Materials Foundation Model via Hybrid Invariant-Equivariant Architecturescited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformerscited by 7
- 2026MatRIS: Toward Reliable and Efficient Pretrained Machine Learning Interatomic Potentialscited by 6
- 2026PFT: Phonon Fine-tuning for Machine Learned Interatomic Potentialscited by 5
- 2026Beyond Adam: SOAP and Muon for Faster, Label-Efficient Training of Machine Learning Interatomic Potentialscited by 3
- 2026A strategic roadmap for an atomistic machine-learning ecosystemcited by 0
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalizationcited by 0
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalization7 Oct 2026
- 2026A strategic roadmap for an atomistic machine-learning ecosystem30 Sep 2026
- 2026Beyond Adam: SOAP and Muon for Faster, Label-Efficient Training of Machine Learning Interatomic Potentials2 Jul 2026
- 2026EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformers10 Apr 2026
- 2026MatRIS: Toward Reliable and Efficient Pretrained Machine Learning Interatomic Potentials2 Mar 2026
- 2026PFT: Phonon Fine-tuning for Machine Learned Interatomic Potentials12 Jan 2026