mlsanityData to 7 Oct 2026

Training a Foundation Model for Materials on a Budget

arXiv 2508.16067 ↗First posted 22 Aug 2025physics.comp-ph cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Foundation models for materials modeling are advancing quickly, but their training remains expensive, often placing state-of-the-art methods out of reach for many research groups. We introduce Nequix, a compact E(3)-equivariant potential that pairs a simplified NequIP design with modern training practices, including equivariant root-mean-square layer normalization and the Muon optimizer, to retain accuracy while substantially reducing compute requirements. Nequix has 700K parameters and was trained in 100 A100 GPU-hours. On the Matbench-Discovery and MDR Phonon benchmarks, Nequix ranks third overall while requiring a 20 times lower training cost than most other methods, and it delivers two orders of magnitude faster inference speed than the current top-ranked model. We release model weights and fully reproducible codebase at https://github.com/atomicarchitects/nequix.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 22 Aug 2025.

Builds on

9 of 30 references.

References · 9

  1. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  2. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
  3. 2021Equinox: neural networks in JAX via callable PyTrees and filtered transformationscited by 143
  4. 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
  5. 2024Orb: A Fast, Scalable Neural Network Potentialcited by 63
  6. 2025An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networkscited by 19
  7. 2025High-performance training and inference for deep equivariant interatomic potentialscited by 17
  8. 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Productscited by 14
  9. 2025A Materials Foundation Model via Hybrid Invariant-Equivariant Architecturescited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.