Mixture of Experts Framework in Machine Learning Interatomic Potentials for Atomistic Simulations
On the map: Mixture-of-experts → MoE theory and gating functions
Abstract (arXiv)
First-principles atomistic simulations are essential for understanding complex material phenomena but are fundamentally limited by their computational cost. While Machine Learning Interatomic Potentials (MLIPs) have drastically improved cost for a given accuracy, their inference cost remains a bottleneck for massive systems or long timescales. To address this, we introduce a multifidelity "Mixture-of-Experts" framework based on the E(3)-equivariant Allegro architecture. Our method spatially partitions the simulation domain into a chemically complex region (e.g., reactive interfaces) and a simple region (e.g., bulk lattice), assigning models of varying capacity to each. Among the challenges in such static domain decomposition, the mechanical mismatch between models at the interface is particularly critical, as it can generate artificial stress fields and instability. We address this challenge with a co-training strategy in which the loss function includes agreement constraints -- penalties on per-atom energy and force discrepancies between models evaluated on shared bulk environments -- forcing the independent models to learn a consistent physical description of the bulk material. We validate this approach on a realistic Pt+CO catalytic system, demonstrating that the co-trained models maintain exact energy conservation, align their bulk mechanical response (e.g., equation of state and bulk modulus), and achieve predictive accuracy comparable to a full high-fidelity simulation at more than twice the computational speed.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in MoE theory and gating functions, one of 12 directions in Mixture-of-experts. Builds on 8 of its 25 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
8 of 25 references.
Closest ancestors · 1
Same direction, newest first
Other references · 7
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
- 2025UMA: A Family of Universal Models for Atomscited by 99
- 2025High-performance training and inference for deep equivariant interatomic potentialscited by 17
- 2024Mixture of Diverse Size Expertscited by 4
- 2025Efficient and Accurate Spatial Mixing of Machine Learned Interatomic Potentials for Materials Sciencecited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Breaking the Training Barrier of Billion-Parameter Universal Machine Learning Interatomic Potentials
- 2026Lang2MLIP: End-to-End Language-to-Machine Learning Interatomic Potential Development with Autonomous Agentic Workflows
- 2026MLIPilot: LLM-Driven Auto-Research for Machine-Learned Interatomic Potentials
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligence
- 2026El Agente Potente: High-Throughput Agentic Atomistic Simulations
- 2025Automated Machine Learning Pipeline: Large Language Models-Assisted Automated Dataset Generation for Training Machine-Learned Interatomic Potentials
- 2026Equivariant Evidential Deep Learning for Interatomic Potentials
- 2026Harnessing AtomisticSkills for Agentic Atomistic Research