# MOFSimBench: Evaluating Universal Machine Learning Interatomic Potentials In Metal--Organic Framework Molecular Modeling

arXiv: https://arxiv.org/abs/2507.11806 · HTML: https://mlsanity.com/paper/2507.11806/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 129 references that are in the map.
- First posted on arXiv 16 Jul 2025.

## Builds on (most cited first, 13 of 13)

- [Learning to Simulate Complex Physics with Graph Networks](https://mlsanity.com/paper/2002.09405/) (2020)
- [E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials](https://mlsanity.com/paper/2101.03164/) (2021)
- [SchNet: A continuous-filter convolutional neural network for modeling quantum interactions](https://mlsanity.com/paper/1706.08566/) (2017)
- [EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representations](https://mlsanity.com/paper/2306.12059/) (2023)
- [Machine learning for molecular simulation](https://mlsanity.com/paper/1911.02792/) (2019)
- [Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction](https://mlsanity.com/paper/2502.12147/) (2025)
- [Orb: A Fast, Scalable Neural Network Potential](https://mlsanity.com/paper/2410.22570/) (2024)
- [Scaling the leading accuracy of deep equivariant models to biomolecular simulations of realistic size](https://mlsanity.com/paper/2304.10061/) (2023)
- [The dark side of the forces: assessing non-conservative force models for atomistic machine learning](https://mlsanity.com/paper/2412.11569/) (2024)
- [AiiDA: Automated Interactive Infrastructure and Database for Computational Science](https://mlsanity.com/paper/1504.01163/) (2015)
- [The Open DAC 2023 Dataset and Challenges for Sorbent Discovery in Direct Air Capture](https://mlsanity.com/paper/2311.00341/) (2023)
- [A generative artificial intelligence framework based on a molecular diffusion model for the design of metal-organic frameworks for carbon capture](https://mlsanity.com/paper/2306.08695/) (2023)
- [Hydrogen under Pressure as a Benchmark for Machine-Learning Interatomic Potentials](https://mlsanity.com/paper/2409.13390/) (2024)

## Built on by (most cited first, 7 of 7)

- [The Rise of Generative AI for Metal-Organic Framework Design and Synthesis](https://mlsanity.com/paper/2508.13197/) (2025)
- [Mofasa: A Step Change in Metal-Organic Framework Generation](https://mlsanity.com/paper/2512.01756/) (2025)
- [Generalization of Long-Range Machine Learning Potentials in Complex Chemical Spaces](https://mlsanity.com/paper/2512.10989/) (2025)
- [Inverse Design of Inorganic Compounds with Generative AI](https://mlsanity.com/paper/2604.11827/) (2026)
- [Breaking the Training Barrier of Billion-Parameter Universal Machine Learning Interatomic Potentials](https://mlsanity.com/paper/2604.15821/) (2026)
- [MLIP Detective: Active Failure Mode Discovery Beyond Benchmark Scores for Machine-Learning Interatomic Potentials](https://mlsanity.com/paper/2609.08399/) (2026)
- [GLASS: Global Latent Aggregation with Slot-based Set Decoding for Scalable All-Atom Crystal Generation](https://mlsanity.com/paper/2609.37158/) (2026)

## Abstract (arXiv)

Universal machine learning interatomic potentials (uMLIPs) have emerged as powerful tools for accelerating atomistic simulations, offering scalable and efficient modeling with accuracy close to quantum calculations. However, their reliability and effectiveness in practical, real-world applications remain an open question. Metal-organic frameworks (MOFs) and related nanoporous materials are highly porous crystals with critical relevance in carbon capture, energy storage, and catalysis applications. Modeling nanoporous materials presents distinct challenges for uMLIPs due to their diverse chemistry, structural complexity, including porosity and coordination bonds, and the absence from existing training datasets. Here, we introduce MOFSimBench, a benchmark to evaluate uMLIPs on key materials modeling tasks for nanoporous materials, including structural optimization, molecular dynamics (MD) stability, the prediction of bulk properties, such as bulk modulus and heat capacity, and guest-host interactions. Evaluating over 20 models from various architectures on a chemically and structurally diverse materials set, we find that top-performing uMLIPs consistently outperform classical force fields and fine-tuned machine learning potentials across all tasks, demonstrating their readiness for deployment in nanoporous materials modeling. Our analysis highlights that data quality, particularly the diversity of training sets and inclusion of out-of-equilibrium conformations, plays a more critical role than model architecture in determining performance across all evaluated uMLIPs. We release our modular and extendable benchmarking framework at https://github.com/AI4ChemS/mofsim-bench, providing an open resource to guide the adoption for nanoporous materials modeling and further development of uMLIPs.
