Augmenting Molecular Graphs with Geometries via Machine Learning Interatomic Potentials
Not on the map. Why?
Abstract (arXiv)
Accurate molecular property predictions require 3D geometries, which are typically obtained using expensive methods such as density functional theory (DFT). Here, we attempt to obtain molecular geometries by relying solely on machine learning interatomic potential (MLIP) models. To this end, we first curate a large-scale molecular relaxation dataset comprising 3.5 million molecules and 300 million snapshots. Then MLIP pre-trained models are trained with supervised learning to predict energy and forces given 3D molecular structures. Once trained, we show that the pre-trained models can be used in different ways to obtain geometries either explicitly or implicitly. First, it can be used to obtain approximate low-energy 3D geometries via geometry optimization. While these geometries do not consistently reach DFT-level chemical accuracy or convergence, they can still improve downstream performance compared to non-relaxed structures. To mitigate potential biases and enhance downstream predictions, we introduce geometry fine-tuning based on the relaxed 3D geometries. Second, the pre-trained models can be directly fine-tuned for property prediction when ground truth 3D geometries are available. Our results demonstrate that MLIP pre-trained models trained on relaxation data can learn transferable molecular representations to improve downstream molecular property prediction and can provide practically valuable but approximate molecular geometries that benefit property predictions. Our code is publicly available at: https://github.com/divelab/AIRS/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 48 references that are in the map. First posted on arXiv 1 Jul 2025.
Builds on
38 of 48 references.
References · 38
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Qwen Technical Reportcited by 3,273
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2021Scaling Vision Transformerscited by 993
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
26 more
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 328
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 179
- 2021Spherical Message Passing for 3D Graph Networkscited by 166
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
- 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 72
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
- 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
- 2023Fractional Denoising for 3D Molecular Pre-trainingcited by 33
- 2021Molecule3D: A Benchmark for Predicting 3D Geometries from Molecular Graphscited by 31
- 2023Highly Accurate Quantum Chemical Property Prediction with Uni-Mol+cited by 22
- 2023Sliced Denoising: A Physics-Informed Molecular Pre-Training Methodcited by 18
- 2024Generalizing Denoising to Non-Equilibrium Structures Improves Equivariant Force Fieldscited by 18
- 2022MolE: a molecular foundation model for drug discoverycited by 12
- 2024Equivariant Graph Network Approximations of High-Degree Polynomials for Force Field Predictioncited by 6
- 2023Gradual Optimization Learning for Conformational Energy Minimizationcited by 4
- 2024Advancements in Molecular Property Prediction: A Survey of Single and Multimodal Approachescited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.