ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations
Not on the map. Why?
Abstract (arXiv)
With massive amounts of atomic simulation data available, there is a huge opportunity to develop fast and accurate machine learning models to approximate expensive physics-based calculations. The key quantity to estimate is atomic forces, where the state-of-the-art Graph Neural Networks (GNNs) explicitly enforce basic physical constraints such as rotation-covariance. However, to strictly satisfy the physical constraints, existing models have to make tradeoffs between computational efficiency and model expressiveness. Here we explore an alternative approach. By not imposing explicit physical constraints, we can flexibly design expressive models while maintaining their computational efficiency. Physical constraints are implicitly imposed by training the models using physics-based data augmentation. To evaluate the approach, we carefully design a scalable and expressive GNN model, ForceNet, and apply it to OC20 (Chanussot et al., 2020), an unprecedentedly-large dataset of quantum physics calculations. Our proposed ForceNet is able to predict atomic forces more accurately than state-of-the-art physics-based GNNs while being faster both in training and inference. Overall, our promising and counter-intuitive results open up an exciting avenue for future research.
Key facts. Cited by 58 papers in the map (data through 14 Oct 2026). Builds on 22 of its 53 references that are in the map. First posted on arXiv 2 Mar 2021.
Builds on
22 of 53 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2016Layer Normalizationcited by 5,669
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
10 more
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2020Directional Message Passing for Molecular Graphscited by 561
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2018Neural Relational Inference for Interacting Systemscited by 339
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 255
- 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
- 2017Searching for Activation Functionscited by 169
- 2019GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulationcited by 75
- 2020An Introduction to Electrocatalyst Design using Machine Learning for Renewable Energy Storagecited by 45
- 2019Alchemy: A Quantum Chemistry Dataset for Benchmarking AI Modelscited by 36
Built on by
Citing papers per year: 2021: 7; 2022: 16; 2023: 12; 2024: 11; 2025: 7; 2026: 5.
58 papers.
Sort:
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 343
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 329
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 168
- 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulationscited by 95
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 84
- 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 73
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
- 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systemscited by 68
- 2022GemNet-OC: Developing Graph Neural Networks for Large and Diverse Molecular Simulation Datasetscited by 61
38 more
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarkscited by 53
- 2021Rotation Invariant Graph Neural Networks using Spin Convolutionscited by 52
- 2022Spherical Channels for Modeling Atomic Interactionscited by 47
- 2021Simple GNN Regularisation for 3D Molecular Property Prediction & Beyondcited by 44
- 2023Smooth, exact rotational symmetrization for deep learning on point cloudscited by 39
- 2021Graph Neural Networks Accelerated Molecular Dynamicscited by 33
- 2022Thermodynamics-informed graph neural networkscited by 33
- 2024A Survey of Generative AI for de novo Drug Design: New Frontiers in Molecule and Protein Generationcited by 29
- 2022Towards Training Billion Parameter Graph Neural Networks for Atomic Simulationscited by 25
- 2022Graph Neural Networks for Moleculescited by 21
- 2023Grounding Graph Network Simulators using Physical Sensor Observationscited by 15
- 2024Relaxed Equivariance via Multitask Learningcited by 13
- 2021Fast Quantum Property Prediction via Deeper 2D and 3D Graph Networkscited by 10
- 2023Data efficiency and extrapolation trends in neural network interatomic potentialscited by 10
- 2024AI-driven inverse design of materials: Past, present and futurecited by 10
- 2025How simple can you go? An off-the-shelf transformer approach to molecular dynamicscited by 10
- 2022Learned Force Fields Are Ready For Ground State Catalyst Discoverycited by 8
- 2024Stability-Aware Training of Machine Learning Force Fields with Differentiable Boltzmann Estimatorscited by 8
- 2024Baking Symmetry into GFlowNetscited by 7
- 2022PhAST: Physics-Aware, Scalable, and Task-specific GNNs for Accelerated Catalyst Designcited by 6
- 2022Learning Physics-Consistent Particle Interactionscited by 4
- 2023Molecular Geometry-aware Transformer for accurate 3D Atomic System modelingcited by 4
- 2023Transfer learning for atomistic simulations using GNNs and kernel mean embeddingscited by 4
- 2022Synthetic data enable experiments in atomistic machine learningcited by 3
- 2022Rotation-equivariant Graph Neural Networks for Learning Glassy Liquids Representationscited by 1
- 2023From Peptides to Nanostructures: A Euclidean Transformer for Fast and Stable Machine Learned Force Fieldscited by 1
- 2023On Training Derivative-Constrained Neural Networkscited by 1
- 2024FreeCG: Free the Design Space of Clebsch-Gordan Transform for Machine Learning Force Fieldscited by 1
- 2024Physics-Informed Weakly Supervised Learning for Interatomic Potentialscited by 1
- 2025Understanding the Capabilities of Molecular Graph Neural Networks in Materials Science Through Multimodal Learning and Physical Context Encodingcited by 1
- 2025Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learningcited by 1
- 2026Faster Molecular Dynamics with Neural Network Potentials via Distilled Multiple Time-Stepping and Non-Conservative Forcescited by 1
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulationscited by 1
- 2022Efficient Traffic State Forecasting using Spatio-Temporal Network Dependencies: A Sparse Graph Neural Network Approachcited by 0
- 2022Multi-view deep learning based molecule design and structural optimization accelerates the SARS-CoV-2 inhibitor discoverycited by 0
- 2023Spline-based neural network interatomic potentials: blending classical and machine learning modelscited by 0
- 2023Latent Task-Specific Graph Network Simulatorscited by 0
- 2024Pretraining Strategy for Neural Potentialscited by 0
50 most cited of 58 All 58 (JSON)
- 2026How Do Transformers Learn to Represent Symmetries?7 Oct 2026
- 2026Hessian-Informed Conformation Augmentation for Potential Energy Surface Curvature in Machine Learning Interatomic Potentials4 Sep 2026
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulations31 Jul 2026
- 2026The Convergence Frontier: Integrating Machine Learning and High Performance Quantum Computing for Next-Generation Drug Discovery18 Mar 2026
- 2026Faster Molecular Dynamics with Neural Network Potentials via Distilled Multiple Time-Stepping and Non-Conservative Forces16 Feb 2026
- 2025Learning Biomolecular Motion: The Physics-Informed Machine Learning Paradigm10 Nov 2025
- 2025Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning7 Nov 2025
- 2025Topological Feature Compression for Molecular Graph Neural Networks11 Aug 2025
- 2025Understanding the Capabilities of Molecular Graph Neural Networks in Materials Science Through Multimodal Learning and Physical Context Encoding17 May 2025
- 2025How simple can you go? An off-the-shelf transformer approach to molecular dynamics3 Mar 2025
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks20 Feb 2025
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction17 Feb 2025
38 more
- 2024Conformation Generation using Transformer Flows16 Nov 2024
- 2024AI-driven inverse design of materials: Past, present and future14 Nov 2024
- 2024Relaxed Equivariance via Multitask Learning23 Oct 2024
- 2024Physics-Informed Weakly Supervised Learning for Interatomic Potentials23 Jul 2024
- 2024Improving Molecular Modeling with Geometric GNNs: an Empirical Study11 Jul 2024
- 2024FreeCG: Free the Design Space of Clebsch-Gordan Transform for Machine Learning Force Fields2 Jul 2024
- 2024Baking Symmetry into GFlowNets8 Jun 2024
- 2024Ensemble Learning of Machine Learning Force Fields26 Mar 2024
- 2024Pretraining Strategy for Neural Potentials24 Feb 2024
- 2024Stability-Aware Training of Machine Learning Force Fields with Differentiable Boltzmann Estimators21 Feb 2024
- 2024A Survey of Generative AI for de novo Drug Design: New Frontiers in Molecule and Protein Generation13 Feb 2024
- 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems12 Dec 2023
- 2023Latent Task-Specific Graph Network Simulators9 Nov 2023
- 2023Spline-based neural network interatomic potentials: blending classical and machine learning models4 Oct 2023
- 2023On Training Derivative-Constrained Neural Networks2 Oct 2023
- 2023From Peptides to Nanostructures: A Euclidean Transformer for Fast and Stable Machine Learned Force Fields21 Sep 2023
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representations21 Jun 2023
- 2023Transfer learning for atomistic simulations using GNNs and kernel mean embeddings2 Jun 2023
- 2023Smooth, exact rotational symmetrization for deep learning on point clouds30 May 2023
- 2023FAENet: Frame Averaging Equivariant GNN for Materials Modeling28 Apr 2023
- 2023Grounding Graph Network Simulators using Physical Sensor Observations23 Feb 2023
- 2023Data efficiency and extrapolation trends in neural network interatomic potentials12 Feb 2023
- 2023Molecular Geometry-aware Transformer for accurate 3D Atomic System modeling2 Feb 2023
- 2022Multi-view deep learning based molecule design and structural optimization accelerates the SARS-CoV-2 inhibitor discovery3 Dec 2022
- 2022Synthetic data enable experiments in atomistic machine learning29 Nov 2022
- 2022PhAST: Physics-Aware, Scalable, and Task-specific GNNs for Accelerated Catalyst Design22 Nov 2022
- 2022Rotation-equivariant Graph Neural Networks for Learning Glassy Liquids Representations6 Nov 2022
- 2022Efficient Traffic State Forecasting using Spatio-Temporal Network Dependencies: A Sparse Graph Neural Network Approach6 Nov 2022
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulations13 Oct 2022
- 2022Learned Force Fields Are Ready For Ground State Catalyst Discovery26 Sep 2022
- 2022Graph Neural Networks for Molecules12 Sep 2022
- 2022Graph neural networks for materials science and chemistry5 Aug 2022
- 2022Spherical Channels for Modeling Atomic Interactions29 Jun 2022
- 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalysts17 Jun 2022
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphs17 Jun 2022
- 2022GemNet-OC: Developing Graph Neural Networks for Large and Diverse Molecular Simulation Datasets6 Apr 2022
- 2022Towards Training Billion Parameter Graph Neural Networks for Atomic Simulations18 Mar 2022
- 2022Thermodynamics-informed graph neural networks3 Mar 2022
50 newest of 58 All 58 (JSON)
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 343
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 329
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 168
- 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulationscited by 95
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 84
- 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 73
- 2022ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphscited by 69
- 2023A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systemscited by 68
- 2022GemNet-OC: Developing Graph Neural Networks for Large and Diverse Molecular Simulation Datasetscited by 61
12 most cited of 58 All 58 (JSON)
- 2026How Do Transformers Learn to Represent Symmetries?7 Oct 2026
- 2026Hessian-Informed Conformation Augmentation for Potential Energy Surface Curvature in Machine Learning Interatomic Potentials4 Sep 2026
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulations31 Jul 2026
- 2026The Convergence Frontier: Integrating Machine Learning and High Performance Quantum Computing for Next-Generation Drug Discovery18 Mar 2026
- 2026Faster Molecular Dynamics with Neural Network Potentials via Distilled Multiple Time-Stepping and Non-Conservative Forces16 Feb 2026
- 2025Learning Biomolecular Motion: The Physics-Informed Machine Learning Paradigm10 Nov 2025
- 2025Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning7 Nov 2025
- 2025Topological Feature Compression for Molecular Graph Neural Networks11 Aug 2025
- 2025Understanding the Capabilities of Molecular Graph Neural Networks in Materials Science Through Multimodal Learning and Physical Context Encoding17 May 2025
- 2025How simple can you go? An off-the-shelf transformer approach to molecular dynamics3 Mar 2025
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks20 Feb 2025
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction17 Feb 2025
12 newest of 58 All 58 (JSON)