Algorithmic Differentiation for Automated Modeling of Machine Learned Force Fields
Not on the map. Why?
Abstract (arXiv)
Reconstructing force fields (FFs) from atomistic simulation data is a challenge since accurate data can be highly expensive. Here, machine learning (ML) models can help to be data economic as they can be successfully constrained using the underlying symmetry and conservation laws of physics. However, so far, every descriptor newly proposed for an ML model has required a cumbersome and mathematically tedious remodeling. We therefore propose using modern techniques from algorithmic differentiation within the ML modeling process -- effectively enabling the usage of novel descriptors or models fully automatically at an order of magnitude higher computational efficiency. This paradigmatic approach enables not only a versatile usage of novel representations and the efficient computation of larger systems -- all of high value to the FF community -- but also the simple inclusion of further physical knowledge such as higher-order information (e.g. Hessians, more complex partial differential equations constraints etc.), even beyond the presented FF domain.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 26 of its 65 references that are in the map. First posted on arXiv 25 Aug 2022.
Builds on
26 of 65 references.
References · 26
- 2015Automatic differentiation in machine learning: a surveycited by 855
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2019Hamiltonian Neural Networkscited by 712
- 2021Machine learning accelerated computational fluid dynamicscited by 471
- 2015Deep Kernel Learningcited by 445
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
- 2020Lagrangian Neural Networkscited by 398
- 2019Machine Learning for Fluid Mechanicscited by 385
- 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
- 2020Machine Learning Force Fieldscited by 207
- 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 148
- 2017Machine Learning of Linear Differential Equations using Gaussian Processescited by 140
14 more
- 2017VAMPnets: Deep learning of molecular kineticscited by 136
- 2019Machine learning for molecular simulationcited by 110
- 2021SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effectscited by 104
- 2020Equivariant flow-based sampling for lattice gauge theorycited by 103
- 2021SE(3)-equivariant prediction of molecular wavefunctions and electronic densitiescited by 67
- 2013Density Estimation in Infinite Dimensional Exponential Familiescited by 42
- 2017Linearly constrained Gaussian processescited by 42
- 2020Gauge equivariant neural networks for quantum lattice gauge theoriescited by 28
- 2018Scaling Gaussian Process Regression with Derivativescited by 27
- 2020Nonparametric Score Estimatorscited by 23
- 2021High-Dimensional Gaussian Process Inference with Derivativescited by 16
- 2020Linearly Constrained Gaussian Processes with Boundary Conditionscited by 14
- 2020Probabilistic Numeric Convolutional Neural Networkscited by 10
- 2021Symmetric and antisymmetric kernels for machine learning problems in quantum physics and chemistrycited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 1; 2025: 0; 2026: 1.
7 papers.
- 2024Hessian QM9: A quantum chemistry database of molecular Hessians in implicit solventscited by 7
- 2023Transfer learning for atomistic simulations using GNNs and kernel mean embeddingscited by 4
- 2022Reconstructing Kernel-based Machine Learning Force Fields with Super-linear Convergencecited by 2
- 2023Stress and heat flux via automatic differentiationcited by 1
- 2023From Peptides to Nanostructures: A Euclidean Transformer for Fast and Stable Machine Learned Force Fieldscited by 1
- 2023Scaling up machine learning-based chemical plant simulation: A method for fine-tuning a model to induce stable fixed pointscited by 0
- 2026A Tutorial Review of Bayesian Optimization with Gaussian Processes to Accelerate Stationary Point Searchescited by 0
- 2026A Tutorial Review of Bayesian Optimization with Gaussian Processes to Accelerate Stationary Point Searches11 Mar 2026
- 2024Hessian QM9: A quantum chemistry database of molecular Hessians in implicit solvents15 Aug 2024
- 2023From Peptides to Nanostructures: A Euclidean Transformer for Fast and Stable Machine Learned Force Fields21 Sep 2023
- 2023Scaling up machine learning-based chemical plant simulation: A method for fine-tuning a model to induce stable fixed points25 Jul 2023
- 2023Transfer learning for atomistic simulations using GNNs and kernel mean embeddings2 Jun 2023
- 2023Stress and heat flux via automatic differentiation2 May 2023
- 2022Reconstructing Kernel-based Machine Learning Force Fields with Super-linear Convergence24 Dec 2022