Differentiable sampling of molecular geometries with uncertainty-based adversarial attacks
Not on the map. Why?
Abstract (arXiv)
Neural network (NN) interatomic potentials provide fast prediction of potential energy surfaces, closely matching the accuracy of the electronic structure methods used to produce the training data. However, NN predictions are only reliable within well-learned training domains, and show volatile behavior when extrapolating. Uncertainty quantification approaches can flag atomic configurations for which prediction confidence is low, but arriving at such uncertain regions requires expensive sampling of the NN phase space, often using atomistic simulations. Here, we exploit automatic differentiation to drive atomistic systems towards high-likelihood, high-uncertainty configurations without the need for molecular dynamics simulations. By performing adversarial attacks on an uncertainty metric, informative geometries that expand the training domain of NNs are sampled. When combined to an active learning loop, this approach bootstraps and improves NN potentials while decreasing the number of calls to the ground truth method. This efficiency is demonstrated on sampling of kinetic barriers and collective variables in molecules, and can be extended to any NN potential architecture and materials system.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 19 of its 95 references that are in the map. First posted on arXiv 27 Jan 2021.
Builds on
19 of 95 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2018Adversarial Attacks on Neural Networks for Graph Datacited by 395
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
- 2020How Neural Networks Extrapolate: From Feedforward to Graph Neural Networkscited by 218
- 2017Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanicscited by 213
7 more
- 2018When Gaussian Process Meets Big Data: A Review of Scalable GPscited by 205
- 2018Measuring abstract reasoning in neural networkscited by 165
- 2019Adversarial Examples Are a Natural Consequence of Test Error in Noisecited by 114
- 2019DScribe: Library of Descriptors for Machine Learning in Materials Sciencecited by 63
- 2020Differentiable Molecular Simulations for Control and Learningcited by 25
- 2019Generative Models for Automatic Chemical Designcited by 23
- 2020Committee neural network potentials control generalization errors and enable active learningcited by 14
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 8; 2024: 6; 2025: 3; 2026: 2.
25 papers.
Sort:
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulationscited by 92
- 2022SPICE, A Dataset of Drug-like Molecules and Peptides for Training Machine Learning Potentialscited by 80
- 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Modelscited by 50
- 2023Single-model uncertainty quantification in neural network potentials does not consistently outperform model ensemblescited by 30
- 2021Learning neural network potentials from experimental data via Differentiable Trajectory Reweightingcited by 26
- 2022Hyperactive Learning (HAL) for Data-Driven Interatomic Potentialscited by 17
- 2023Uncertainty-biased molecular dynamics for learning uniformly accurate interatomic potentialscited by 16
- 2023Accelerating Molecular Graph Neural Networks via Knowledge Distillationcited by 11
- 2023Data efficiency and extrapolation trends in neural network interatomic potentialscited by 10
- 2024Model-free quantification of completeness, uncertainties, and outliers in atomistic machine learning using information theorycited by 10
- 2023Neural Operator: Is data all you need to model the world? An insight into the paradigm of data-driven scientific MLcited by 8
- 2023Machine-learning-accelerated simulations to enable automatic surface reconstructioncited by 8
13 more
- 2021Excited state, non-adiabatic dynamics of large photoswitchable molecules using a chemically transferable machine learning potentialcited by 7
- 2022Benchmarking Machine Learning Robustness in Covid-19 Genome Sequence Classificationcited by 6
- 2023Allegro-Legato: Scalable, Fast, and Robust Neural-Network Quantum Molecular Dynamics via Sharpness-Aware Minimizationcited by 3
- 2023Transformer-Based Neural Surrogate for Link-Level Path Loss Prediction from Variable-Sized Mapscited by 3
- 2024On the design space between molecular mechanics and machine learning force fieldscited by 3
- 2024Enhanced sampling of robust molecular datasets with uncertainty-based collective variablescited by 2
- 2025Learning atomic forces from uncertainty-calibrated adversarial attackscited by 2
- 2024Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentialscited by 1
- 2025Unsupervised Atomic Data Mining via Multi-Kernel Graph Autoencoders for Machine Learning Force Fieldscited by 1
- 2024Simulating, Fast and Slow: Learning Policies for Black-Box Optimizationcited by 0
- 2025Maximizing Efficiency of Dataset Compression for Machine Learning Potentials With Information Theorycited by 0
- 2026Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentialscited by 0
- 2026MLIP Detective: Active Failure Mode Discovery Beyond Benchmark Scores for Machine-Learning Interatomic Potentialscited by 0
- 2026MLIP Detective: Active Failure Mode Discovery Beyond Benchmark Scores for Machine-Learning Interatomic Potentials8 Sep 2026
- 2026Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentials2 Jun 2026
- 2025Maximizing Efficiency of Dataset Compression for Machine Learning Potentials With Information Theory13 Nov 2025
- 2025Unsupervised Atomic Data Mining via Multi-Kernel Graph Autoencoders for Machine Learning Force Fields15 Sep 2025
- 2025Learning atomic forces from uncertainty-calibrated adversarial attacks25 Feb 2025
- 2024Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentials27 Oct 2024
- 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Models16 Oct 2024
- 2024On the design space between molecular mechanics and machine learning force fields3 Sep 2024
- 2024Simulating, Fast and Slow: Learning Policies for Black-Box Optimization6 Jun 2024
- 2024Model-free quantification of completeness, uncertainties, and outliers in atomistic machine learning using information theory18 Apr 2024
- 2024Enhanced sampling of robust molecular datasets with uncertainty-based collective variables6 Feb 2024
- 2023Uncertainty-biased molecular dynamics for learning uniformly accurate interatomic potentials3 Dec 2023
13 more
- 2023Transformer-Based Neural Surrogate for Link-Level Path Loss Prediction from Variable-Sized Maps6 Oct 2023
- 2023Accelerating Molecular Graph Neural Networks via Knowledge Distillation26 Jun 2023
- 2023Machine-learning-accelerated simulations to enable automatic surface reconstruction12 May 2023
- 2023Single-model uncertainty quantification in neural network potentials does not consistently outperform model ensembles2 May 2023
- 2023Allegro-Legato: Scalable, Fast, and Robust Neural-Network Quantum Molecular Dynamics via Sharpness-Aware Minimization14 Mar 2023
- 2023Data efficiency and extrapolation trends in neural network interatomic potentials12 Feb 2023
- 2023Neural Operator: Is data all you need to model the world? An insight into the paradigm of data-driven scientific ML30 Jan 2023
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulations13 Oct 2022
- 2022Hyperactive Learning (HAL) for Data-Driven Interatomic Potentials9 Oct 2022
- 2022SPICE, A Dataset of Drug-like Molecules and Peptides for Training Machine Learning Potentials21 Sep 2022
- 2022Benchmarking Machine Learning Robustness in Covid-19 Genome Sequence Classification18 Jul 2022
- 2021Excited state, non-adiabatic dynamics of large photoswitchable molecules using a chemically transferable machine learning potential10 Aug 2021
- 2021Learning neural network potentials from experimental data via Differentiable Trajectory Reweighting2 Jun 2021
- 2022Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulationscited by 92
- 2022SPICE, A Dataset of Drug-like Molecules and Peptides for Training Machine Learning Potentialscited by 80
- 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Modelscited by 50
- 2023Single-model uncertainty quantification in neural network potentials does not consistently outperform model ensemblescited by 30
- 2021Learning neural network potentials from experimental data via Differentiable Trajectory Reweightingcited by 26
- 2022Hyperactive Learning (HAL) for Data-Driven Interatomic Potentialscited by 17
- 2023Uncertainty-biased molecular dynamics for learning uniformly accurate interatomic potentialscited by 16
- 2023Accelerating Molecular Graph Neural Networks via Knowledge Distillationcited by 11
- 2023Data efficiency and extrapolation trends in neural network interatomic potentialscited by 10
- 2024Model-free quantification of completeness, uncertainties, and outliers in atomistic machine learning using information theorycited by 10
- 2023Neural Operator: Is data all you need to model the world? An insight into the paradigm of data-driven scientific MLcited by 8
- 2023Machine-learning-accelerated simulations to enable automatic surface reconstructioncited by 8
12 most cited of 25 All 25 (JSON)
- 2026MLIP Detective: Active Failure Mode Discovery Beyond Benchmark Scores for Machine-Learning Interatomic Potentials8 Sep 2026
- 2026Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentials2 Jun 2026
- 2025Maximizing Efficiency of Dataset Compression for Machine Learning Potentials With Information Theory13 Nov 2025
- 2025Unsupervised Atomic Data Mining via Multi-Kernel Graph Autoencoders for Machine Learning Force Fields15 Sep 2025
- 2025Learning atomic forces from uncertainty-calibrated adversarial attacks25 Feb 2025
- 2024Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentials27 Oct 2024
- 2024Open Materials 2024 (OMat24) Inorganic Materials Dataset and Models16 Oct 2024
- 2024On the design space between molecular mechanics and machine learning force fields3 Sep 2024
- 2024Simulating, Fast and Slow: Learning Policies for Black-Box Optimization6 Jun 2024
- 2024Model-free quantification of completeness, uncertainties, and outliers in atomistic machine learning using information theory18 Apr 2024
- 2024Enhanced sampling of robust molecular datasets with uncertainty-based collective variables6 Feb 2024
- 2023Uncertainty-biased molecular dynamics for learning uniformly accurate interatomic potentials3 Dec 2023
12 newest of 25 All 25 (JSON)