Assigning Confidence to Molecular Property Prediction
Not on the map. Why?
Abstract (arXiv)
Introduction: Computational modeling has rapidly advanced over the last decades, especially to predict molecular properties for chemistry, material science and drug design. Recently, machine learning techniques have emerged as a powerful and cost-effective strategy to learn from existing datasets and perform predictions on unseen molecules. Accordingly, the explosive rise of data-driven techniques raises an important question: What confidence can be assigned to molecular property predictions and what techniques can be used for that purpose? Areas covered: In this work, we discuss popular strategies for predicting molecular properties relevant to drug design, their corresponding uncertainty sources and methods to quantify uncertainty and confidence. First, our considerations for assessing confidence begin with dataset bias and size, data-driven property prediction and feature design. Next, we discuss property simulation via molecular docking, and free-energy simulations of binding affinity in detail. Lastly, we investigate how these uncertainties propagate to generative models, as they are usually coupled with property predictors. Expert opinion: Computational techniques are paramount to reduce the prohibitive cost and timing of brute-force experimentation when exploring the enormous chemical space. We believe that assessing uncertainty in property prediction models is essential whenever closed-loop drug design campaigns relying on high-throughput virtual screening are deployed. Accordingly, considering sources of uncertainty leads to better-informed experimental validations, more reliable predictions and to more realistic expectations of the entire workflow. Overall, this increases confidence in the predictions and designs and, ultimately, accelerates drug design.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 22 of its 167 references that are in the map. First posted on arXiv 23 Feb 2021.
Builds on
22 of 167 references.
References · 22
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2018Optimization of Molecules via Deep Reinforcement Learningcited by 199
- 2017Deep Reinforcement Learning for De-Novo Drug Designcited by 161
- 2017Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Modelscited by 116
- 2019Mol-CycleGAN - a generative model for molecular optimizationcited by 66
- 2019Augmenting Genetic Algorithms with Deep Neural Networks for Exploring the Chemical Spacecited by 66
- 2020Uncertainty Quantification Using Neural Networks for Molecular Property Predictioncited by 66
- 2016Protein-Ligand Scoring with Convolutional Neural Networkscited by 57
10 more
- 2020Molecular machine learning with conformer ensemblescited by 27
- 2019Bayesian semi-supervised learning for uncertainty-calibrated prediction of molecular properties and active learningcited by 21
- 2020Deep Molecular Dreaming: Inverse machine learning for de-novo molecular design and interpretability with surjective representationscited by 20
- 2020Gaussian Process Molecule Property Prediction with FlowMOcited by 18
- 2020Curiosity in exploring chemical space: Intrinsic rewards for deep molecular reinforcement learningcited by 16
- 2019Concepts and Applications of Conformal Prediction in Computational Drug Discoverycited by 13
- 2017Using Rule-Based Labels for Weak Supervised Learning: A ChemNet for Transferable Chemical Property Predictioncited by 12
- 2019Combining docking pose rank and structure with deep learning improves protein-ligand binding mode predictioncited by 10
- 2017Most Ligand-Based Classification Benchmarks Reward Memorization Rather than Generalizationcited by 5
- 2020Predicting drug properties with parameter-free machine learning: Pareto-Optimal Embedded Modeling (POEM)cited by 1
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 3; 2024: 3; 2025: 0; 2026: 1.
14 papers.
Sort:
- 2022On scientific understanding with artificial intelligencecited by 68
- 2021JANUS: Parallel Tempered Genetic Algorithm Guided by Deep Neural Networks for Inverse Molecular Designcited by 31
- 2021Calibrated Uncertainty for Molecular Property Prediction using Ensembles of Message Passing Neural Networkscited by 21
- 2022Materials Property Prediction with Uncertainty Quantification: A Benchmark Studycited by 14
- 2022Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUScited by 10
- 2023Deep Learning Methods for Small Molecule Drug Discovery: A Surveycited by 10
- 2023Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forcescited by 10
- 2022Graph Machine Learning for Design of High-Octane Fuelscited by 6
- 2021MaterialsAtlas.org: A Materials Informatics Web App Platform for Materials Discovery and Survey of State-of-the-Artcited by 5
- 2024Ranking over Regression for Bayesian Optimization and Molecule Selectioncited by 4
- 2024FlexMol: A Flexible Toolkit for Benchmarking Molecular Relational Learningcited by 3
- 2024Quantum Computing-Enhanced Algorithm Unveils Novel Inhibitors for KRAScited by 1
- 2026A Systematic Survey and Benchmark of Deep Learning for Molecular Property Prediction in the Foundation Model Era17 Apr 2026
- 2024FlexMol: A Flexible Toolkit for Benchmarking Molecular Relational Learning19 Oct 2024
- 2024Ranking over Regression for Bayesian Optimization and Molecule Selection11 Oct 2024
- 2024Quantum Computing-Enhanced Algorithm Unveils Novel Inhibitors for KRAS13 Feb 2024
- 2023Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forces10 May 2023
- 2023Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holes24 Mar 2023
- 2023Deep Learning Methods for Small Molecule Drug Discovery: A Survey1 Mar 2023
- 2022Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUS3 Dec 2022
- 2022Materials Property Prediction with Uncertainty Quantification: A Benchmark Study4 Nov 2022
- 2022Graph Machine Learning for Design of High-Octane Fuels1 Jun 2022
- 2022On scientific understanding with artificial intelligence4 Apr 2022
- 2021MaterialsAtlas.org: A Materials Informatics Web App Platform for Materials Discovery and Survey of State-of-the-Art9 Sep 2021
- 2022On scientific understanding with artificial intelligencecited by 68
- 2021JANUS: Parallel Tempered Genetic Algorithm Guided by Deep Neural Networks for Inverse Molecular Designcited by 31
- 2021Calibrated Uncertainty for Molecular Property Prediction using Ensembles of Message Passing Neural Networkscited by 21
- 2022Materials Property Prediction with Uncertainty Quantification: A Benchmark Studycited by 14
- 2022Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUScited by 10
- 2023Deep Learning Methods for Small Molecule Drug Discovery: A Surveycited by 10
- 2023Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forcescited by 10
- 2022Graph Machine Learning for Design of High-Octane Fuelscited by 6
- 2021MaterialsAtlas.org: A Materials Informatics Web App Platform for Materials Discovery and Survey of State-of-the-Artcited by 5
- 2024Ranking over Regression for Bayesian Optimization and Molecule Selectioncited by 4
- 2024FlexMol: A Flexible Toolkit for Benchmarking Molecular Relational Learningcited by 3
- 2024Quantum Computing-Enhanced Algorithm Unveils Novel Inhibitors for KRAScited by 1
12 most cited of 14 All 14 (JSON)
- 2026A Systematic Survey and Benchmark of Deep Learning for Molecular Property Prediction in the Foundation Model Era17 Apr 2026
- 2024FlexMol: A Flexible Toolkit for Benchmarking Molecular Relational Learning19 Oct 2024
- 2024Ranking over Regression for Bayesian Optimization and Molecule Selection11 Oct 2024
- 2024Quantum Computing-Enhanced Algorithm Unveils Novel Inhibitors for KRAS13 Feb 2024
- 2023Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forces10 May 2023
- 2023Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holes24 Mar 2023
- 2023Deep Learning Methods for Small Molecule Drug Discovery: A Survey1 Mar 2023
- 2022Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUS3 Dec 2022
- 2022Materials Property Prediction with Uncertainty Quantification: A Benchmark Study4 Nov 2022
- 2022Graph Machine Learning for Design of High-Octane Fuels1 Jun 2022
- 2022On scientific understanding with artificial intelligence4 Apr 2022
- 2021MaterialsAtlas.org: A Materials Informatics Web App Platform for Materials Discovery and Survey of State-of-the-Art9 Sep 2021
12 newest of 14 All 14 (JSON)