Reliable OOD Virtual Screening with Extrapolatory Pseudo-Label Matching
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) models are increasingly deployed for virtual screening in drug discovery, where the goal is to identify novel, chemically diverse scaffolds while minimizing experimental costs. This creates a fundamental challenge: the most valuable discoveries lie in out-of-distribution (OOD) regions beyond the training data, yet ML models often degrade under distribution shift. Standard novelty-rejection strategies ensure reliability within the training domain but limit discovery by rejecting precisely the novel scaffolds most worth finding. Moreover, experimental budgets permit testing only a small fraction of nominated candidates, demanding models that produce reliable confidence estimates. We introduce EXPLOR (Extrapolatory Pseudo-Label Matching for OOD Uncertainty-Based Rejection), a framework that addresses both challenges through extrapolatory pseudo-labeling on latent-space augmentations, requiring only a single labeled training set and no access to unlabeled test compounds, mirroring the realistic conditions of prospective screening campaigns. Through a multi-headed architecture with a novel per-head matching loss, EXPLOR learns to extrapolate to OOD chemical space while producing reliable confidence estimates, with particularly strong performance in high-confidence regions, which is critical for virtual screening where only top-ranked candidates advance to experimental validation. We demonstrate state-of-the-art performance across chemical and tabular benchmarks using different molecular embeddings.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 69 references that are in the map. First posted on arXiv 3 Jun 2024.
Builds on
33 of 69 references.
References · 33
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2019Invariant Risk Minimizationcited by 1,832
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
21 more
- 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2020Learning to Learn Single Domain Generalizationcited by 295
- 2013Learning Factored Representations in a Deep Mixture of Expertscited by 275
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
- 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2018Domain Generalization via Conditional Invariant Representationcited by 146
- 2021Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalizationcited by 144
- 2020Rethinking Bias-Variance Trade-off for Generalization of Neural Networkscited by 107
- 2021Machine Learning with a Reject Option: A surveycited by 107
- 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
- 2020Uncertainty Quantification Using Neural Networks for Molecular Property Predictioncited by 66
- 2023Benchmarking Distribution Shift in Tabular Data with TableShiftcited by 64
- 2022Domain Generalization by Learning and Removing Domain-specific Featurescited by 28
- 2023Improving Domain Generalization with Domain Relationscited by 14
- 2023MUBen: Benchmarking the Uncertainty of Molecular Representation Modelscited by 11
- 2024Unknown Domain Inconsistency Minimization for Domain Generalizationcited by 7
- 2023Modality-Agnostic Self-Supervised Learning with Meta-Learned Masked Auto-Encodercited by 5
Built on by
Citing papers per year: 2025: 1.
1 paper.