mlsanityData to 7 Oct 2026

Reliable OOD Virtual Screening with Extrapolatory Pseudo-Label Matching

arXiv 2406.01825 ↗First posted 3 Jun 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Machine learning (ML) models are increasingly deployed for virtual screening in drug discovery, where the goal is to identify novel, chemically diverse scaffolds while minimizing experimental costs. This creates a fundamental challenge: the most valuable discoveries lie in out-of-distribution (OOD) regions beyond the training data, yet ML models often degrade under distribution shift. Standard novelty-rejection strategies ensure reliability within the training domain but limit discovery by rejecting precisely the novel scaffolds most worth finding. Moreover, experimental budgets permit testing only a small fraction of nominated candidates, demanding models that produce reliable confidence estimates. We introduce EXPLOR (Extrapolatory Pseudo-Label Matching for OOD Uncertainty-Based Rejection), a framework that addresses both challenges through extrapolatory pseudo-labeling on latent-space augmentations, requiring only a single labeled training set and no access to unlabeled test compounds, mirroring the realistic conditions of prospective screening campaigns. Through a multi-headed architecture with a novel per-head matching loss, EXPLOR learns to extrapolate to OOD chemical space while producing reliable confidence estimates, with particularly strong performance in high-confidence regions, which is critical for virtual screening where only top-ranked candidates advance to experimental validation. We demonstrate state-of-the-art performance across chemical and tabular benchmarks using different molecular embeddings.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 69 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

33 of 69 references.

References · 33

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  4. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  5. 2019Invariant Risk Minimizationcited by 1,832
  6. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  7. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
  8. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  9. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  10. 2017Selective Classification for Deep Neural Networkscited by 799
  11. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  12. 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
21 more
  1. 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
  2. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
  3. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
  4. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
  5. 2020Learning to Learn Single Domain Generalizationcited by 295
  6. 2013Learning Factored Representations in a Deep Mixture of Expertscited by 275
  7. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
  8. 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
  9. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  10. 2018Domain Generalization via Conditional Invariant Representationcited by 146
  11. 2021Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalizationcited by 144
  12. 2020Rethinking Bias-Variance Trade-off for Generalization of Neural Networkscited by 107
  13. 2021Machine Learning with a Reject Option: A surveycited by 107
  14. 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
  15. 2020Uncertainty Quantification Using Neural Networks for Molecular Property Predictioncited by 66
  16. 2023Benchmarking Distribution Shift in Tabular Data with TableShiftcited by 64
  17. 2022Domain Generalization by Learning and Removing Domain-specific Featurescited by 28
  18. 2023Improving Domain Generalization with Domain Relationscited by 14
  19. 2023MUBen: Benchmarking the Uncertainty of Molecular Representation Modelscited by 11
  20. 2024Unknown Domain Inconsistency Minimization for Domain Generalizationcited by 7
  21. 2023Modality-Agnostic Self-Supervised Learning with Meta-Learned Masked Auto-Encodercited by 5

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.