Antibody DomainBed: Out-of-Distribution Generalization in Therapeutic Protein Design
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) has demonstrated significant promise in accelerating drug design. Active ML-guided optimization of therapeutic molecules typically relies on a surrogate model predicting the target property of interest. The model predictions are used to determine which designs to evaluate in the lab, and the model is updated on the new measurements to inform the next cycle of decisions. A key challenge is that the experimental feedback from each cycle inspires changes in the candidate proposal or experimental protocol for the next cycle, which lead to distribution shifts. To promote robustness to these shifts, we must account for them explicitly in the model training. We apply domain generalization (DG) methods to classify the stability of interactions between an antibody and antigen across five domains defined by design cycles. Our results suggest that foundational models and ensembling improve predictive performance on out-of-distribution domains. We publicly release our codebase extending the DG benchmark ``DomainBed,'' and the associated dataset of antibody sequences and structures emulating distribution shifts across design cycles.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 74 references that are in the map. First posted on arXiv 15 Jul 2024.
Builds on
36 of 74 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2019Invariant Risk Minimizationcited by 1,832
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2020In Search of Lost Domain Generalizationcited by 1,042
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
24 more
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
- 2020The Risks of Invariant Risk Minimizationcited by 262
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
- 2021Fishr: Invariant Gradient Variances for Out-of-Distribution Generalizationcited by 186
- 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
- 2022Protein Representation Learning by Geometric Structure Pretrainingcited by 161
- 2023Protein Design with Guided Discrete Diffusioncited by 154
- 2022Diverse Weight Averaging for Out-of-Distribution Generalizationcited by 148
- 2021Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalizationcited by 144
- 2020Learning explanations that are hard to varycited by 132
- 2019Efficient Pipeline for Camera Trap Image Reviewcited by 79
- 2019Neural Empirical Bayescited by 46
- 2022Spurious Features Everywhere -- Large-Scale Detection of Harmful Spurious Features in ImageNetcited by 41
- 2023Spawrious: A Benchmark for Fine Control of Spurious Correlation Biasescited by 41
- 2023Protein Discovery with Discrete Walk-Jump Samplingcited by 38
- 2020Risk Variance Penalizationcited by 21
- 2022Reprogramming Pretrained Language Models for Antibody Sequence Infillingcited by 20
- 2022PropertyDAG: Multi-objective Bayesian optimization of partially ordered, mixed-variable properties for biological sequence designcited by 8
- 2022A Pareto-optimal compositional energy-based model for sampling and optimization of protein sequencescited by 7
- 2022Multi-segment preserving sampling for deep manifold samplercited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.
- 2025Overconfident Oracles: Limitations of In Silico Sequence Design Benchmarkingcited by 3
- 2025Unified all-atom molecule generation with neural fieldscited by 2
- 2024One protein is all you needcited by 0
- 2025Unified all-atom molecule generation with neural fields19 Nov 2025
- 2025Overconfident Oracles: Limitations of In Silico Sequence Design Benchmarking24 Feb 2025
- 2024One protein is all you need4 Nov 2024