mlsanityData to 14 Oct 2026

Conditional generation of antibody sequences with classifier-guided germline-absorbing discrete diffusion

arXiv 2605.06720 ↗First posted 7 May 2026cs.LG cs.AIcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Antibody therapeutics are among the most successful modern medicines, yet computationally designing antibodies with desirable binding and developability properties remains challenging. While protein language models (pLMs) have emerged as powerful tools for antibody sequence design, existing approaches largely suffer from two key limitations: they predominantly memorize germline sequences rather than modeling biologically meaningful somatic variation, and they offer limited support for flexible classifier-guided conditional generation. We address these challenges through two primary contributions. First, we demonstrate that discrete diffusion fine-tuning achieves strong language modeling performance on antibody sequences while allowing for generation conditioned on any off-the-shelf classifier. Second, we introduce germline absorbing diffusion, a novel modification of the discrete diffusion noise process in which the germline sequence - rather than a masked sequence - serves as the absorbing state. This biologically motivated inductive bias restricts the model to learning the trajectory from germline to observed sequence, effectively excluding genetic variation and V(D)J recombination statistics from the learned distribution and dramatically mitigating germline bias. We show that germline diffusion improves non-germline residue prediction accuracy from 26 percent to 46 percent, approaching the theoretical upper bound set by true biological variability. We then demonstrate the utility of our germline diffusion model on the conditional generation tasks of sampling antibodies with improved hydrophobicity and predicted binding affinity. On both tasks our model shows an improved tradeoff between class adherence and sample quality, significantly outperforming EvoProtGrad, a popular strategy to sample from pLMs with gradient-based discrete Markov Chain Monte Carlo.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 19 of its 48 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

19 of 48 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023AbDiffuser: Full-Atom Generation of in vitro Functioning Antibodies28 Jul
  2. 2023SE(3) diffusion model with application to protein backbone generation5 Feb

Other references · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  9. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  10. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  11. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 574
  12. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
5 more
  1. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
  2. 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 159
  3. 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
  4. 2021Deciphering antibody affinity maturation with language models and weakly supervised learningcited by 53
  5. 2022Plug & Play Directed Evolution of Proteins with Gradient-based Discrete MCMCcited by 17

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Guided Sequence-Structure Generative Modeling for Iterative Antibody Optimization
  2. 2023AntiBARTy Diffusion for Property Guided Antibody Design
  3. 2024Retrieval Augmented Diffusion Model for Structure-informed Antibody Design and Optimization
  4. 2025Guided Generation for Developable Antibodies
  5. 2024Antigen-Specific Antibody Design via Direct Energy-based Preference Optimization
  6. 2024De novo antibody design with SE(3) diffusion
  7. 2025AffinityFlow: Guided Flows for Antibody Affinity Maturation
  8. 2024Diffusion on language model encodings for protein sequence generation