Towards A Generative Protein Evolution Machine with DPLM-Evo
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Proteins are shaped by gradual evolution under biophysical and functional constraints. Protein language models learn rich evolutionary constraints from large-scale sequences, and discrete diffusion-based protein language models~(eg, DPLMs) are promising for both understanding and generation. However, existing DPLMs typically rely on masked diffusion that contradicts a simple biological intuition: proteins evolve through accumulated edits, not by emerging from masks. Consequently, these frameworks lack explicit pretraining objectives for substitution and insertion/deletion (indel) operations, limiting both optimization-style post-editing and flexible guided generation. To address these limitations, we present DPLM-Evo, an evolutionary discrete diffusion framework that explicitly predicts substitution, insertion, and deletion operations during denoising. DPLM-Evo decouples an upsampled-length latent alignment space from the variable-length observed sequence space, which makes indel-aware generation tractable. To better align substitutions with real evolution, we further introduce a contextualized evolutionary noising kernel that produces biologically informed, context-dependent mutation patterns. Across tasks, DPLM-Evo improves sequence understanding and achieves state-of-the-art mutation effect prediction performance on ProteinGym in the single-sequence setting. It also enables variable-length simulated evolution, and post-editing/optimization of existing proteins via explicit edit trajectories.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 37 of its 60 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
37 of 60 references.
Closest ancestors · 3
Same direction, newest first
- 2025A Diffusion Model to Shrink Proteins While Maintaining Their Function10 Nov
- 2024Diffusion Language Models Are Versatile Protein Learners28 Feb
- 2023Protein Design with Guided Discrete Diffusion31 May
Other references · 34
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2025Large Language Diffusion Modelscited by 872
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2025Dream 7B: Diffusion Large Language Modelscited by 515
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
22 more
- 2019Evaluating Protein Transfer Learning with TAPEcited by 229
- 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Modelscited by 214
- 2019Levenshtein Transformercited by 197
- 2024Scaling up Masked Diffusion Models on Textcited by 195
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
- 2023A Reparameterized Discrete Diffusion Model for Text Generationcited by 152
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 148
- 2025The Diffusion Dualitycited by 124
- 2020Fully Non-autoregressive Neural Machine Translation: Tricks of the Tradecited by 99
- 2023Structure-informed Language Models Are Protein Designerscited by 68
- 2025Generalized Interpolating Discrete Diffusioncited by 68
- 2024DPLM-2: A Multimodal Diffusion Protein Language Modelcited by 59
- 2025Edit Flows: Flow Matching with Edit Operationscited by 53
- 2023DINOISER: Diffused Conditional Sequence Learning by Manipulating Noisescited by 50
- 2023Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuningcited by 39
- 2019NAT: Neural Architecture Transformer for Accurate and Compact Architecturescited by 33
- 2023PoET: A generative model of protein families as sequences-of-sequencescited by 29
- 2021Modeling Protein Using Large-scale Pretrain Language Modelcited by 21
- 2025Sequential Diffusion Language Modelscited by 19
- 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvascited by 16
- 2025Elucidating the Design Space of Multimodal Protein Language Modelscited by 10
- 2016Aligning 415 519 proteins in less than two hours on PCcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026EvoFlows: Evolutionary Edit-Based Flow-Matching for Protein Engineering
- 2025Evolutionary Profiles for Protein Fitness Prediction
- 2024Diffusion on language model encodings for protein sequence generation
- 2024Reinforcement Learning for Sequence Design Leveraging Protein Language Models
- 2025Swarms of Large Language Model Agents for Protein Sequence Design with Experimental Validation
- 2024MutaPLM: Protein Language Modeling for Mutation Explanation and Engineering
- 2024Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
- 2026Repurposing Protein Language Models for Latent Flow-Based Fitness Optimization