mlsanityData to 7 Oct 2026

Deep Generative Modeling for Protein Design

arXiv 2109.13754 ↗First posted 31 Aug 2021cs.LG cs.AIcited by 17

Not on the map. Why?

Abstract (arXiv)

Deep learning approaches have produced substantial breakthroughs in fields such as image classification and natural language processing and are making rapid inroads in the area of protein design. Many generative models of proteins have been developed that encompass all known protein sequences, model specific protein families, or extrapolate the dynamics of individual proteins. Those generative models can learn protein representations that are often more informative of protein structure and function than hand-engineered features. Furthermore, they can be used to quickly propose millions of novel proteins that resemble the native counterparts in terms of expression level, stability, or other attributes. The protein design process can further be guided by discriminative oracles to select candidates with the highest probability of having the desired properties. In this review, we discuss five classes of generative models that have been most successful at modeling proteins and provide a framework for model guided protein design.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 28 of its 96 references that are in the map. First posted on arXiv 31 Aug 2021.

Builds on

28 of 96 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2013Auto-Encoding Variational Bayescited by 3,980
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  5. 2015Variational Inference with Normalizing Flowscited by 2,161
  6. 2016Density estimation using Real NVPcited by 2,029
  7. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  8. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  9. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  10. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  11. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  12. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
16 more
  1. 2017Wasserstein GANcited by 635
  2. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  3. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
  4. 2018Invertible Residual Networkscited by 364
  5. 2019Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Designcited by 258
  6. 2019Residual Flows for Invertible Generative Modelingcited by 256
  7. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  8. 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 248
  9. 2019Evaluating Protein Transfer Learning with TAPEcited by 229
  10. 2020ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 162
  11. 2020ProGen: Language Modeling for Protein Generationcited by 127
  12. 2019Conditioning by adaptive sampling for robust designcited by 110
  13. 2019Flow Contrastive Estimation of Energy-Based Modelscited by 75
  14. 2021Protein sequence design with deep generative modelscited by 35
  15. 2020Deep Learning in Protein Structural Modeling and Designcited by 25
  16. 2020Energy-based models for atomic-resolution protein conformationscited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 9; 2024: 1; 2025: 4; 2026: 1.

17 papers.

Sort:

By area:

  1. 2022Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Modelscited by 97
  2. 2022PiFold: Toward effective and efficient protein inverse foldingcited by 82
  3. 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 72
  4. 2023Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoningcited by 25
  5. 2023Mathematical analysis of singularities in the diffusion model under the submanifold assumptioncited by 20
  6. 2023Knowledge-Design: Pushing the Limit of Protein Design via Knowledge Refinementcited by 11
  7. 2023DiffSDS: A language diffusion model for protein backbone inpainting under geometric conditions and constraintscited by 10
  8. 2025Steering Protein Language Modelscited by 7
  9. 2023Generative artificial intelligence for de novo protein designcited by 5
  10. 2023Artificial intelligence-driven antimicrobial peptide discoverycited by 3
  11. 2025SpecMER: Fast Protein Generation with K-mer Guided Speculative Decodingcited by 2
  12. 2023Graph Representation Learning for Interactive Biomolecule Systemscited by 1
5 more
  1. 2023AI driven B-cell Immunotherapy Designcited by 0
  2. 2023Description Generation using Variational Auto-Encoders for precursor microRNAcited by 0
  3. 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Modelscited by 0
  4. 2025LOCO-EPI: Leave-one-chromosome-out (LOCO) as a benchmarking paradigm for deep learning based prediction of enhancer-promoter interactionscited by 0
  5. 2026ConfHit: Conformal Generative Design with Oracle Free Guaranteescited by 0