Deep Generative Modeling for Protein Design
Not on the map. Why?
Abstract (arXiv)
Deep learning approaches have produced substantial breakthroughs in fields such as image classification and natural language processing and are making rapid inroads in the area of protein design. Many generative models of proteins have been developed that encompass all known protein sequences, model specific protein families, or extrapolate the dynamics of individual proteins. Those generative models can learn protein representations that are often more informative of protein structure and function than hand-engineered features. Furthermore, they can be used to quickly propose millions of novel proteins that resemble the native counterparts in terms of expression level, stability, or other attributes. The protein design process can further be guided by discriminative oracles to select candidates with the highest probability of having the desired properties. In this review, we discuss five classes of generative models that have been most successful at modeling proteins and provide a framework for model guided protein design.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 28 of its 96 references that are in the map. First posted on arXiv 31 Aug 2021.
Builds on
28 of 96 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
16 more
- 2017Wasserstein GANcited by 635
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
- 2018Invertible Residual Networkscited by 364
- 2019Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Designcited by 258
- 2019Residual Flows for Invertible Generative Modelingcited by 256
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 248
- 2019Evaluating Protein Transfer Learning with TAPEcited by 229
- 2020ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 162
- 2020ProGen: Language Modeling for Protein Generationcited by 127
- 2019Conditioning by adaptive sampling for robust designcited by 110
- 2019Flow Contrastive Estimation of Energy-Based Modelscited by 75
- 2021Protein sequence design with deep generative modelscited by 35
- 2020Deep Learning in Protein Structural Modeling and Designcited by 25
- 2020Energy-based models for atomic-resolution protein conformationscited by 20
Built on by
Citing papers per year: 2022: 2; 2023: 9; 2024: 1; 2025: 4; 2026: 1.
17 papers.
Sort:
By area:
- 2022Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Modelscited by 97
- 2022PiFold: Toward effective and efficient protein inverse foldingcited by 82
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 72
- 2023Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoningcited by 25
- 2023Mathematical analysis of singularities in the diffusion model under the submanifold assumptioncited by 20
- 2023Knowledge-Design: Pushing the Limit of Protein Design via Knowledge Refinementcited by 11
- 2023DiffSDS: A language diffusion model for protein backbone inpainting under geometric conditions and constraintscited by 10
- 2025Steering Protein Language Modelscited by 7
- 2023Generative artificial intelligence for de novo protein designcited by 5
- 2023Artificial intelligence-driven antimicrobial peptide discoverycited by 3
- 2025SpecMER: Fast Protein Generation with K-mer Guided Speculative Decodingcited by 2
- 2023Graph Representation Learning for Interactive Biomolecule Systemscited by 1
5 more
- 2023AI driven B-cell Immunotherapy Designcited by 0
- 2023Description Generation using Variational Auto-Encoders for precursor microRNAcited by 0
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Modelscited by 0
- 2025LOCO-EPI: Leave-one-chromosome-out (LOCO) as a benchmarking paradigm for deep learning based prediction of enhancer-promoter interactionscited by 0
- 2026ConfHit: Conformal Generative Design with Oracle Free Guaranteescited by 0
- 2026ConfHit: Conformal Generative Design with Oracle Free Guarantees7 Mar 2026
- 2025SpecMER: Fast Protein Generation with K-mer Guided Speculative Decoding25 Sep 2025
- 2025Steering Protein Language Models1 Jul 2025
- 2025LOCO-EPI: Leave-one-chromosome-out (LOCO) as a benchmarking paradigm for deep learning based prediction of enhancer-promoter interactions1 Apr 2025
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models12 Feb 2025
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr 2024
- 2023Description Generation using Variational Auto-Encoders for precursor microRNA29 Nov 2023
- 2023Generative artificial intelligence for de novo protein design15 Oct 2023
- 2023AI driven B-cell Immunotherapy Design3 Sep 2023
- 2023Artificial intelligence-driven antimicrobial peptide discovery21 Aug 2023
- 2023Knowledge-Design: Pushing the Limit of Protein Design via Knowledge Refinement20 May 2023
- 2023Graph Representation Learning for Interactive Biomolecule Systems5 Apr 2023
5 more
- 2023Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoning7 Mar 2023
- 2023DiffSDS: A language diffusion model for protein backbone inpainting under geometric conditions and constraints22 Jan 2023
- 2023Mathematical analysis of singularities in the diffusion model under the submanifold assumption19 Jan 2023
- 2022PiFold: Toward effective and efficient protein inverse folding22 Sep 2022
- 2022Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Models26 May 2022
- 2022Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Modelscited by 97
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 72
- 2023Mathematical analysis of singularities in the diffusion model under the submanifold assumptioncited by 20
- 2023DiffSDS: A language diffusion model for protein backbone inpainting under geometric conditions and constraintscited by 10
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Modelscited by 0
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models12 Feb 2025
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr 2024
- 2023DiffSDS: A language diffusion model for protein backbone inpainting under geometric conditions and constraints22 Jan 2023
- 2023Mathematical analysis of singularities in the diffusion model under the submanifold assumption19 Jan 2023
- 2022Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Models26 May 2022
- 2022PiFold: Toward effective and efficient protein inverse foldingcited by 82
- 2023Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoningcited by 25
- 2023Knowledge-Design: Pushing the Limit of Protein Design via Knowledge Refinementcited by 11
- 2025Steering Protein Language Modelscited by 7
- 2023Generative artificial intelligence for de novo protein designcited by 5
- 2023Artificial intelligence-driven antimicrobial peptide discoverycited by 3
- 2023Graph Representation Learning for Interactive Biomolecule Systemscited by 1
- 2023AI driven B-cell Immunotherapy Designcited by 0
- 2023Description Generation using Variational Auto-Encoders for precursor microRNAcited by 0
- 2025LOCO-EPI: Leave-one-chromosome-out (LOCO) as a benchmarking paradigm for deep learning based prediction of enhancer-promoter interactionscited by 0
- 2026ConfHit: Conformal Generative Design with Oracle Free Guaranteescited by 0
- 2026ConfHit: Conformal Generative Design with Oracle Free Guarantees7 Mar 2026
- 2025Steering Protein Language Models1 Jul 2025
- 2025LOCO-EPI: Leave-one-chromosome-out (LOCO) as a benchmarking paradigm for deep learning based prediction of enhancer-promoter interactions1 Apr 2025
- 2023Description Generation using Variational Auto-Encoders for precursor microRNA29 Nov 2023
- 2023Generative artificial intelligence for de novo protein design15 Oct 2023
- 2023AI driven B-cell Immunotherapy Design3 Sep 2023
- 2023Artificial intelligence-driven antimicrobial peptide discovery21 Aug 2023
- 2023Knowledge-Design: Pushing the Limit of Protein Design via Knowledge Refinement20 May 2023
- 2023Graph Representation Learning for Interactive Biomolecule Systems5 Apr 2023
- 2023Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoning7 Mar 2023
- 2022PiFold: Toward effective and efficient protein inverse folding22 Sep 2022