SPID: Distilled Protein Backbone Generation
Not on the map. Why?
Abstract (arXiv)
Diffusion- and flow-based generative models have recently demonstrated strong performance in protein backbone generation tasks, offering unprecedented capabilities for de novo protein design. However, despite their generation quality, these models are constrained by slow sampling, often requiring hundreds of iterative steps. This computational bottleneck limits their practical utility in large-scale protein discovery, where thousands to millions of candidate structures are needed. To address this challenge, we explore the techniques of score distillation, which has shown great success in reducing the number of sampling steps in the vision domain while maintaining high generation quality. However, a straightforward adaptation of these methods results in unacceptably low designability. We introduce Score Protein identity Distillation (SPID), which resolves this incompatibility by combining few-step generation with inference-time noise scaling. SPID adapts the Score identity Distillation (SiD) framework to both diffusion- and flow-based models without requiring access to pretraining data. Applied to the Proteina flow-matching model, our 16-step generator achieves 94.4% designability, matching the 400-step teacher, while delivering more than a 20-fold reduction in effective backbone-generation time and maintaining comparable diversity and novelty. SPID generalizes across unconditional generation, fold-class conditional generation, and motif scaffolding, and extends to equivariant diffusion architectures, achieving significant reduction in generation time with comparable generation quality to the teacher in all tasks. The resulting reduction in inference cost could facilitate large-scale in silico protein design, thereby advancing diffusion-based models toward real-world protein engineering applications. The PyTorch implementation is available at https://github.com/LY-Xie/SiD_Protein
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
22 of 41 references.
References · 22
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Consistency Modelscited by 1,778
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2022Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problemcited by 229
- 2023SE(3) diffusion model with application to protein backbone generationcited by 214
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 203
- 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generationcited by 147
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 99
10 more
- 2022Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Modelscited by 97
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 81
- 2025Proteina: Scaling Flow-based Protein Structure Generative Modelscited by 63
- 2023Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Cloudscited by 53
- 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Stepcited by 47
- 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 39
- 2025Efficient Diffusion Models: A Surveycited by 35
- 2024Out of Many, One: Designing and Scaffolding Proteins at the Scale of the Structural Universe with Genie 2cited by 33
- 2025Few-Step Diffusion via Score identity Distillationcited by 10
- 2025A Survey on Pre-Trained Diffusion Model Distillationscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Riemannian MeanFlowcited by 5
- 2026Riemannian MeanFlow8 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Generative Modeling in Protein Design: Neural Representations, Conditional Generation, and Evaluation Standards
- 2025Flows, straight but not so fast: Exploring the design space of Rectified Flows in Protein Design
- 2026SaDiT: Efficient Protein Backbone Design via Latent Structural Tokenization and Diffusion Transformers
- 2026SE(3)-MeanFlow: Few-Step Protein Backbone Generation on Lie Groups
- 2024Sequence-Augmented SE(3)-Flow Matching For Conditional Protein Backbone Generation
- 2026ProHiFlo: Hierarchical Flow Matching with Functional Guidance for De Novo Protein Generation
- 2025Demystify Protein Generation with Hierarchical Conditional Diffusion Models
- 2025Protein-SE(3): Benchmarking SE(3)-based Generative Models for Protein Structure Design