Protein Inverse Folding From Structure Feedback
Not on the map. Why?
Abstract (arXiv)
The inverse folding problem, aiming to design amino acid sequences that fold into desired three-dimensional structures, is pivotal for various biotechnological applications. Here, we introduce a novel approach leveraging Direct Preference Optimization (DPO) to fine-tune an inverse folding model using feedback from a protein folding model. Given a target protein structure, we begin by sampling candidate sequences from the inverse-folding model, then predict the three-dimensional structure of each sequence with the folding model to generate pairwise structural-preference labels. These labels are used to fine-tune the inverse-folding model under the DPO objective. Our results on the CATH 4.2 test set demonstrate that DPO fine-tuning not only improves sequence recovery of baseline models but also leads to a significant improvement in average TM-Score from 0.77 to 0.81, indicating enhanced structure similarity. Furthermore, iterative application of our DPO-based method on challenging protein structures yields substantial gains, with an average TM-Score increase of 79.5% with regard to the baseline model. This work establishes a promising direction for enhancing protein sequence design ability from structure feedback by effectively utilizing preference optimization.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
24 of 55 references.
References · 24
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2024Self-Rewarding Language Modelscited by 654
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
- 2024Hallucination of Multimodal Large Language Models: A Surveycited by 380
- 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
12 more
- 2023Evaluating Large Language Models at Evaluating Instruction Followingcited by 290
- 2024Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positivecited by 239
- 2024Self-Play Preference Optimization for Language Model Alignmentcited by 228
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
- 2020ProGen: Language Modeling for Protein Generationcited by 127
- 2023HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Datacited by 124
- 2022PiFold: Toward effective and efficient protein inverse foldingcited by 82
- 2023Structure-informed Language Models Are Protein Designerscited by 68
- 2022AlphaDesign: A graph protein design method and benchmark on AlphaFoldDBcited by 39
- 2022Generative De Novo Protein Design with Global Contextcited by 15
- 2024Improving Inverse Folding for Peptide Design with Diversity-regularized Direct Preference Optimizationcited by 5
- 2024Preference optimization of protein language models as a multi-objective binder design paradigmcited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learningcited by 5
- 2026Property-driven Protein Inverse Folding With Multi-Objective Preference Alignmentcited by 3
- 2025g-DPO: Scalable Preference Optimization for Protein Language Modelscited by 0
- 2026SurfDesign: Effective Protein Design on Molecular Surfacescited by 0
- 2026Preference-based Antibody Expression Ranking: Scaling with Large-scale Weak Supervisioncited by 0
- 2026Preference-based Antibody Expression Ranking: Scaling with Large-scale Weak Supervision29 Jun 2026
- 2026SurfDesign: Effective Protein Design on Molecular Surfaces25 May 2026
- 2026Property-driven Protein Inverse Folding With Multi-Objective Preference Alignment6 Mar 2026
- 2025g-DPO: Scalable Preference Optimization for Protein Language Models22 Oct 2025
- 2025ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learning9 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025EnerBridge-DPO: Energy-Guided Protein Inverse Folding with Markov Bridges and Direct Preference Optimization
- 2024Reinforcement learning on structure-conditioned categorical diffusion for protein inverse folding
- 2025Improving Protein Sequence Design through Designability Preference Optimization
- 2024Diffusion Model with Representation Alignment for Protein Inverse Folding
- 2025PRISM: Enhancing Protein Inverse Folding through Fine-Grained Retrieval on Structure-Sequence Multimodal Representations
- 2025ProtInvTree: Deliberate Protein Inverse Folding with Reward-guided Tree Search
- 2025RadDiff: Retrieval-Augmented Denoising Diffusion for Protein Inverse Folding
- 2023Graph Denoising Diffusion for Inverse Protein Folding