mlsanityData to 7 Oct 2026

Protein Inverse Folding From Structure Feedback

arXiv 2506.03028 ↗First posted 3 Jun 2025cs.LG q-bio.BMcited by 5

Not on the map. Why?

Abstract (arXiv)

The inverse folding problem, aiming to design amino acid sequences that fold into desired three-dimensional structures, is pivotal for various biotechnological applications. Here, we introduce a novel approach leveraging Direct Preference Optimization (DPO) to fine-tune an inverse folding model using feedback from a protein folding model. Given a target protein structure, we begin by sampling candidate sequences from the inverse-folding model, then predict the three-dimensional structure of each sequence with the folding model to generate pairwise structural-preference labels. These labels are used to fine-tune the inverse-folding model under the DPO objective. Our results on the CATH 4.2 test set demonstrate that DPO fine-tuning not only improves sequence recovery of baseline models but also leads to a significant improvement in average TM-Score from 0.77 to 0.81, indicating enhanced structure similarity. Furthermore, iterative application of our DPO-based method on challenging protein structures yields substantial gains, with an average TM-Score increase of 79.5% with regard to the baseline model. This work establishes a promising direction for enhancing protein sequence design ability from structure feedback by effectively utilizing preference optimization.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

24 of 55 references.

References · 24

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2017Deep reinforcement learning from human preferencescited by 3,846
  7. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  8. 2016Group Equivariant Convolutional Networkscited by 1,154
  9. 2024Self-Rewarding Language Modelscited by 654
  10. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
  11. 2024Hallucination of Multimodal Large Language Models: A Surveycited by 380
  12. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
12 more
  1. 2023Evaluating Large Language Models at Evaluating Instruction Followingcited by 290
  2. 2024Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positivecited by 239
  3. 2024Self-Play Preference Optimization for Language Model Alignmentcited by 228
  4. 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
  5. 2020ProGen: Language Modeling for Protein Generationcited by 127
  6. 2023HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Datacited by 124
  7. 2022PiFold: Toward effective and efficient protein inverse foldingcited by 82
  8. 2023Structure-informed Language Models Are Protein Designerscited by 68
  9. 2022AlphaDesign: A graph protein design method and benchmark on AlphaFoldDBcited by 39
  10. 2022Generative De Novo Protein Design with Global Contextcited by 15
  11. 2024Improving Inverse Folding for Peptide Design with Diversity-regularized Direct Preference Optimizationcited by 5
  12. 2024Preference optimization of protein language models as a multi-objective binder design paradigmcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025EnerBridge-DPO: Energy-Guided Protein Inverse Folding with Markov Bridges and Direct Preference Optimization
  2. 2024Reinforcement learning on structure-conditioned categorical diffusion for protein inverse folding
  3. 2025Improving Protein Sequence Design through Designability Preference Optimization
  4. 2024Diffusion Model with Representation Alignment for Protein Inverse Folding
  5. 2025PRISM: Enhancing Protein Inverse Folding through Fine-Grained Retrieval on Structure-Sequence Multimodal Representations
  6. 2025ProtInvTree: Deliberate Protein Inverse Folding with Reward-guided Tree Search
  7. 2025RadDiff: Retrieval-Augmented Denoising Diffusion for Protein Inverse Folding
  8. 2023Graph Denoising Diffusion for Inverse Protein Folding