mlsanityData to 14 Oct 2026

Diffusion Model with Representation Alignment for Protein Inverse Folding

arXiv 2412.09380 ↗First posted 12 Dec 2024cs.LG cs.AIcited by 10

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Protein inverse folding is a fundamental problem in bioinformatics, aiming to recover the amino acid sequences from a given protein backbone structure. Despite the success of existing methods, they struggle to fully capture the intricate inter-residue relationships critical for accurate sequence prediction. We propose a novel method that leverages diffusion models with representation alignment (DMRA), which enhances diffusion-based inverse folding by (1) proposing a shared center that aggregates contextual information from the entire protein structure and selectively distributes it to each residue; and (2) aligning noisy hidden representations with clean semantic representations during the denoising process. This is achieved by predefined semantic representations for amino acid types and a representation alignment method that utilizes type embeddings as semantic feedback to normalize each residue. In experiments, we conduct extensive evaluations on the CATH4.2 dataset to demonstrate that DMRA outperforms leading methods, achieving state-of-the-art performance and exhibiting strong generalization capabilities on the TS50 and TS500 datasets.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 5 of its 51 references that are in the map. First posted on arXiv 12 Dec 2024.

Builds on

5 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Diffusion Language Models Are Versatile Protein Learners28 Feb

Other references · 4

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  4. 2024Deconstructing Denoising Diffusion Models for Self-Supervised Learningcited by 91

Built on by

Cited by year

Citing papers per year: 2025: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Graph Denoising Diffusion for Inverse Protein Folding
  2. 2025RadDiff: Retrieval-Augmented Denoising Diffusion for Protein Inverse Folding
  3. 2024Mask prior-guided denoising diffusion improves inverse protein folding
  4. 2024Reinforcement learning on structure-conditioned categorical diffusion for protein inverse folding
  5. 2022AlphaFold Distillation for Protein Design
  6. 2025PRISM: Enhancing Protein Inverse Folding through Fine-Grained Retrieval on Structure-Sequence Multimodal Representations
  7. 2025Protein Inverse Folding From Structure Feedback
  8. 2022Protein structure generation via folding diffusion