mlsanityData to 7 Oct 2026

Unsupervisedly Prompting AlphaFold2 for Few-Shot Learning of Accurate Folding Landscape and Protein Structure Prediction

arXiv 2208.09652 ↗First posted 20 Aug 2022cs.LG cs.AI physics.bio-phcited by 1

Not on the map. Why?

Abstract (arXiv)

Data-driven predictive methods which can efficiently and accurately transform protein sequences into biologically active structures are highly valuable for scientific research and medical development. Determining accurate folding landscape using co-evolutionary information is fundamental to the success of modern protein structure prediction methods. As the state of the art, AlphaFold2 has dramatically raised the accuracy without performing explicit co-evolutionary analysis. Nevertheless, its performance still shows strong dependence on available sequence homologs. Based on the interrogation on the cause of such dependence, we presented EvoGen, a meta generative model, to remedy the underperformance of AlphaFold2 for poor MSA targets. By prompting the model with calibrated or virtually generated homologue sequences, EvoGen helps AlphaFold2 fold accurately in low-data regime and even achieve encouraging performance with single-sequence predictions. Being able to make accurate predictions with few-shot MSA not only generalizes AlphaFold2 better for orphan sequences, but also democratizes its use for high-throughput applications. Besides, EvoGen combined with AlphaFold2 yields a probabilistic structure generation method which could explore alternative conformations of protein sequences, and the task-aware differentiable algorithm for sequence generation will benefit other related tasks including protein design.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 63 references that are in the map. First posted on arXiv 20 Aug 2022.

Builds on

15 of 63 references.

References · 15

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  8. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  9. 2016HyperNetworkscited by 1,003
  10. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  11. 2016Learning to learn by gradient descent by gradient descentcited by 616
  12. 2015Generating Sentences from a Continuous Spacecited by 607
3 more
  1. 2020Molecular CT: Unifying Geometry and Representation Learning for Molecules at Different Scalescited by 4
  2. 2021EBM-Fold: Fully-Differentiable Protein Folding Powered by Energy-based Modelscited by 3
  3. 2022PSP: Million-level Protein Sequence Dataset for Protein Structure Predictioncited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.