EBM-Fold: Fully-Differentiable Protein Folding Powered by Energy-based Models
Not on the map. Why?
Abstract (arXiv)
Accurate protein structure prediction from amino-acid sequences is critical to better understanding the protein function. Recent advances in this area largely benefit from more precise inter-residue distance and orientation predictions, powered by deep neural networks. However, the structure optimization procedure is still dominated by traditional tools, e.g. Rosetta, where the structure is solved via minimizing a pre-defined statistical energy function (with optional prediction-based restraints). Such energy function may not be optimal in formulating the whole conformation space of proteins. In this paper, we propose a fully-differentiable approach for protein structure optimization, guided by a data-driven generative network. This network is trained in a denoising manner, attempting to predict the correction signal from corrupted distance matrices between Ca atoms. Once the network is well trained, Langevin dynamics based sampling is adopted to gradually optimize structures from random initialization. Extensive experiments demonstrate that our EBM-Fold approach can efficiently produce high-quality decoys, compared against traditional Rosetta-based structure optimization routines.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 22 of its 59 references that are in the map. First posted on arXiv 11 May 2021.
Builds on
22 of 59 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
- 2017Reinforcement Learning with Deep Energy-Based Policiescited by 659
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 381
- 2021How to Train Your Energy-Based Modelscited by 271
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 260
10 more
- 2016A Theory of Generative ConvNetcited by 174
- 2021Learning Gradient Fields for Molecular Conformation Generationcited by 162
- 2020LieTransformer: Equivariant self-attention for Lie Groupscited by 100
- 2020Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classificationcited by 57
- 2018Learning Descriptor Networks for 3D Shape Synthesis and Analysiscited by 56
- 2018Learning deep kernels for exponential family densitiescited by 36
- 2020Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysiscited by 26
- 2019Learning Energy-based Spatial-Temporal Generative ConvNets for Dynamic Patternscited by 22
- 2020Energy-based models for atomic-resolution protein conformationscited by 20
- 2021Iterative SE(3)-Transformerscited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 1.
3 papers.
- 2022Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problemcited by 229
- 2023Unsupervised Protein-Ligand Binding Energy Prediction via Neural Euler's Rotation Equationcited by 18
- 2022Unsupervisedly Prompting AlphaFold2 for Few-Shot Learning of Accurate Folding Landscape and Protein Structure Predictioncited by 1
- 2023Unsupervised Protein-Ligand Binding Energy Prediction via Neural Euler's Rotation Equation25 Jan 2023
- 2022Unsupervisedly Prompting AlphaFold2 for Few-Shot Learning of Accurate Folding Landscape and Protein Structure Prediction20 Aug 2022
- 2022Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem8 Jun 2022