Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Not on the map. Why?
Abstract (arXiv)
Recently exciting progress has been made on protein contact prediction, but the predicted contacts for proteins without many sequence homologs is still of low quality and not very useful for de novo structure prediction. This paper presents a new deep learning method that predicts contacts by integrating both evolutionary coupling (EC) and sequence conservation information through an ultra-deep neural network formed by two deep residual networks. This deep neural network allows us to model very complex sequence-contact relationship as well as long-range inter-contact correlation. Our method greatly outperforms existing contact prediction methods and leads to much more accurate contact-assisted protein folding. Tested on three datasets of 579 proteins, the average top L long-range prediction accuracy obtained our method, the representative EC method CCMpred and the CASP11 winner MetaPSICOV is 0.47, 0.21 and 0.30, respectively; the average top L/10 long-range accuracy of our method, CCMpred and MetaPSICOV is 0.77, 0.47 and 0.59, respectively. Ab initio folding using our predicted contacts as restraints can yield correct folds (i.e., TMscore>0.6) for 203 test proteins, while that using MetaPSICOV- and CCMpred-predicted contacts can do so for only 79 and 62 proteins, respectively. Further, our contact-assisted models have much better quality than template-based models. Using our predicted contacts as restraints, we can (ab initio) fold 208 of the 398 membrane proteins with TMscore>0.5. By contrast, when the training proteins of our method are used as templates, homology modeling can only do so for 10 of them. One interesting finding is that even if we do not train our prediction models with any membrane proteins, our method works very well on membrane protein prediction. Finally, in recent blind CAMEO benchmark our method successfully folded 5 test proteins with a novel fold.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 8; 2024: 2; 2025: 2; 2026: 2.
31 papers.
Sort:
- 2022Diffusion-based Molecule Generation with Informative Prior Bridgescited by 104
- 2022E3Bind: An End-to-End Equivariant Network for Protein-Ligand Dockingcited by 35
- 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problemscited by 29
- 2021Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Modelcited by 20
- 2022Exploring evolution-aware & -free protein language models as protein function predictorscited by 20
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2022Protein Language Models and Structure Prediction: Connection and Progressioncited by 17
- 2021Which transformer architecture fits my data? A vocabulary bottleneck in self-attentioncited by 16
- 2023Generative Pretrained Autoregressive Transformer Graph Neural Network applied to the Analysis and Discovery of Novel Proteinscited by 10
- 2023OpenProteinSet: Training data for structural biology at scalecited by 8
- 2021Pandemic Drugs at Pandemic Speed: Infrastructure for Accelerating COVID-19 Drug Discovery with Hybrid Machine Learning- and Physics-based Simulations on High Performance Computerscited by 7
- 2022HRel: Filter Pruning based on High Relevance between Activation Maps and Class Labelscited by 7
19 more
- 2023Multi-task Bioassay Pre-training for Protein-ligand Binding Affinity Predictioncited by 7
- 2021Protein-RNA interaction prediction with deep learning: Structure matterscited by 6
- 2021Protein sequence-to-structure learning: Is this the end(-to-end revolution)?cited by 3
- 2022PSP: Million-level Protein Sequence Dataset for Protein Structure Predictioncited by 3
- 2021G-VAE, a Geometric Convolutional VAE for ProteinStructure Generationcited by 2
- 2022Symmetry Structured Convolutional Neural Networkscited by 2
- 2022Multiscale Graph Neural Networks for Protein Residue Contact Map Predictioncited by 1
- 2022Deciphering RNA Secondary Structure Prediction: A Probabilistic K-Rook Matching Perspectivecited by 1
- 2025BioArc: Discovering Optimal Neural Architectures for Biological Foundation Modelscited by 1
- 2021tFold-TR: Combining Deep Learning Enhanced Hybrid Potential Energy for Template-Based Modeling Structure Refinementcited by 0
- 2022Learning to Discover Medicinescited by 0
- 2023CoGANPPIS: A Coevolution-enhanced Global Attention Neural Network for Protein-Protein Interaction Site Predictioncited by 0
- 2023Improving Protein-peptide Interface Predictions in the Low Data Regimecited by 0
- 2023MATE-Pred: Multimodal Attention-based TCR-Epitope interaction Predictorcited by 0
- 2024Kirigami: large convolutional kernels improve deep learning-based RNA secondary structure predictioncited by 0
- 2024ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactionscited by 0
- 2025Learning from B Cell Evolution: Adaptive Multi-Expert Diffusion for Antibody Design via Online Optimizationcited by 0
- 2026LC-SEPLM: long-range contact-supervised adaptation for sequence-only protein representation learningcited by 0
- 2026Protein Structure Prediction: From Evolutionary Constraints to Generative Modelingcited by 0
- 2026Protein Structure Prediction: From Evolutionary Constraints to Generative Modeling17 Aug 2026
- 2026LC-SEPLM: long-range contact-supervised adaptation for sequence-only protein representation learning24 Jul 2026
- 2025BioArc: Discovering Optimal Neural Architectures for Biological Foundation Models29 Nov 2025
- 2025Learning from B Cell Evolution: Adaptive Multi-Expert Diffusion for Antibody Design via Online Optimization25 Jul 2025
- 2024ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions26 Jun 2024
- 2024Kirigami: large convolutional kernels improve deep learning-based RNA secondary structure prediction4 Jun 2024
- 2023MATE-Pred: Multimodal Attention-based TCR-Epitope interaction Predictor5 Dec 2023
- 2023OpenProteinSet: Training data for structural biology at scale10 Aug 2023
- 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problems30 Jun 2023
- 2023Multi-task Bioassay Pre-training for Protein-ligand Binding Affinity Prediction8 Jun 2023
- 2023Improving Protein-peptide Interface Predictions in the Low Data Regime31 May 2023
- 2023Generative Pretrained Autoregressive Transformer Graph Neural Network applied to the Analysis and Discovery of Novel Proteins7 May 2023
19 more
- 2023CoGANPPIS: A Coevolution-enhanced Global Attention Neural Network for Protein-Protein Interaction Site Prediction13 Mar 2023
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review11 Mar 2023
- 2022Deciphering RNA Secondary Structure Prediction: A Probabilistic K-Rook Matching Perspective2 Dec 2022
- 2022Multiscale Graph Neural Networks for Protein Residue Contact Map Prediction2 Dec 2022
- 2022Protein Language Models and Structure Prediction: Connection and Progression30 Nov 2022
- 2022E3Bind: An End-to-End Equivariant Network for Protein-Ligand Docking12 Oct 2022
- 2022Diffusion-based Molecule Generation with Informative Prior Bridges2 Sep 2022
- 2022PSP: Million-level Protein Sequence Dataset for Protein Structure Prediction24 Jun 2022
- 2022Exploring evolution-aware & -free protein language models as protein function predictors14 Jun 2022
- 2022Symmetry Structured Convolutional Neural Networks3 Mar 2022
- 2022HRel: Filter Pruning based on High Relevance between Activation Maps and Class Labels22 Feb 2022
- 2022Learning to Discover Medicines14 Feb 2022
- 2021Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model29 Oct 2021
- 2021Protein-RNA interaction prediction with deep learning: Structure matters26 Jul 2021
- 2021G-VAE, a Geometric Convolutional VAE for ProteinStructure Generation22 Jun 2021
- 2021Protein sequence-to-structure learning: Is this the end(-to-end revolution)?16 May 2021
- 2021tFold-TR: Combining Deep Learning Enhanced Hybrid Potential Energy for Template-Based Modeling Structure Refinement10 May 2021
- 2021Which transformer architecture fits my data? A vocabulary bottleneck in self-attention9 May 2021
- 2021Pandemic Drugs at Pandemic Speed: Infrastructure for Accelerating COVID-19 Drug Discovery with Hybrid Machine Learning- and Physics-based Simulations on High Performance Computers4 Mar 2021
- 2022Diffusion-based Molecule Generation with Informative Prior Bridgescited by 104
- 2022E3Bind: An End-to-End Equivariant Network for Protein-Ligand Dockingcited by 35
- 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problemscited by 29
- 2021Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Modelcited by 20
- 2022Exploring evolution-aware & -free protein language models as protein function predictorscited by 20
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2022Protein Language Models and Structure Prediction: Connection and Progressioncited by 17
- 2021Which transformer architecture fits my data? A vocabulary bottleneck in self-attentioncited by 16
- 2023Generative Pretrained Autoregressive Transformer Graph Neural Network applied to the Analysis and Discovery of Novel Proteinscited by 10
- 2023OpenProteinSet: Training data for structural biology at scalecited by 8
- 2021Pandemic Drugs at Pandemic Speed: Infrastructure for Accelerating COVID-19 Drug Discovery with Hybrid Machine Learning- and Physics-based Simulations on High Performance Computerscited by 7
- 2022HRel: Filter Pruning based on High Relevance between Activation Maps and Class Labelscited by 7
12 most cited of 31 All 31 (JSON)
- 2026Protein Structure Prediction: From Evolutionary Constraints to Generative Modeling17 Aug 2026
- 2026LC-SEPLM: long-range contact-supervised adaptation for sequence-only protein representation learning24 Jul 2026
- 2025BioArc: Discovering Optimal Neural Architectures for Biological Foundation Models29 Nov 2025
- 2025Learning from B Cell Evolution: Adaptive Multi-Expert Diffusion for Antibody Design via Online Optimization25 Jul 2025
- 2024ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions26 Jun 2024
- 2024Kirigami: large convolutional kernels improve deep learning-based RNA secondary structure prediction4 Jun 2024
- 2023MATE-Pred: Multimodal Attention-based TCR-Epitope interaction Predictor5 Dec 2023
- 2023OpenProteinSet: Training data for structural biology at scale10 Aug 2023
- 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problems30 Jun 2023
- 2023Multi-task Bioassay Pre-training for Protein-ligand Binding Affinity Prediction8 Jun 2023
- 2023Improving Protein-peptide Interface Predictions in the Low Data Regime31 May 2023
- 2023Generative Pretrained Autoregressive Transformer Graph Neural Network applied to the Analysis and Discovery of Novel Proteins7 May 2023
12 newest of 31 All 31 (JSON)