Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation
Not on the map. Why?
Abstract (arXiv)
The field of protein folding research has been greatly advanced by deep learning methods, with AlphaFold2 (AF2) demonstrating exceptional performance and atomic-level precision. As co-evolution is integral to protein structure prediction, AF2's accuracy is significantly influenced by the depth of multiple sequence alignment (MSA), which requires extensive exploration of a large protein database for similar sequences. However, not all protein sequences possess abundant homologous families, and consequently, AF2's performance can degrade on such queries, at times failing to produce meaningful results. To address this, we introduce a novel generative language model, MSA-Augmenter, which leverages protein-specific attention mechanisms and large-scale MSAs to generate useful, novel protein sequences not currently found in databases. These sequences supplement shallow MSAs, enhancing the accuracy of structural property predictions. Our experiments on CASP14 demonstrate that MSA-Augmenter can generate de novo sequences that retain co-evolutionary information from inferior MSAs, thereby improving protein structure prediction quality on top of strong AF2.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 2 Jun 2023.
Builds on
15 of 31 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2019Axial Attention in Multidimensional Transformerscited by 350
- 2020Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processingcited by 161
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
Built on by
Citing papers per year: 2024: 2; 2025: 3.
5 papers.
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domainscited by 80
- 2024MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Trainingcited by 7
- 2025Computational Protein Science in the Era of Large Language Models (LLMs)cited by 6
- 2025Large Language Models for Bioinformaticscited by 3
- 2025Lightweight MSA Design Advances Protein Folding From Evolutionary Embeddingscited by 1
- 2025Lightweight MSA Design Advances Protein Folding From Evolutionary Embeddings17 Jun 2025
- 2025Computational Protein Science in the Era of Large Language Models (LLMs)17 Jan 2025
- 2025Large Language Models for Bioinformatics10 Jan 2025
- 2024MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Training8 Jun 2024
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domains26 Jan 2024
Similar, not cited
Close in wording, no citation either way
- 2022Protein language models trained on multiple sequence alignments learn phylogenetic relationships
- 2026Training-Free Generation of Protein Sequences from Small Family Alignments via Stochastic Attention
- 2026ProtAlign: Contrastive learning paradigm for Sequence and structure alignment
- 2024Improving Inverse Folding for Peptide Design with Diversity-regularized Direct Preference Optimization
- 2025ProtInvTree: Deliberate Protein Inverse Folding with Reward-guided Tree Search
- 2025PRISM: Enhancing Protein Inverse Folding through Fine-Grained Retrieval on Structure-Sequence Multimodal Representations
- 2022Protein Sequence and Structure Co-Design with Equivariant Translation
- 2025Protein Structure Tokenization: Benchmarking and New Recipe