Retrieval-Enhanced Mutation Mastery: Augmenting Zero-Shot Prediction of Protein Language Model
Not on the map. Why?
Abstract (arXiv)
Enzyme engineering enables the modification of wild-type proteins to meet industrial and research demands by enhancing catalytic activity, stability, binding affinities, and other properties. The emergence of deep learning methods for protein modeling has demonstrated superior results at lower costs compared to traditional approaches such as directed evolution and rational design. In mutation effect prediction, the key to pre-training deep learning models lies in accurately interpreting the complex relationships among protein sequence, structure, and function. This study introduces a retrieval-enhanced protein language model for comprehensive analysis of native properties from sequence and local structural interactions, as well as evolutionary properties from retrieved homologous sequences. The state-of-the-art performance of the proposed ProtREM is validated on over 2 million mutants across 217 assays from an open benchmark (ProteinGym). We also conducted post-hoc analyses of the model's ability to improve the stability and binding affinity of a VHH antibody. Additionally, we designed 10 new mutants on a DNA polymerase and conducted wet-lab experiments to evaluate their enhanced activity at higher temperatures. Both in silico and experimental evaluations confirmed that our method provides reliable predictions of mutation effects, offering an auxiliary tool for biologists aiming to evolve existing enzymes. The implementation is publicly available at https://github.com/tyang816/ProtREM.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 4 of its 37 references that are in the map. First posted on arXiv 28 Oct 2024.
Builds on
4 of 37 references.
References · 4
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 313
- 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
- 2024Protein Representation Learning with Sequence Information Embedding: Does it Always Lead to a Better Performance?cited by 4
Built on by
Citing papers per year: 2025: 7.
7 papers.
- 2025Understanding protein function with a multimodal retrieval-augmented foundation modelcited by 6
- 2025VenusX: Unlocking Fine-Grained Functional Understanding of Proteinscited by 5
- 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?cited by 4
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directionscited by 3
- 2025Sequence-Only Prediction of Binding Affinity Changes: A Robust and Interpretable Model for Antibody Engineeringcited by 3
- 2025InstructPLM-mu: 1-Hour Fine-Tuning of ESM2 Beats ESM3 in Protein Mutation Predictionscited by 0
- 2025Evolutionary Profiles for Protein Fitness Predictioncited by 0
- 2025Evolutionary Profiles for Protein Fitness Prediction8 Oct 2025
- 2025InstructPLM-mu: 1-Hour Fine-Tuning of ESM2 Beats ESM3 in Protein Mutation Predictions3 Oct 2025
- 2025Understanding protein function with a multimodal retrieval-augmented foundation model5 Aug 2025
- 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?26 May 2025
- 2025VenusX: Unlocking Fine-Grained Functional Understanding of Proteins17 May 2025
- 2025Sequence-Only Prediction of Binding Affinity Changes: A Robust and Interpretable Model for Antibody Engineering14 May 2025
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directions20 Mar 2025