mlsanityData to 14 Oct 2026

Retrieval-Enhanced Mutation Mastery: Augmenting Zero-Shot Prediction of Protein Language Model

arXiv 2410.21127 ↗First posted 28 Oct 2024cs.CL cs.AI q-bio.QMcited by 7

Not on the map. Why?

Abstract (arXiv)

Enzyme engineering enables the modification of wild-type proteins to meet industrial and research demands by enhancing catalytic activity, stability, binding affinities, and other properties. The emergence of deep learning methods for protein modeling has demonstrated superior results at lower costs compared to traditional approaches such as directed evolution and rational design. In mutation effect prediction, the key to pre-training deep learning models lies in accurately interpreting the complex relationships among protein sequence, structure, and function. This study introduces a retrieval-enhanced protein language model for comprehensive analysis of native properties from sequence and local structural interactions, as well as evolutionary properties from retrieved homologous sequences. The state-of-the-art performance of the proposed ProtREM is validated on over 2 million mutants across 217 assays from an open benchmark (ProteinGym). We also conducted post-hoc analyses of the model's ability to improve the stability and binding affinity of a VHH antibody. Additionally, we designed 10 new mutants on a DNA polymerase and conducted wet-lab experiments to evaluate their enhanced activity at higher temperatures. Both in silico and experimental evaluations confirmed that our method provides reliable predictions of mutation effects, offering an auxiliary tool for biologists aiming to evolve existing enzymes. The implementation is publicly available at https://github.com/tyang816/ProtREM.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 4 of its 37 references that are in the map. First posted on arXiv 28 Oct 2024.

Builds on

4 of 37 references.

References · 4

  1. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  2. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 313
  3. 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
  4. 2024Protein Representation Learning with Sequence Information Embedding: Does it Always Lead to a Better Performance?cited by 4

Built on by

Cited by year

Citing papers per year: 2025: 7.

7 papers.