MutaPLM: Protein Language Modeling for Mutation Explanation and Engineering
Not on the map. Why?
Abstract (arXiv)
Studying protein mutations within amino acid sequences holds tremendous significance in life sciences. Protein language models (PLMs) have demonstrated strong capabilities in broad biological applications. However, due to architectural design and lack of supervision, PLMs model mutations implicitly with evolutionary plausibility, which is not satisfactory to serve as explainable and engineerable tools in real-world studies. To address these issues, we present MutaPLM, a unified framework for interpreting and navigating protein mutations with protein language models. MutaPLM introduces a protein delta network that captures explicit protein mutation representations within a unified feature space, and a transfer learning pipeline with a chain-of-thought (CoT) strategy to harvest protein mutation knowledge from biomedical texts. We also construct MutaDescribe, the first large-scale protein mutation dataset with rich textual annotations, which provides cross-modal supervision signals. Through comprehensive experiments, we demonstrate that MutaPLM excels at providing human-understandable explanations for mutational effects and prioritizing novel mutations with desirable properties. Our code, model, and data are open-sourced at https://github.com/PharMolix/MutaPLM.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 101 references that are in the map. First posted on arXiv 30 Oct 2024.
Builds on
35 of 101 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023Mistral 7Bcited by 3,065
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2020Self-supervised Learning: Generative or Contrastivecited by 693
23 more
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2020A Survey of Deep Active Learningcited by 547
- 2017Beam Search Strategies for Neural Machine Translationcited by 232
- 2023Continual Pre-training of Language Modelscited by 194
- 2023Protein Design with Guided Discrete Diffusioncited by 154
- 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
- 2020ProGen: Language Modeling for Protein Generationcited by 127
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2019Conditioning by adaptive sampling for robust designcited by 110
- 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
- 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 99
- 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 78
- 2023ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Textscited by 78
- 2022OntoProtein: Protein Pretraining With Gene Ontology Embeddingcited by 70
- 2023Structure-informed Language Models Are Protein Designerscited by 68
- 2020AdaLead: A simple and robust adaptive greedy search algorithm for sequence designcited by 63
- 2024ProLLaMA: A Protein Large Language Model for Multi-Task Protein Language Processingcited by 53
- 2023PoET: A generative model of protein families as sequences-of-sequencescited by 29
- 2020Deep Learning in Protein Structural Modeling and Designcited by 25
- 2024ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Trainingcited by 21
- 2022Plug & Play Directed Evolution of Proteins with Gradient-based Discrete MCMCcited by 17
- 2024Multi-Modal CLIP-Informed Protein Editingcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026PFArena: Benchmarking Language Models for Protein Modification
- 2024Reinforcement Learning for Sequence Design Leveraging Protein Language Models
- 2024DPLM-2: A Multimodal Diffusion Protein Language Model
- 2025Understanding protein function with a multimodal retrieval-augmented foundation model
- 2024Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
- 2025Evolutionary Profiles for Protein Fitness Prediction
- 2026Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
- 2026Towards A Generative Protein Evolution Machine with DPLM-Evo