mlsanityData to 7 Oct 2026

MutaPLM: Protein Language Modeling for Mutation Explanation and Engineering

arXiv 2410.22949 ↗First posted 30 Oct 2024cs.LG q-bio.BMcited by 1

Not on the map. Why?

Abstract (arXiv)

Studying protein mutations within amino acid sequences holds tremendous significance in life sciences. Protein language models (PLMs) have demonstrated strong capabilities in broad biological applications. However, due to architectural design and lack of supervision, PLMs model mutations implicitly with evolutionary plausibility, which is not satisfactory to serve as explainable and engineerable tools in real-world studies. To address these issues, we present MutaPLM, a unified framework for interpreting and navigating protein mutations with protein language models. MutaPLM introduces a protein delta network that captures explicit protein mutation representations within a unified feature space, and a transfer learning pipeline with a chain-of-thought (CoT) strategy to harvest protein mutation knowledge from biomedical texts. We also construct MutaDescribe, the first large-scale protein mutation dataset with rich textual annotations, which provides cross-modal supervision signals. Through comprehensive experiments, we demonstrate that MutaPLM excels at providing human-understandable explanations for mutational effects and prioritizing novel mutations with desirable properties. Our code, model, and data are open-sourced at https://github.com/PharMolix/MutaPLM.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 101 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

35 of 101 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2023Mistral 7Bcited by 3,065
  10. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  11. 2022Galactica: A Large Language Model for Sciencecited by 736
  12. 2020Self-supervised Learning: Generative or Contrastivecited by 693
23 more
  1. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
  2. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
  3. 2020A Survey of Deep Active Learningcited by 547
  4. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  5. 2023Continual Pre-training of Language Modelscited by 194
  6. 2023Protein Design with Guided Discrete Diffusioncited by 154
  7. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
  8. 2020ProGen: Language Modeling for Protein Generationcited by 127
  9. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  10. 2019Conditioning by adaptive sampling for robust designcited by 110
  11. 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
  12. 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 99
  13. 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 78
  14. 2023ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Textscited by 78
  15. 2022OntoProtein: Protein Pretraining With Gene Ontology Embeddingcited by 70
  16. 2023Structure-informed Language Models Are Protein Designerscited by 68
  17. 2020AdaLead: A simple and robust adaptive greedy search algorithm for sequence designcited by 63
  18. 2024ProLLaMA: A Protein Large Language Model for Multi-Task Protein Language Processingcited by 53
  19. 2023PoET: A generative model of protein families as sequences-of-sequencescited by 29
  20. 2020Deep Learning in Protein Structural Modeling and Designcited by 25
  21. 2024ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Trainingcited by 21
  22. 2022Plug & Play Directed Evolution of Proteins with Gradient-based Discrete MCMCcited by 17
  23. 2024Multi-Modal CLIP-Informed Protein Editingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026PFArena: Benchmarking Language Models for Protein Modification
  2. 2024Reinforcement Learning for Sequence Design Leveraging Protein Language Models
  3. 2024DPLM-2: A Multimodal Diffusion Protein Language Model
  4. 2025Understanding protein function with a multimodal retrieval-augmented foundation model
  5. 2024Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
  6. 2025Evolutionary Profiles for Protein Fitness Prediction
  7. 2026Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
  8. 2026Towards A Generative Protein Evolution Machine with DPLM-Evo