mlsanityData to 14 Oct 2026

Protein as a Second Language for LLMs

arXiv 2510.11188 ↗First posted 13 Oct 2025cs.LG cs.AI q-bio.BMcited by 0

Not on the map. Why?

Abstract (arXiv)

Deciphering the function of unseen protein sequences is a fundamental challenge with broad scientific impact, yet most existing methods depend on task-specific adapters or large-scale supervised fine-tuning. We introduce the "Protein-as-Second-Language" framework, which reformulates amino-acid sequences as sentences in a novel symbolic language that large language models can interpret through contextual exemplars. Our approach adaptively constructs sequence-question-answer triples that reveal functional cues in a zero-shot setting, without any further training. To support this process, we curate a bilingual corpus of 79,926 protein-QA instances spanning attribute prediction, descriptive understanding, and extended reasoning. Empirically, our method delivers consistent gains across diverse open-source LLMs and GPT-4, achieving up to 17.2% ROUGE-L improvement (average +7%) and even surpassing fine-tuned protein-specific language models. These results highlight that generic LLMs, when guided with protein-as-language cues, can outperform domain-specialized models, offering a scalable pathway for protein understanding in foundation models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 57 references that are in the map. First posted on arXiv 13 Oct 2025.

Builds on

22 of 57 references.

References · 22

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  3. 2022Galactica: A Large Language Model for Sciencecited by 744
  4. 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 159
  5. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 133
  6. 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
  7. 2023ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Textscited by 78
  8. 2022OntoProtein: Protein Pretraining With Gene Ontology Embeddingcited by 70
  9. 2024ProLLaMA: A Protein Large Language Model for Multi-Task Protein Language Processingcited by 53
  10. 2024xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Proteincited by 50
  11. 2023Prot2Text: Multimodal Protein's Function Generation with GNNs and Transformerscited by 32
  12. 2024ProtT3: Protein-to-Text Generation for Text-based Protein Understandingcited by 25
10 more
  1. 2024ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understandingcited by 23
  2. 2024ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Trainingcited by 21
  3. 2024A Fine-tuning Dataset and Benchmark for Large Language Models for Protein Understandingcited by 19
  4. 2024ProtChatGPT: Towards Understanding Proteins with Large Language Modelscited by 18
  5. 2025Protein Large Language Models: A Comprehensive Surveycited by 18
  6. 2024EvoLlama: Enhancing LLMs' Understanding of Proteins via Multimodal Structure and Sequence Representationscited by 9
  7. 2025VenusX: Unlocking Fine-Grained Functional Understanding of Proteinscited by 5
  8. 2024Unifying Sequences, Structures, and Descriptions for Any-to-Any Protein Generation with the Large Multimodal Model HelixProtXcited by 4
  9. 2025ProtTeX: Structure-In-Context Reasoning and Editing of Proteins with Large Language Modelscited by 4
  10. 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?cited by 4

Built on by

Not cited yet.