ProLLM: Protein Chain-of-Thoughts Enhanced LLM for Protein-Protein Interaction Prediction
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
The prediction of protein-protein interactions (PPIs) is crucial for understanding biological functions and diseases. Previous machine learning approaches to PPI prediction mainly focus on direct physical interactions, ignoring the broader context of nonphysical connections through intermediate proteins, thus limiting their effectiveness. The emergence of Large Language Models (LLMs) provides a new opportunity for addressing this complex biological challenge. By transforming structured data into natural language prompts, we can map the relationships between proteins into texts. This approach allows LLMs to identify indirect connections between proteins, tracing the path from upstream to downstream. Therefore, we propose a novel framework ProLLM that employs an LLM tailored for PPI for the first time. Specifically, we propose Protein Chain of Thought (ProCoT), which replicates the biological mechanism of signaling pathways as natural language prompts. ProCoT considers a signaling pathway as a protein reasoning process, which starts from upstream proteins and passes through several intermediate proteins to transmit biological signals to downstream proteins. Thus, we can use ProCoT to predict the interaction between upstream proteins and downstream proteins. The training of ProLLM employs the ProCoT format, which enhances the model's understanding of complex biological problems. In addition to ProCoT, this paper also contributes to the exploration of embedding replacement of protein sites in natural language prompts, and instruction fine-tuning in protein knowledge datasets. We demonstrate the efficacy of ProLLM through rigorous validation against benchmark datasets, showing significant improvement over existing methods in terms of prediction accuracy and generalizability. The code is available at: https://github.com/MingyuJ666/ProLLM.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 13 of its 56 references that are in the map. First posted on arXiv 30 Mar 2024.
Builds on
13 of 56 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023Instruction Tuning with GPT-4cited by 676
- 2022Protein Representation Learning by Geometric Structure Pretrainingcited by 161
- 2024The Impact of Reasoning Step Length on Large Language Modelscited by 152
- 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
- 2021Learning Unknown from Correlations: Graph Neural Network for Inter-novel-protein Interaction Predictioncited by 24
- 2024ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Trainingcited by 21
- 2024Health-LLM: Personalized Retrieval-Augmented Disease Prediction Systemcited by 17
- 2023SemiGNN-PPI: Self-Ensembling Multi-Graph Neural Network for Efficient and Generalizable Protein-Protein Interaction Predictioncited by 13
- 2022Why only Micro-F1? Class Weighting of Measures for Relation Classificationcited by 8
Built on by
Citing papers per year: 2024: 2; 2025: 8; 2026: 2.
12 papers.
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 85
- 2025Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understandingcited by 44
- 2025LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Modelscited by 21
- 2024LLM4GRN: Discovering Causal Gene Regulatory Networks with LLMs -- Evaluation through Synthetic Data Generationcited by 7
- 2025Computational Protein Science in the Era of Large Language Models (LLMs)cited by 6
- 2026Proteo-R1: Reasoning Foundation Models for De Novo Protein Designcited by 6
- 2025From Trace to Line: LLM Agent for Real-World OSS Vulnerability Localizationcited by 4
- 2025Knowledge-Augmented Long-CoT Generation for Complex Biomolecular Reasoningcited by 2
- 2025PepThink-R1: LLM for Interpretable Cyclic Peptide Optimization with CoT SFT and Reinforcement Learningcited by 1
- 2024Recent advances in deep learning and language models for studying the microbiomecited by 0
- 2025The Prompt Engineering Report Distilled: Quick Start Guide for Life Sciencescited by 0
- 2026Protein Thoughts: Interpretable Reasoning with Tree of Thoughts and Embedding-Space Flow Matching for Protein-Protein Interaction Discoverycited by 0
- 2026Protein Thoughts: Interpretable Reasoning with Tree of Thoughts and Embedding-Space Flow Matching for Protein-Protein Interaction Discovery19 May 2026
- 2026Proteo-R1: Reasoning Foundation Models for De Novo Protein Design1 May 2026
- 2025Knowledge-Augmented Long-CoT Generation for Complex Biomolecular Reasoning11 Nov 2025
- 2025From Trace to Line: LLM Agent for Real-World OSS Vulnerability Localization30 Sep 2025
- 2025The Prompt Engineering Report Distilled: Quick Start Guide for Life Sciences14 Sep 2025
- 2025PepThink-R1: LLM for Interpretable Cyclic Peptide Optimization with CoT SFT and Reinforcement Learning20 Aug 2025
- 2025LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Models5 Mar 2025
- 2025Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding3 Feb 2025
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models21 Jan 2025
- 2025Computational Protein Science in the Era of Large Language Models (LLMs)17 Jan 2025
- 2024LLM4GRN: Discovering Causal Gene Regulatory Networks with LLMs -- Evaluation through Synthetic Data Generation21 Oct 2024
- 2024Recent advances in deep learning and language models for studying the microbiome15 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2026Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
- 2023InstructProtein: Aligning Human and Protein Language via Knowledge Instruction
- 2025ProtTeX: Structure-In-Context Reasoning and Editing of Proteins with Large Language Models
- 2026ProtLingo: Efficient Protein Language Modeling via Conditional Memory and Expert Routing
- 2026BioBridge: Bridging Proteins and Language for Enhanced Biological Reasoning with LLMs
- 2026AMix-2: Establishing Protein as a Native Modality in Large Language Models
- 2024ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding
- 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?