Uncertainty-Aware Adaptation of Large Language Models for Protein-Protein Interaction Analysis
Not on the map. Why?
Abstract (arXiv)
Identification of protein-protein interactions (PPIs) helps derive cellular mechanistic understanding, particularly in the context of complex conditions such as neurodegenerative disorders, metabolic syndromes, and cancer. Large Language Models (LLMs) have demonstrated remarkable potential in predicting protein structures and interactions via automated mining of vast biomedical literature; yet their inherent uncertainty remains a key challenge for deriving reproducible findings, critical for biomedical applications. In this study, we present an uncertainty-aware adaptation of LLMs for PPI analysis, leveraging fine-tuned LLaMA-3 and BioMedGPT models. To enhance prediction reliability, we integrate LoRA ensembles and Bayesian LoRA models for uncertainty quantification (UQ), ensuring confidence-calibrated insights into protein behavior. Our approach achieves competitive performance in PPI identification across diverse disease contexts while addressing model uncertainty, thereby enhancing trustworthiness and reproducibility in computational biology. These findings underscore the potential of uncertainty-aware LLM adaptation for advancing precision medicine and biomedical research.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 62 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
36 of 62 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2022Galactica: A Large Language Model for Sciencecited by 736
24 more
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2024Large Language Models: A Surveycited by 506
- 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 359
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2024A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directionscited by 115
- 2023Bayesian Low-rank Adaptation for Large Language Modelscited by 112
- 2024Taming Overconfidence in LLMs: Reward Calibration in RLHFcited by 105
- 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 99
- 2023LoRA ensembles for large language model fine-tuningcited by 65
- 2024BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Modelscited by 48
- 2024ClimateGPT: Towards AI Synthesizing Interdisciplinary Research on Climate Changecited by 46
- 2024Think Twice Before Trusting: Self-Detection for Large Language Models through Comprehensive Answer Reflectioncited by 40
- 2024Uncertainty quantification in fine-tuned LLMs using LoRA ensemblescited by 35
- 2022Adapting the Linearised Laplace Model Evidence for Modern Deep Learningcited by 29
- 2023Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Modelscited by 29
- 2024Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Modelscited by 20
- 2021Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Detailscited by 14
- 2023Learning Active Subspaces for Effective and Scalable Uncertainty Quantification in Deep Neural Networkscited by 9
- 2024Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gatescited by 8
- 2022Sequential Bayesian Neural Subnetwork Ensemblescited by 5
- 2023Spike-and-slab shrinkage priors for structurally sparse Bayesian neural networkscited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.