# LLMs for Drug-Drug Interaction Prediction: A Comprehensive Comparison

arXiv: https://arxiv.org/abs/2502.06890 · HTML: https://mlsanity.com/paper/2502.06890/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 45 references that are in the map.
- First posted on arXiv 9 Feb 2025.

## Builds on (most cited first, 11 of 11)

- [LoRA: Low-Rank Adaptation of Large Language Models](https://mlsanity.com/paper/2106.09685/) (2021)
- [QLoRA: Efficient Finetuning of Quantized LLMs](https://mlsanity.com/paper/2305.14314/) (2023)
- [Optuna: A Next-generation Hyperparameter Optimization Framework](https://mlsanity.com/paper/1907.10902/) (2019)
- [LIMA: Less Is More for Alignment](https://mlsanity.com/paper/2305.11206/) (2023)
- [A systematic study of the class imbalance problem in convolutional neural networks](https://mlsanity.com/paper/1710.05381/) (2017)
- [Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction Prediction](https://mlsanity.com/paper/2010.11711/) (2020)
- [Comprehensive evaluation of deep and graph learning on drug-drug interactions prediction](https://mlsanity.com/paper/2306.05257/) (2023)
- [STNN-DDI: A Substructure-aware Tensor Neural Network to Predict Drug-Drug Interactions](https://mlsanity.com/paper/2111.05708/) (2021)
- [Detecting drug-drug interactions using artificial neural networks and classic graph similarity measures](https://mlsanity.com/paper/1903.04571/) (2019)
- [Emerging Opportunities of Using Large Language Models for Translation Between Drug Molecules and Indications](https://mlsanity.com/paper/2402.09588/) (2024)
- [HELIOT: LLM-Based CDSS for Adverse Drug Reaction Management](https://mlsanity.com/paper/2409.16395/) (2024)

## Built on by (most cited first, 5 of 5)

- [Evolution of meta's llama models and parameter-efficient fine-tuning of large language models: a survey](https://mlsanity.com/paper/2510.12178/) (2025)
- [Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategies](https://mlsanity.com/paper/2503.07306/) (2025)
- [Case-Based Reasoning Enhances the Predictive Power of LLMs in Drug-Drug Interaction](https://mlsanity.com/paper/2505.23034/) (2025)
- [Machine-Learning-Enhanced Non-Invasive Testing for MASLD Fibrosis: Shallow-Deep Neural Networks Versus FIB-4, Tabular Foundation Models, and Large Language Models](https://mlsanity.com/paper/2605.20523/) (2026)
- [MARD: Mirror-Augmented Reasoning Distillation for Mechanism-Level Drug-Drug Interaction Prediction](https://mlsanity.com/paper/2606.12578/) (2026)

## Abstract (arXiv)

The increasing volume of drug combinations in modern therapeutic regimens needs reliable methods for predicting drug-drug interactions (DDIs). While Large Language Models (LLMs) have revolutionized various domains, their potential in pharmaceutical research, particularly in DDI prediction, remains largely unexplored. This study thoroughly investigates LLMs' capabilities in predicting DDIs by uniquely processing molecular structures (SMILES), target organisms, and gene interaction data as raw text input from the latest DrugBank dataset. We evaluated 18 different LLMs, including proprietary models (GPT-4, Claude, Gemini) and open-source variants (from 1.5B to 72B parameters), first assessing their zero-shot capabilities in DDI prediction. We then fine-tuned selected models (GPT-4, Phi-3.5 2.7B, Qwen-2.5 3B, Gemma-2 9B, and Deepseek R1 distilled Qwen 1.5B) to optimize their performance. Our comprehensive evaluation framework included validation across 13 external DDI datasets, comparing against traditional approaches such as l2-regularized logistic regression. Fine-tuned LLMs demonstrated superior performance, with Phi-3.5 2.7B achieving a sensitivity of 0.978 in DDI prediction, with an accuracy of 0.919 on balanced datasets (50% positive, 50% negative cases). This result represents an improvement over both zero-shot predictions and state-of-the-art machine-learning methods used for DDI prediction. Our analysis reveals that LLMs can effectively capture complex molecular interaction patterns and cases where drug pairs target common genes, making them valuable tools for practical applications in pharmaceutical research and clinical settings.
