SSM-DTA: Breaking the Barriers of Data Scarcity in Drug-Target Affinity Prediction
Not on the map. Why?
Abstract (arXiv)
Accurate prediction of Drug-Target Affinity (DTA) is of vital importance in early-stage drug discovery, facilitating the identification of drugs that can effectively interact with specific targets and regulate their activities. While wet experiments remain the most reliable method, they are time-consuming and resource-intensive, resulting in limited data availability that poses challenges for deep learning approaches. Existing methods have primarily focused on developing techniques based on the available DTA data, without adequately addressing the data scarcity issue. To overcome this challenge, we present the SSM-DTA framework, which incorporates three simple yet highly effective strategies: (1) A multi-task training approach that combines DTA prediction with masked language modeling (MLM) using paired drug-target data. (2) A semi-supervised training method that leverages large-scale unpaired molecules and proteins to enhance drug and target representations. This approach differs from previous methods that only employed molecules or proteins in pre-training. (3) The integration of a lightweight cross-attention module to improve the interaction between drugs and targets, further enhancing prediction accuracy. Through extensive experiments on benchmark datasets such as BindingDB, DAVIS, and KIBA, we demonstrate the superior performance of our framework. Additionally, we conduct case studies on specific drug-target binding activities, virtual screening experiments, drug feature visualizations, and real-world applications, all of which showcase the significant potential of our work. In conclusion, our proposed SSM-DTA framework addresses the data limitation challenge in DTA prediction and yields promising results, paving the way for more efficient and accurate drug discovery processes. Our code is available at hrefhttps://github.com/QizhiPei/SSM-DTAGithub.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 23 of its 61 references that are in the map. First posted on arXiv 20 Jun 2022.
Builds on
23 of 61 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2021Video Swin Transformercited by 1,091
- 2019Strategies for Pre-training Graph Neural Networkscited by 971
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
11 more
- 2019Evaluating Protein Transfer Learning with TAPEcited by 231
- 2018DeepDTA: Deep Drug-Target Binding Affinity Predictioncited by 173
- 2020Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgettingcited by 170
- 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
- 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 94
- 2018N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Moleculescited by 93
- 2018DeepAffinity: Interpretable Deep Learning of Compound-Protein Affinity through Unified Recurrent and Convolutional Neural Networkscited by 52
- 2019Bridging the Gap between Pre-Training and Fine-Tuning for End-to-End Speech Translationcited by 39
- 2021Dual-view Molecule Pre-trainingcited by 27
- 2019Pre-Training of Deep Bidirectional Protein Sequence Representations with Structural Informationcited by 15
- 2022Mitigating cold start problems in drug-target affinity prediction with interaction knowledge transferringcited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 4; 2026: 1.
8 papers.
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2024Tx-LLM: A Large Language Model for Therapeuticscited by 25
- 2025Biological Sequence with Language Model Prompting: A Surveycited by 2
- 2025DynamicDTA: Drug-Target Binding Affinity Prediction Using Dynamic Descriptors and Graph Representationcited by 1
- 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Designcited by 1
- 2024Exploiting Pre-trained Models for Drug Target Affinity Prediction with Nearest Neighborscited by 0
- 2025LINKER: Learning Interactions Between Functional Groups and Residues With Chemical Knowledge-Enhanced Reasoning and Explainabilitycited by 0
- 2026Chemical and geometric representation fidelity improves drug--target affinity predictioncited by 0
- 2026Chemical and geometric representation fidelity improves drug--target affinity prediction2 Sep 2026
- 2025LINKER: Learning Interactions Between Functional Groups and Residues With Chemical Knowledge-Enhanced Reasoning and Explainability3 Sep 2025
- 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design14 Aug 2025
- 2025DynamicDTA: Drug-Target Binding Affinity Prediction Using Dynamic Descriptors and Graph Representation13 May 2025
- 2025Biological Sequence with Language Model Prompting: A Survey6 Mar 2025
- 2024Exploiting Pre-trained Models for Drug Target Affinity Prediction with Nearest Neighbors21 Jul 2024
- 2024Tx-LLM: A Large Language Model for Therapeutics10 Jun 2024
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-413 Nov 2023
Similar, not cited
Close in wording, no citation either way
- 2026Co-Diffusion: An Affinity-Aware Two-Stage Latent Diffusion Framework for Generalizable Drug-Target Affinity Prediction
- 2025LLMs for Drug-Drug Interaction Prediction: A Comprehensive Comparison
- 2026DrugPlayGround: Benchmarking Large Language Models and Embeddings for Drug Discovery
- 2023DiffDTM: A conditional structure-free framework for bioactive molecules generation targeted for dual proteins
- 2026ISAAC: Auditing Causal Reasoning in Deep Models for Drug-Target Interaction
- 2025A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery
- 2024Reprogramming Pretrained Target-Specific Diffusion Models for Dual-Target Drug Design
- 2026Evaluating the Progression of Large Language Model Capabilities for Small-Molecule Drug Design