mlsanityData to 14 Oct 2026

Beyond Simple Concatenation: Fairly Assessing PLM Architectures for Multi-Chain Protein-Protein Interactions Prediction

arXiv 2505.20036 ↗First posted 26 May 2025cs.LG q-bio.BMcited by 2

Not on the map. Why?

Abstract (arXiv)

Protein-protein interactions (PPIs) are fundamental to numerous cellular processes, and their characterization is vital for understanding disease mechanisms and guiding drug discovery. While protein language models (PLMs) have demonstrated remarkable success in predicting protein structure and function, their application to sequence-based PPI binding affinity prediction remains relatively underexplored. This gap is often attributed to the scarcity of high-quality, rigorously refined datasets and the reliance on simple strategies for concatenating protein representations. In this work, we address these limitations. First, we introduce a meticulously curated version of the PPB-Affinity dataset of a total of 8,207 unique protein-protein interaction entries, by resolving annotation inconsistencies and duplicate entries for multi-chain protein interactions. This dataset incorporates a stringent, less than or equal to 30%, sequence identity threshold to ensure robust splitting into training, validation, and test sets, minimizing data leakage. Second, we propose and systematically evaluate four architectures for adapting PLMs to PPI binding affinity prediction: embeddings concatenation (EC), sequences concatenation (SC), hierarchical pooling (HP), and pooled attention addition (PAD). These architectures were assessed using two training methods: full fine-tuning and a lightweight approach employing ConvBERT heads over frozen PLM features. Our comprehensive experiments across multiple leading PLMs (ProtT5, ESM2, Ankh, Ankh2, and ESM3) demonstrated that the HP and PAD architectures consistently outperform conventional concatenation methods, achieving up to 12% increase in terms of Spearman correlation. These results highlight the necessity of sophisticated architectural designs to fully exploit the capabilities of PLMs for nuanced PPI binding affinity prediction.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 8 of its 38 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

8 of 38 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Datasets: A Community Library for Natural Language Processingcited by 530
  3. 2019Evaluating Protein Transfer Learning with TAPEcited by 231
  4. 2020ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 162
  5. 2020ConvBERT: Improving BERT with Span-based Dynamic Convolutioncited by 88
  6. 2022PEER: A Comprehensive and Multi-Task Benchmark for Protein Sequence Understandingcited by 77
  7. 2023Ankh: Optimized Protein Language Model Unlocks General-Purpose Modellingcited by 45
  8. 2024Revealing data leakage in protein interaction benchmarkscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.