mlsanityData to 7 Oct 2026

ProFSA: Self-supervised Pocket Pretraining via Protein Fragment-Surroundings Alignment

arXiv 2310.07229 ↗First posted 11 Oct 2023cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

Pocket representations play a vital role in various biomedical applications, such as druggability estimation, ligand affinity prediction, and de novo drug design. While existing geometric features and pretrained representations have demonstrated promising results, they usually treat pockets independent of ligands, neglecting the fundamental interactions between them. However, the limited pocket-ligand complex structures available in the PDB database (less than 100 thousand non-redundant pairs) hampers large-scale pretraining endeavors for interaction modeling. To address this constraint, we propose a novel pocket pretraining approach that leverages knowledge from high-resolution atomic protein structures, assisted by highly effective pretrained small molecule representations. By segmenting protein structures into drug-like fragments and their corresponding pockets, we obtain a reasonable simulation of ligand-receptor interactions, resulting in the generation of over 5 million complexes. Subsequently, the pocket encoder is trained in a contrastive manner to align with the representation of pseudo-ligand furnished by some pretrained small molecule encoders. Our method, named ProFSA, achieves state-of-the-art performance across various tasks, including pocket druggability prediction, pocket matching, and ligand binding affinity prediction. Notably, ProFSA surpasses other pretraining methods by a substantial margin. Moreover, our work opens up a new avenue for mitigating the scarcity of protein-ligand complex data through the utilization of high-quality and diverse protein structure databases.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 19 of its 51 references that are in the map. First posted on arXiv 11 Oct 2023.

Builds on

19 of 51 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  5. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  6. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  7. 2019Evaluating Protein Transfer Learning with TAPEcited by 229
  8. 2018DeepDTA: Deep Drug-Target Binding Affinity Predictioncited by 171
  9. 2020ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 162
  10. 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
  11. 2020ATOM3D: Tasks On Molecules in Three Dimensionscited by 73
  12. 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
7 more
  1. 2022Learning Hierarchical Protein Representations via Complete 3D Graph Networkscited by 54
  2. 2018DeepAffinity: Interpretable Deep Learning of Compound-Protein Affinity through Unified Recurrent and Convolutional Neural Networkscited by 52
  3. 2022Multi-Scale Representation Learning on Proteinscited by 52
  4. 2019Learning protein sequence embeddings using information from structurecited by 50
  5. 2023Fractional Denoising for 3D Molecular Pre-trainingcited by 33
  6. 2023Generalist Equivariant Transformer Towards 3D Molecular Interaction Learningcited by 18
  7. 2022CoSP: Co-supervised pretraining of pocket and ligandcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 2; 2026: 5.

12 papers.