ProFSA: Self-supervised Pocket Pretraining via Protein Fragment-Surroundings Alignment
Not on the map. Why?
Abstract (arXiv)
Pocket representations play a vital role in various biomedical applications, such as druggability estimation, ligand affinity prediction, and de novo drug design. While existing geometric features and pretrained representations have demonstrated promising results, they usually treat pockets independent of ligands, neglecting the fundamental interactions between them. However, the limited pocket-ligand complex structures available in the PDB database (less than 100 thousand non-redundant pairs) hampers large-scale pretraining endeavors for interaction modeling. To address this constraint, we propose a novel pocket pretraining approach that leverages knowledge from high-resolution atomic protein structures, assisted by highly effective pretrained small molecule representations. By segmenting protein structures into drug-like fragments and their corresponding pockets, we obtain a reasonable simulation of ligand-receptor interactions, resulting in the generation of over 5 million complexes. Subsequently, the pocket encoder is trained in a contrastive manner to align with the representation of pseudo-ligand furnished by some pretrained small molecule encoders. Our method, named ProFSA, achieves state-of-the-art performance across various tasks, including pocket druggability prediction, pocket matching, and ligand binding affinity prediction. Notably, ProFSA surpasses other pretraining methods by a substantial margin. Moreover, our work opens up a new avenue for mitigating the scarcity of protein-ligand complex data through the utilization of high-quality and diverse protein structure databases.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 19 of its 51 references that are in the map. First posted on arXiv 11 Oct 2023.
Builds on
19 of 51 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2019Evaluating Protein Transfer Learning with TAPEcited by 229
- 2018DeepDTA: Deep Drug-Target Binding Affinity Predictioncited by 171
- 2020ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 162
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2020ATOM3D: Tasks On Molecules in Three Dimensionscited by 73
- 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
7 more
- 2022Learning Hierarchical Protein Representations via Complete 3D Graph Networkscited by 54
- 2018DeepAffinity: Interpretable Deep Learning of Compound-Protein Affinity through Unified Recurrent and Convolutional Neural Networkscited by 52
- 2022Multi-Scale Representation Learning on Proteinscited by 52
- 2019Learning protein sequence embeddings using information from structurecited by 50
- 2023Fractional Denoising for 3D Molecular Pre-trainingcited by 33
- 2023Generalist Equivariant Transformer Towards 3D Molecular Interaction Learningcited by 18
- 2022CoSP: Co-supervised pretraining of pocket and ligandcited by 12
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 2; 2026: 5.
12 papers.
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applicationscited by 28
- 2023Protein-ligand binding representation learning from fine-grained interactionscited by 12
- 2024An Equivariant Pretrained Transformer for Unified 3D Molecular Representation Learningcited by 5
- 2024Multi-level Interaction Modeling for Protein Mutational Effect Predictioncited by 5
- 2026Self-Conditioned Denoising for Atomistic Representation Learningcited by 3
- 2024SIU: A Million-Scale Structural Small Molecule-Protein Interaction Dataset for Unbiased Bioactivity Predictioncited by 2
- 2025Integrating Protein Dynamics into Structure-Based Drug Design via Full-Atom Stochastic Flowscited by 2
- 2025MolChord: Structure-Sequence Alignment for Protein-Guided Drug Designcited by 2
- 2026Structure-guided molecular design with contrastive 3D protein-ligand learningcited by 0
- 2026h-MINT: Modeling Pocket-Ligand Binding with Hierarchical Molecular Interaction Networkcited by 0
- 2026CARD: Coarse-to-fine Autoregressive Modeling with Radix-based Decomposition for Transferable Free Energy Estimationcited by 0
- 2026Curvature-Informed Potential Energy Surface for Protein-Ligand Binding Affinity Predictioncited by 0
- 2026Curvature-Informed Potential Energy Surface for Protein-Ligand Binding Affinity Prediction12 Jun 2026
- 2026CARD: Coarse-to-fine Autoregressive Modeling with Radix-based Decomposition for Transferable Free Energy Estimation4 May 2026
- 2026h-MINT: Modeling Pocket-Ligand Binding with Hierarchical Molecular Interaction Network25 Apr 2026
- 2026Structure-guided molecular design with contrastive 3D protein-ligand learning21 Apr 2026
- 2026Self-Conditioned Denoising for Atomistic Representation Learning17 Mar 2026
- 2025MolChord: Structure-Sequence Alignment for Protein-Guided Drug Design31 Oct 2025
- 2025Integrating Protein Dynamics into Structure-Based Drug Design via Full-Atom Stochastic Flows6 Mar 2025
- 2024SIU: A Million-Scale Structural Small Molecule-Protein Interaction Dataset for Unbiased Bioactivity Prediction13 Jun 2024
- 2024Multi-level Interaction Modeling for Protein Mutational Effect Prediction28 May 2024
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applications1 Mar 2024
- 2024An Equivariant Pretrained Transformer for Unified 3D Molecular Representation Learning20 Feb 2024
- 2023Protein-ligand binding representation learning from fine-grained interactions9 Nov 2023