mlsanityData to 7 Oct 2026

Pre-Training on Large-Scale Generated Docking Conformations with HelixDock to Unlock the Potential of Protein-ligand Structure Prediction Models

arXiv 2310.13913 ↗First posted 21 Oct 2023cs.LG cs.CE q-bio.BMcited by 5

Not on the map. Why?

Abstract (arXiv)

Protein-ligand structure prediction is an essential task in drug discovery, predicting the binding interactions between small molecules (ligands) and target proteins (receptors). Recent advances have incorporated deep learning techniques to improve the accuracy of protein-ligand structure prediction. Nevertheless, the experimental validation of docking conformations remains costly, it raises concerns regarding the generalizability of these deep learning-based methods due to the limited training data. In this work, we show that by pre-training on a large-scale docking conformation generated by traditional physics-based docking tools and then fine-tuning with a limited set of experimentally validated receptor-ligand complexes, we can obtain a protein-ligand structure prediction model with outstanding performance. Specifically, this process involved the generation of 100 million docking conformations for protein-ligand pairings, an endeavor consuming roughly 1 million CPU core days. The proposed model, HelixDock, aims to acquire the physical knowledge encapsulated by the physics-based docking tools during the pre-training phase. HelixDock has been rigorously benchmarked against both physics-based and deep learning-based baselines, demonstrating its exceptional precision and robust transferability in predicting binding confirmation. In addition, our investigation reveals the scaling laws governing pre-trained protein-ligand structure prediction models, indicating a consistent enhancement in performance with increases in model parameters and the volume of pre-training data. Moreover, we applied HelixDock to several drug discovery-related tasks to validate its practical utility. HelixDock demonstrates outstanding capabilities on both cross-docking and structure-based virtual screening benchmarks.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 85 references that are in the map. First posted on arXiv 21 Oct 2023.

Builds on

24 of 85 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Scaling Laws for Neural Language Modelscited by 6,411
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  5. 2021Scaling Vision Transformerscited by 993
  6. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  7. 2021E(n) Equivariant Graph Neural Networkscited by 951
  8. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  9. 2017Deep Learning Scaling is Predictable, Empiricallycited by 556
  10. 2018Rethinking ImageNet Pre-trainingcited by 376
  11. 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 307
  12. 2019Evaluating Protein Transfer Learning with TAPEcited by 229
12 more
  1. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  2. 2022EquiBind: Geometric Deep Learning for Drug Binding Structure Predictioncited by 143
  3. 2022Revisiting Neural Scaling Laws in Language and Visioncited by 129
  4. 2021Scaling Laws for Neural Machine Translationcited by 110
  5. 2021GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Predictioncited by 61
  6. 2017Development and evaluation of a deep learning model for protein-ligand binding affinity predictioncited by 50
  7. 2020Improved Protein-ligand Binding Affinity Prediction with Structure-Based Deep Fusion Inferencecited by 35
  8. 2022Structure-aware Protein Self-supervised Learningcited by 33
  9. 2022HelixFold-Single: MSA-free Protein Structure Prediction by Using Protein Language Model as an Alternativecited by 15
  10. 2021LiteGEM: Lite Geometry Enhanced Molecular Representation Learning for Quantum Property Predictioncited by 6
  11. 2021APObind: A Dataset of Ligand Unbound Protein Conformations for Machine Learning Applications in De Novo Drug Designcited by 3
  12. 2022HelixADMET: a robust and endpoint extensible ADMET system incorporating self-supervised knowledge transfercited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 1.

5 papers.