mlsanityData to 7 Oct 2026

MolCAP: Molecular Chemical reActivity pretraining and prompted-finetuning enhanced molecular representation learning

arXiv 2306.09187 ↗First posted 13 Jun 2023q-bio.BM cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Molecular representation learning (MRL) is a fundamental task for drug discovery. However, previous deep-learning (DL) methods focus excessively on learning robust inner-molecular representations by mask-dominated pretraining framework, neglecting abundant chemical reactivity molecular relationships that have been demonstrated as the determining factor for various molecular property prediction tasks. Here, we present MolCAP to promote MRL, a graph pretraining Transformer based on chemical reactivity (IMR) knowledge with prompted finetuning. Results show that MolCAP outperforms comparative methods based on traditional molecular pretraining framework, in 13 publicly available molecular datasets across a diversity of biomedical tasks. Prompted by MolCAP, even basic graph neural networks are capable of achieving surprising performance that outperforms previous models, indicating the promising prospect of applying reactivity information for MRL. In addition, manual designed molecular templets are potential to uncover the dataset bias. All in all, we expect our MolCAP to gain more chemical meaningful insights for the entire process of drug discovery.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 34 references that are in the map. First posted on arXiv 13 Jun 2023.

Builds on

12 of 34 references.

References · 12

  1. 2017Graph Attention Networkscited by 8,854
  2. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  3. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
  4. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  5. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 246
  6. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  7. 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
  8. 2018N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Moleculescited by 93
  9. 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
  10. 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
  11. 2022Multi-task Joint Strategies of Self-supervised Representation Learning on Biomedical Networks for Drug Discoverycited by 13
  12. 2022Can NLI Provide Proper Indirect Supervision for Low-resource Biomedical Relation Extraction?cited by 13

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 0; 2025: 1.

2 papers.