Knowledge-aware Contrastive Molecular Graph Learning
Not on the map. Why?
Abstract (arXiv)
Leveraging domain knowledge including fingerprints and functional groups in molecular representation learning is crucial for chemical property prediction and drug discovery. When modeling the relation between graph structure and molecular properties implicitly, existing works can hardly capture structural or property changes and complex structure, with much smaller atom vocabulary and highly frequent atoms. In this paper, we propose the Contrastive Knowledge-aware GNN (CKGNN) for self-supervised molecular representation learning to fuse domain knowledge into molecular graph representation. We explicitly encode domain knowledge via knowledge-aware molecular encoder under the contrastive learning framework, ensuring that the generated molecular embeddings equipped with chemical domain knowledge to distinguish molecules with similar chemical formula but dissimilar functions. Extensive experiments on 8 public datasets demonstrate the effectiveness of our model with a 6% absolute improvement on average against strong competitors. Ablation study and further investigation also verify the best of both worlds: incorporation of chemical domain knowledge into self-supervised learning.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 24 Mar 2021.
Builds on
18 of 29 references.
References · 18
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2018Deep Graph Infomaxcited by 1,101
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
6 more
- 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
- 2020Graph Random Neural Network for Semi-Supervised Learning on Graphscited by 213
- 2019Graph Matching Networks for Learning the Similarity of Graph Structured Objectscited by 202
- 2020Exploiting Neuron and Synapse Filter Dynamics in Spatial Temporal Learning of Deep Spiking Neural Networkcited by 36
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 2.
8 papers.
- 2021Molecular Contrastive Learning with Chemical Element Knowledge Graphcited by 50
- 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44
- 2021Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practicescited by 24
- 2022Graph Neural Networks for Moleculescited by 21
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Surveycited by 21
- 2022CoSP: Co-supervised pretraining of pocket and ligandcited by 12
- 2023Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Hierarchical Structurescited by 4
- 2022Knowledge-informed Molecular Learning: A Survey on Paradigm Transfercited by 3
- 2023Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Hierarchical Structures17 Feb 2023
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Survey14 Feb 2023
- 2022Graph Neural Networks for Molecules12 Sep 2022
- 2022CoSP: Co-supervised pretraining of pocket and ligand23 Jun 2022
- 2022Knowledge-informed Molecular Learning: A Survey on Paradigm Transfer17 Feb 2022
- 2021Molecular Contrastive Learning with Chemical Element Knowledge Graph1 Dec 2021
- 2021Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices5 Nov 2021
- 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphs4 Oct 2021