mlsanityData to 7 Oct 2026

MaskMol: Knowledge-guided Molecular Image Pre-Training Framework for Activity Cliffs

arXiv 2409.12926 ↗First posted 2 Sep 2024cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Activity cliffs, which refer to pairs of molecules that are structurally similar but show significant differences in their potency, can lead to model representation collapse and make the model challenging to distinguish them. Our research indicates that as molecular similarity increases, graph-based methods struggle to capture these nuances, whereas image-based approaches effectively retain the distinctions. Thus, we developed MaskMol, a knowledge-guided molecular image self-supervised learning framework. MaskMol accurately learns the representation of molecular images by considering multiple levels of molecular knowledge, such as atoms, bonds, and substructures. By utilizing pixel masking tasks, MaskMol extracts fine-grained information from molecular images, overcoming the limitations of existing deep learning models in identifying subtle structural changes. Experimental results demonstrate MaskMol's high accuracy and transferability in activity cliff estimation and compound potency prediction across 20 different macromolecular targets, outperforming 25 state-of-the-art deep learning and machine learning approaches. Visualization analyses reveal MaskMol's high biological interpretability in identifying activity cliff-relevant molecular substructures. Notably, through MaskMol, we identified candidate EP4 inhibitors that could be used to treat tumors. This study not only raises awareness about activity cliffs but also introduces a novel method for molecular image representation learning and virtual screening, advancing drug discovery and providing new insights into structure-activity relationships (SAR).

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 99 references that are in the map. First posted on arXiv 2 Sep 2024.

Builds on

29 of 99 references.

References · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  7. 2017Graph Attention Networkscited by 8,854
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  9. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  10. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  11. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
  12. 2020Graph Contrastive Learning with Augmentationscited by 1,203
17 more
  1. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  2. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  3. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  4. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
  5. 2020Parameterized Explainer for Graph Neural Networkcited by 423
  6. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  7. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  8. 2020Hierarchical Generation of Molecular Graphs using Structural Motifscited by 204
  9. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  10. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  11. 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
  12. 2022One Transformer Can Understand Both 2D & 3D Molecular Datacited by 77
  13. 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
  14. 2021Multilingual Molecular Representation Learning via Contrastive Pre-trainingcited by 12
  15. 2023Exploring QSAR Models for Activity-Cliff Predictioncited by 9
  16. 2023Instructor-inspired Machine Learning for Robust Molecular Property Predictioncited by 8
  17. 2023Why Deep Models Often cannot Beat Non-deep Counterparts on Molecular Property Prediction?cited by 3

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.