mlsanityData to 7 Oct 2026

Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey

arXiv 2402.07249 ↗First posted 11 Feb 2024cs.LG cs.CE q-bio.BMcited by 6

Not on the map. Why?

Abstract (arXiv)

The precise prediction of molecular properties is essential for advancements in drug development, particularly in virtual screening and compound optimization. The recent introduction of numerous deep learning-based methods has shown remarkable potential in enhancing molecular property prediction (MPP), especially improving accuracy and insights into molecular structures. Yet, two critical questions arise: does the integration of domain knowledge augment the accuracy of molecular property prediction and does employing multi-modal data fusion yield more precise results than unique data source methods? To explore these matters, we comprehensively review and quantitatively analyze recent deep learning methods based on various benchmarks. We discover that integrating molecular information significantly improves molecular property prediction (MPP) for both regression and classification tasks. Specifically, regression improvements, measured by reductions in root mean square error (RMSE), are up to 4.0%, while classification enhancements, measured by the area under the receiver operating characteristic curve (ROC-AUC), are up to 1.7%. We also discover that enriching 2D graphs with 1D SMILES boosts multi-modal learning performance for regression tasks by up to 9.1%, and augmenting 2D graphs with 3D information increases performance for classification tasks by up to 13.2%, with both enhancements measured using ROC-AUC. The two consolidated insights offer crucial guidance for future advancements in drug discovery.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 78 of its 197 references that are in the map. First posted on arXiv 11 Feb 2024.

Builds on

78 of 197 references.

References · 78

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  6. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  7. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  8. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  9. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
  10. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  11. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  12. 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
38 more
  1. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  2. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  3. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 438
  4. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
  5. 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
  6. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  7. 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 312
  8. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
  9. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  10. 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
  11. 2021ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Predictioncited by 204
  12. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
  13. 2021Spherical Message Passing for 3D Graph Networkscited by 166
  14. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
  15. 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
  16. 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
  17. 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
  18. 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
  19. 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 113
  20. 2020Molecule Attention Transformercited by 92
  21. 2023GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Textcited by 82
  22. 2021Few-Shot Graph Learning for Molecular Property Predictioncited by 81
  23. 2022One Transformer Can Understand Both 2D & 3D Molecular Datacited by 77
  24. 2019Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspectivecited by 73
  25. 2022GRPE: Relative Positional Encoding for Graph Transformercited by 67
  26. 2022Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matchingcited by 67
  27. 2021MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graphcited by 65
  28. 2021GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Predictioncited by 61
  29. 2020Hierarchical Inter-Message Passing for Learning on Molecular Graphscited by 59
  30. 2020ASGN: An Active Semi-supervised Graph Neural Network for Molecular Property Predictioncited by 58
  31. 2015Gated Feedback Recurrent Neural Networkscited by 54
  32. 2021Rotation Invariant Graph Neural Networks using Spin Convolutionscited by 52
  33. 2021Molecular Contrastive Learning with Chemical Element Knowledge Graphcited by 50
  34. 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
  35. 2020Advanced Graph and Sequence Neural Networks for Molecular Property Prediction and Drug Discoverycited by 46
  36. 2022Unified 2D and 3D Pre-Training of Molecular Representationscited by 45
  37. 2021Simple GNN Regularisation for 3D Molecular Property Prediction & Beyondcited by 44
  38. 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44

50 most cited of 78 All 78 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 2.

6 papers.