mlsanityData to 7 Oct 2026

MolFusion: Multimodal Fusion Learning for Molecular Representations via Multi-granularity Views

arXiv 2406.18020 ↗First posted 26 Jun 2024cs.LG cs.AI physics.chem-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial Intelligence predicts drug properties by encoding drug molecules, aiding in the rapid screening of candidates. Different molecular representations, such as SMILES and molecule graphs, contain complementary information for molecular encoding. Thus exploiting complementary information from different molecular representations is one of the research priorities in molecular encoding. Most existing methods for combining molecular multi-modalities only use molecular-level information, making it hard to encode intra-molecular alignment information between different modalities. To address this issue, we propose a multi-granularity fusion method that is MolFusion. The proposed MolFusion consists of two key components: (1) MolSim, a molecular-level encoding component that achieves molecular-level alignment between different molecular representations. and (2) AtomAlign, an atomic-level encoding component that achieves atomic-level alignment between different molecular representations. Experimental results show that MolFusion effectively utilizes complementary multimodal information, leading to significant improvements in performance across various classification and regression tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 46 references that are in the map. First posted on arXiv 26 Jun 2024.

Builds on

20 of 46 references.

References · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  3. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  4. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  5. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  6. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  7. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  8. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  9. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  10. 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
  11. 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
  12. 2021CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIPcited by 88
8 more
  1. 2021ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learningcited by 72
  2. 2021MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graphcited by 65
  3. 2021Molecular Contrastive Learning with Chemical Element Knowledge Graphcited by 50
  4. 2017Deep Learning for Computational Chemistrycited by 38
  5. 2022A Systematic Survey of Chemical Pre-trained Modelscited by 34
  6. 2021Dual-view Molecule Pre-trainingcited by 27
  7. 2023Language models in molecular discoverycited by 6
  8. 2020BERT Learns (and Teaches) Chemistrycited by 3

Built on by

Not cited yet.