mlsanityData to 7 Oct 2026

Advancing Drug Discovery with Enhanced Chemical Understanding via Asymmetric Contrastive Multimodal Learning

arXiv 2311.06456 ↗First posted 11 Nov 2023cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

The versatility of multimodal deep learning holds tremendous promise for advancing scientific research and practical applications. As this field continues to evolve, the collective power of cross-modal analysis promises to drive transformative innovations, opening new frontiers in chemical understanding and drug discovery. Hence, we introduce Asymmetric Contrastive Multimodal Learning (ACML), a specifically designed approach to enhance molecular understanding and accelerate advancements in drug discovery. ACML harnesses the power of effective asymmetric contrastive learning to seamlessly transfer information from various chemical modalities to molecular graph representations. By combining pre-trained chemical unimodal encoders and a shallow-designed graph encoder with 5 layers, ACML facilitates the assimilation of coordinated chemical semantics from different modalities, leading to comprehensive representation learning with efficient training. We demonstrate the effectiveness of this framework through large-scale cross-modality retrieval and isomer discrimination tasks. Additionally, ACML enhances interpretability by revealing chemical semantics in graph presentations and bolsters the expressive power of graph neural networks, as evidenced by improved performance in molecular property prediction tasks from MoleculeNet and Therapeutics Data Commons (TDC). Ultimately, ACML exemplifies its potential to revolutionize molecular representational learning, offering deeper insights into the chemical semantics of diverse modalities and paving the way for groundbreaking advancements in chemical research and drug discovery.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 87 references that are in the map. First posted on arXiv 11 Nov 2023.

Builds on

35 of 87 references.

References · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2017Graph Attention Networkscited by 8,854
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  8. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  9. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  10. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  11. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  12. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
23 more
  1. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  2. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
  3. 2019VideoBERT: A Joint Model for Video and Language Representation Learningcited by 702
  4. 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
  5. 2015Recent Advances in Convolutional Neural Networkscited by 360
  6. 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
  7. 2015Order Matters: Sequence to sequence for setscited by 236
  8. 2020Audio-Visual Instance Discrimination with Cross-Modal Agreementcited by 192
  9. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  10. 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
  11. 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
  12. 2018Towards Sparse Hierarchical Graph Classifierscited by 100
  13. 2021SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanismcited by 75
  14. 2020Subgraph Neural Networkscited by 73
  15. 2021CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representationscited by 72
  16. 2023Self-Supervised Multimodal Learning: A Surveycited by 58
  17. 2022Multimodal learning with graphscited by 54
  18. 2022Graph-based Molecular Representation Learningcited by 51
  19. 2022Graph Neural Networks with Adaptive Readoutscited by 29
  20. 2017HoME: a Household Multimodal Environmentcited by 20
  21. 2021Learning Attributed Graph Representations with Communicative Message Passing Transformercited by 20
  22. 2022Motif-based Graph Representation Learning with Application to Chemical Moleculescited by 9
  23. 2020Predicting Chemical Properties using Self-Attention Multi-task Learning based on SMILES Representationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 3.

5 papers.