Advancing Drug Discovery with Enhanced Chemical Understanding via Asymmetric Contrastive Multimodal Learning
Not on the map. Why?
Abstract (arXiv)
The versatility of multimodal deep learning holds tremendous promise for advancing scientific research and practical applications. As this field continues to evolve, the collective power of cross-modal analysis promises to drive transformative innovations, opening new frontiers in chemical understanding and drug discovery. Hence, we introduce Asymmetric Contrastive Multimodal Learning (ACML), a specifically designed approach to enhance molecular understanding and accelerate advancements in drug discovery. ACML harnesses the power of effective asymmetric contrastive learning to seamlessly transfer information from various chemical modalities to molecular graph representations. By combining pre-trained chemical unimodal encoders and a shallow-designed graph encoder with 5 layers, ACML facilitates the assimilation of coordinated chemical semantics from different modalities, leading to comprehensive representation learning with efficient training. We demonstrate the effectiveness of this framework through large-scale cross-modality retrieval and isomer discrimination tasks. Additionally, ACML enhances interpretability by revealing chemical semantics in graph presentations and bolsters the expressive power of graph neural networks, as evidenced by improved performance in molecular property prediction tasks from MoleculeNet and Therapeutics Data Commons (TDC). Ultimately, ACML exemplifies its potential to revolutionize molecular representational learning, offering deeper insights into the chemical semantics of diverse modalities and paving the way for groundbreaking advancements in chemical research and drug discovery.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 87 references that are in the map. First posted on arXiv 11 Nov 2023.
Builds on
35 of 87 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Graph Attention Networkscited by 8,854
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
23 more
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2019VideoBERT: A Joint Model for Video and Language Representation Learningcited by 702
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
- 2015Recent Advances in Convolutional Neural Networkscited by 360
- 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
- 2015Order Matters: Sequence to sequence for setscited by 236
- 2020Audio-Visual Instance Discrimination with Cross-Modal Agreementcited by 192
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
- 2018Towards Sparse Hierarchical Graph Classifierscited by 100
- 2021SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanismcited by 75
- 2020Subgraph Neural Networkscited by 73
- 2021CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representationscited by 72
- 2023Self-Supervised Multimodal Learning: A Surveycited by 58
- 2022Multimodal learning with graphscited by 54
- 2022Graph-based Molecular Representation Learningcited by 51
- 2022Graph Neural Networks with Adaptive Readoutscited by 29
- 2017HoME: a Household Multimodal Environmentcited by 20
- 2021Learning Attributed Graph Representations with Communicative Message Passing Transformercited by 20
- 2022Motif-based Graph Representation Learning with Application to Chemical Moleculescited by 9
- 2020Predicting Chemical Properties using Self-Attention Multi-task Learning based on SMILES Representationcited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 3.
5 papers.
- 2024Graph Multi-Similarity Learning for Molecular Property Predictioncited by 1
- 2026Advancing Ligand-based Virtual Screening and Molecular Generation with Pretrained Molecular Embedding Distancecited by 1
- 2025Thin Bridges for Drug Text Alignment: Lightweight Contrastive Learning for Target Specific Drug Retrievalcited by 0
- 2026SpecX: A Large-Scale Benchmark for Multi-Modal Spectroscopy and Cross-Paradigm Evaluationcited by 0
- 2026ChemHyperMag: Physics-informed magnetic hypergraph learning improves molecular ADMET predictioncited by 0
- 2026ChemHyperMag: Physics-informed magnetic hypergraph learning improves molecular ADMET prediction19 Jul 2026
- 2026SpecX: A Large-Scale Benchmark for Multi-Modal Spectroscopy and Cross-Paradigm Evaluation11 May 2026
- 2026Advancing Ligand-based Virtual Screening and Molecular Generation with Pretrained Molecular Embedding Distance27 Apr 2026
- 2025Thin Bridges for Drug Text Alignment: Lightweight Contrastive Learning for Target Specific Drug Retrieval30 Sep 2025
- 2024Graph Multi-Similarity Learning for Molecular Property Prediction31 Jan 2024