MolBind: Multimodal Alignment of Language, Molecules, and Proteins
Not on the map. Why?
Abstract (arXiv)
Recent advancements in biology and chemistry have leveraged multi-modal learning, integrating molecules and their natural language descriptions to enhance drug discovery. However, current pre-training frameworks are limited to two modalities, and designing a unified network to process different modalities (e.g., natural language, 2D molecular graphs, 3D molecular conformations, and 3D proteins) remains challenging due to inherent gaps among them. In this work, we propose MolBind, a framework that trains encoders for multiple modalities through contrastive learning, mapping all modalities to a shared feature space for multi-modal semantic alignment. To facilitate effective pre-training of MolBind on multiple modalities, we also build and collect a high-quality dataset with four modalities, MolBind-M4, including graph-language, conformation-language, graph-conformation, and conformation-protein paired data. MolBind shows superior zero-shot learning performance across a wide range of tasks, demonstrating its strong capability of capturing the underlying semantics of multiple modalities.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 22 of its 43 references that are in the map. First posted on arXiv 13 Mar 2024.
Builds on
22 of 43 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 461
- 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 366
- 2021AudioCLIP: Extending CLIP to Image, Text and Audiocited by 335
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 238
- 2022Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pocketscited by 182
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
- 2022A 3D Generative Model for Structure-Based Drug Designcited by 148
10 more
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
- 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
- 2023Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Datacited by 68
- 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 65
- 2021Rotation Invariant Graph Neural Networks using Spin Convolutionscited by 52
- 2021Molecule3D: A Benchmark for Predicting 3D Geometries from Molecular Graphscited by 31
- 2023DrugCLIP: Contrastive Protein-Molecule Representation Learning for Virtual Screeningcited by 28
- 2023Learning How to Propagate Messages in Graph Neural Networkscited by 23
- 2023Towards equilibrium molecular conformation generation with GFlowNetscited by 14
- 20233D Molecular Geometry Analysis with 2D Graphscited by 1
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 3.
7 papers.
- 2025Protein Large Language Models: A Comprehensive Surveycited by 18
- 20243D-MolT5: Leveraging Discrete Structural Information for Molecule-Text Modelingcited by 9
- 2024OneProt: Towards Multi-Modal Protein Foundation Modelscited by 2
- 2024GeomCLIP: Contrastive Geometry-Text Pre-training for Moleculescited by 2
- 2026TextME: Bridging Unseen Modalities Through Text Descriptionscited by 2
- 2026Unifying Heterogeneous Multi-Modal Remote Sensing Detection Via Language-Pivoted Pretrainingcited by 0
- 2026Reading the Cell, Designing the Cure: Perturbation-Conditioned Molecular Diffusion for Function-Oriented Drug Designcited by 0
- 2026Reading the Cell, Designing the Cure: Perturbation-Conditioned Molecular Diffusion for Function-Oriented Drug Design14 May 2026
- 2026Unifying Heterogeneous Multi-Modal Remote Sensing Detection Via Language-Pivoted Pretraining2 Mar 2026
- 2026TextME: Bridging Unseen Modalities Through Text Descriptions3 Feb 2026
- 2025Protein Large Language Models: A Comprehensive Survey21 Feb 2025
- 2024GeomCLIP: Contrastive Geometry-Text Pre-training for Molecules16 Nov 2024
- 2024OneProt: Towards Multi-Modal Protein Foundation Models7 Nov 2024
- 20243D-MolT5: Leveraging Discrete Structural Information for Molecule-Text Modeling9 Jun 2024