M3-20M: A Large-Scale Multi-Modal Molecule Dataset for AI-driven Drug Design and Discovery
Not on the map. Why?
Abstract (arXiv)
This paper introduces M3-20M, a large-scale Multi-Modal Molecule dataset that contains over 20 million molecules, with the data mainly being integrated from existing databases and partially generated by large language models. Designed to support AI-driven drug design and discovery, M3-20M is 71 times more in the number of molecules than the largest existing dataset, providing an unprecedented scale that can highly benefit the training or fine-tuning of models, including large language models for drug design and discovery tasks. This dataset integrates one-dimensional SMILES, two-dimensional molecular graphs, three-dimensional molecular structures, physicochemical properties, and textual descriptions collected through web crawling and generated using GPT-3.5, offering a comprehensive view of each molecule. To demonstrate the power of M3-20M in drug design and discovery, we conduct extensive experiments on two key tasks: molecule generation and molecular property prediction, using large language models including GLM4, GPT-3.5, GPT-4, and Llama3-8b. Our experimental results show that M3-20M can significantly boost model performance in both tasks. Specifically, it enables the models to generate more diverse and valid molecular structures and achieve higher property prediction accuracy than existing single-modal datasets, which validates the value and potential of M3-20M in supporting AI-driven drug design and discovery. The dataset is available at https://github.com/bz99bz/M-3.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 63 references that are in the map. First posted on arXiv 8 Dec 2024.
Builds on
33 of 63 references.
References · 33
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 275
- 2020GEOM: Energy-annotated molecular conformations for property prediction and molecular generationcited by 243
21 more
- 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 236
- 2020MoFlow: An Invertible Flow Model for Generating Molecular Graphscited by 185
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
- 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 155
- 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 94
- 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 90
- 2023GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Textcited by 82
- 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
- 2023Equivariant Flow Matching with Hybrid Probability Transportcited by 60
- 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 59
- 2021Molecule Generation by Principal Subgraph Mining and Assemblingcited by 54
- 2023Towards Foundational Models for Molecular Learning on Large-Scale Multi-Task Datasetscited by 39
- 2023A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretrainingcited by 32
- 2022GPS++: An Optimised Hybrid MPNN/Transformer for Molecular Property Predictioncited by 28
- 2023Multimodal Molecular Pretraining via Modality Blendingcited by 21
- 2024A quantitative analysis of knowledge-learning preferences in large language models in molecular sciencecited by 18
- 2023Prefix-Tree Decoding for Predicting Mass Spectra from Moleculescited by 16
- 2022Multi-task Joint Strategies of Self-supervised Representation Learning on Biomedical Networks for Drug Discoverycited by 13
- 2022Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Designcited by 7
- 2023Diffusing on Two Levels and Optimizing for Multiple Properties: A Novel Approach to Generating Molecules with Desirable Propertiescited by 5
- 2023MultiModal-Learning for Predicting Molecular Properties: A Framework Based on Image and Graph Structurescited by 1
Built on by
Not cited yet.