mlsanityData to 14 Oct 2026

MolTextNet: A Two-Million Molecule-Text Dataset for Multimodal Molecular Learning

arXiv 2506.00009 ↗First posted 15 May 2025q-bio.BM cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Small molecules are essential to drug discovery, and graph-language models hold promise for learning molecular properties and functions from text. However, existing molecule-text datasets are limited in scale and informativeness, restricting the training of generalizable multimodal models. We present MolTextNet, a dataset of 2.5 million high-quality molecule-text pairs designed to overcome these limitations. To construct it, we propose a synthetic text generation pipeline that integrates structural features, computed properties, bioactivity data, and synthetic complexity. Using GPT-4o-mini, we create structured descriptions for 2.5 million molecules from ChEMBL35, with text over 10 times longer than prior datasets. MolTextNet supports diverse downstream tasks, including property prediction and structure retrieval. Pretraining CLIP-style models with Graph Neural Networks and ModernBERT on MolTextNet yields improved performance, highlighting its potential for advancing foundational multimodal modeling in molecular science. Our dataset is available at https://huggingface.co/datasets/liuganghuggingface/moltextnet.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 15 May 2025.

Builds on

17 of 31 references.

References · 17

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2018How Powerful are Graph Neural Networks?cited by 4,393
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  6. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  7. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  8. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  9. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
  10. 2022Translation between Molecules and Natural Languagecited by 177
  11. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
  12. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 133
5 more
  1. 2024Graph Diffusion Transformers for Multi-Conditional Molecular Generationcited by 45
  2. 2024Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic Planningcited by 29
  3. 2023Data-Centric Learning from Unlabeled Graphs with Diffusion Modelcited by 19
  4. 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
  5. 2024Learning Molecular Representation in a Cellcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.