mlsanityData to 14 Oct 2026

MolEmb: Multimodal Large Language Models Can Be Strong Molecular Embedding Models

arXiv 2608.23646 ↗First posted 24 Aug 2026cs.AI cs.LGcited by 3

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Molecular embedding models can serve as foundational infrastructure for computational chemistry and drug discovery, where reusable vector representations support property prediction, virtual screening, and retrieval. Most molecular encoders are specialist models built around a single molecular view, producing unconditional vectors with no language interface for varying the representation. We ask whether multimodal large language models (MLLMs), which natively process images, text, and symbolic inputs, can instead serve as general molecular embedding models that produce embeddings conditioned on both a molecular profile and a natural-language semantic context. We introduce MolEmb, a lightweight framework that adapts MLLMs by aligning molecular profiles with textual descriptions in a shared embedding space using a bidirectional contrastive objective. The resulting embedding model is competitive on molecular property prediction and supports cross-modal molecule--text retrieval in the same space. We further introduce MolCAR, a diagnostic benchmark for context-aware retrieval, and find that context-aware molecular embedding is primarily a data property of the supervision. These results suggest that MLLMs are not merely chemistry assistants or generators, but a viable and extensible route to general molecular embedding models.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 53 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

40 of 53 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025RxnBench: A Multimodal Benchmark for Evaluating Large Language Models on Chemical Reaction Understanding from Scientific Literature29 Dec
  2. 2025ChemMLLM: Chemical Multimodal Large Language Model22 May
  3. 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Area14 Aug

Other references · 37

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  6. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  7. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  8. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  9. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  10. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
  11. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  12. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
25 more
  1. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
  2. 2021Graph Contrastive Learning Automatedcited by 287
  3. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  4. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
  5. 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Taskscited by 228
  6. 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
  7. 2022Translation between Molecules and Natural Languagecited by 177
  8. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
  9. 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 131
  10. 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 127
  11. 2025Gemini Embedding: Generalizable Embeddings from Geminicited by 94
  12. 2025jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrievalcited by 76
  13. 2026DeepSeek-OCR 2: Visual Causal Flowcited by 74
  14. 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
  15. 2022Spectral Augmentation for Self-Supervised Learning on Graphscited by 39
  16. 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
  17. 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoningcited by 33
  18. 2024MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehensioncited by 22
  19. 2025Benchmarking Retrieval-Augmented Generation for Chemistrycited by 20
  20. 2024A quantitative analysis of knowledge-learning preferences in large language models in molecular sciencecited by 18
  21. 2025MolTextNet: A Two-Million Molecule-Text Dataset for Multimodal Molecular Learningcited by 8
  22. 2025KnowMol: Advancing Molecular Large Language Models with Multi-Level Chemical Knowledgecited by 7
  23. 2025The Underappreciated Power of Vision Models for Graph Structural Understandingcited by 5
  24. 2025Neural Graduated Assignment for Maximum Common Edge Subgraphscited by 3
  25. 2026LLM2Vec-Gen: Generative Embeddings from Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MolE-RAG: Molecular Structure-Enhanced Retrieval-Augmented Generation for Chemistry
  2. 2026Rethinking Molecular Text Representations for LLMs: An Empirical Study
  3. 2025M2LLM: Multi-view Molecular Representation Learning with Large Language Models
  4. 2026DeepMoLM: Leveraging Visual and Geometric Structural Information for Molecule-Text Modeling
  5. 2025Omni-Mol: Multitask Molecular Model for Any-to-any Modalities
  6. 2025MolVision: Molecular Property Prediction with Vision Language Models
  7. 2026Bolek: A Multimodal Language Model for Molecular Reasoning
  8. 2023GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text