mlsanityData to 7 Oct 2026

Mol-LLaMA: Towards General Understanding of Molecules in Large Molecular Language Model

arXiv 2502.13449 ↗First posted 19 Feb 2025cs.LG physics.chem-phcited by 16

Not on the map. Why?

Abstract (arXiv)

Understanding molecules is key to understanding organisms and driving advances in drug discovery, requiring interdisciplinary knowledge across chemistry and biology. Although large molecular language models have achieved notable success in task transfer, they often struggle to accurately analyze molecular features due to limited knowledge and reasoning capabilities. To address this issue, we present Mol-LLaMA, a large molecular language model that grasps the general knowledge centered on molecules and exhibits explainability and reasoning ability. To this end, we design key data types that encompass the fundamental molecular features, taking into account the essential abilities for molecular reasoning. Further, to improve molecular understanding, we propose a module that integrates complementary information from different molecular encoders, leveraging the distinct advantages of molecular representations. Our experimental results demonstrate that Mol-LLaMA is capable of comprehending the general features of molecules and providing informative responses, implying its potential as a general-purpose assistant for molecular analysis. Our project page is at https://mol-llama.github.io/.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 40 of its 72 references that are in the map. First posted on arXiv 19 Feb 2025.

Builds on

40 of 72 references.

References · 40

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  9. 2024GPT-4o System Cardcited by 4,467
  10. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  11. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  12. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
28 more
  1. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  2. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  3. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  4. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  5. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
  6. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  7. 2022Translation between Molecules and Natural Languagecited by 173
  8. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
  9. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
  10. 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
  11. 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
  12. 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 124
  13. 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
  14. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  15. 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
  16. 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
  17. 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 91
  18. 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
  19. 2023GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Textcited by 82
  20. 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
  21. 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 65
  22. 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMscited by 59
  23. 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
  24. 2024Tx-LLM: A Large Language Model for Therapeuticscited by 23
  25. 2024UniMoT: Unified Molecule-Text Language Model with Discrete Token Representationcited by 23
  26. 2024LLaMo: Large Language Model-based Molecular Graph Assistantcited by 22
  27. 2024MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehensioncited by 19
  28. 2024Can Large Language Models Understand Molecules?cited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 10.

16 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Structural Reasoning Improves Molecular Understanding of LLM
  2. 2025BioMedGPT-Mol: Multi-task Learning for Molecular Understanding and Generation
  3. 2025Mol-R1: Towards Explicit Long-CoT Reasoning in Molecule Discovery
  4. 2026Molecular Representations for Large Language Models
  5. 2025Mol-LLM: Multimodal Generalist Molecular LLM with Improved Graph Utilization
  6. 2026Rethinking Molecular Text Representations for LLMs: An Empirical Study
  7. 2025Omni-Mol: Multitask Molecular Model for Any-to-any Modalities
  8. 2026Bolek: A Multimodal Language Model for Molecular Reasoning