Mol-LLaMA: Towards General Understanding of Molecules in Large Molecular Language Model
Not on the map. Why?
Abstract (arXiv)
Understanding molecules is key to understanding organisms and driving advances in drug discovery, requiring interdisciplinary knowledge across chemistry and biology. Although large molecular language models have achieved notable success in task transfer, they often struggle to accurately analyze molecular features due to limited knowledge and reasoning capabilities. To address this issue, we present Mol-LLaMA, a large molecular language model that grasps the general knowledge centered on molecules and exhibits explainability and reasoning ability. To this end, we design key data types that encompass the fundamental molecular features, taking into account the essential abilities for molecular reasoning. Further, to improve molecular understanding, we propose a module that integrates complementary information from different molecular encoders, leveraging the distinct advantages of molecular representations. Our experimental results demonstrate that Mol-LLaMA is capable of comprehending the general features of molecules and providing informative responses, implying its potential as a general-purpose assistant for molecular analysis. Our project page is at https://mol-llama.github.io/.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 40 of its 72 references that are in the map. First posted on arXiv 19 Feb 2025.
Builds on
40 of 72 references.
References · 40
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
28 more
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2022Translation between Molecules and Natural Languagecited by 173
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
- 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
- 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
- 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 124
- 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
- 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
- 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 91
- 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
- 2023GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Textcited by 82
- 2025Learning Smooth and Expressive Interatomic Potentials for Physical Property Predictioncited by 79
- 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 65
- 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMscited by 59
- 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
- 2024Tx-LLM: A Large Language Model for Therapeuticscited by 23
- 2024UniMoT: Unified Molecule-Text Language Model with Discrete Token Representationcited by 23
- 2024LLaMo: Large Language Model-based Molecular Graph Assistantcited by 22
- 2024MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehensioncited by 19
- 2024Can Large Language Models Understand Molecules?cited by 10
Built on by
Citing papers per year: 2025: 6; 2026: 10.
16 papers.
Sort:
By area:
- 2026Graph is a Substrate Across Data Modalitiescited by 13
- 2025MolReasoner: Toward Effective and Interpretable Reasoning for Molecular LLMscited by 11
- 2025Flex-Judge: Text-Only Reasoning Unleashes Zero-Shot Multimodal Evaluatorscited by 6
- 2025Multimodal Prompt Optimization: Why Not Leverage Multiple Modalities for MLLMscited by 5
- 2025Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification?cited by 2
- 2026ToxReason: A Benchmark for Mechanistic Chemical Toxicity Reasoning via Adverse Outcome Pathwaycited by 2
- 2025MoRA: On-the-fly Molecule-aware Low-Rank Adaptation Framework for LLM-based Multi-Modal Molecular Assistantcited by 1
- 2025NMIRacle: Multi-modal Generative Molecular Elucidation from IR and NMR Spectracited by 1
- 2026Entropy-Guided Dynamic Tokens for Graph-LLM Alignment in Molecular Understandingcited by 1
- 2026MolLangData: A Large-Scale Dataset for Molecular Structure-Language Description via a Rule-Regularized Methodcited by 0
- 2026Scaling-Aware Adapter for Structure-Grounded LLM Reasoningcited by 0
- 2026ES-Merging: Biological MLLM Merging via Embedding Space Signalscited by 0
4 more
- 2026MolRGen: A Training and Evaluation Setting for De Novo Molecular Generation with Reasonning Modelscited by 0
- 2026MoleCode unlocks structural intelligence in large language modelscited by 0
- 2026Multi-Granular Rationale-Guided Molecular LLM for Property Predictioncited by 0
- 2026SafeMol: Dual-Modality Safety Alignment for Molecular Multimodal Modelscited by 0
- 2026SafeMol: Dual-Modality Safety Alignment for Molecular Multimodal Models27 Sep 2026
- 2026Multi-Granular Rationale-Guided Molecular LLM for Property Prediction11 Aug 2026
- 2026MoleCode unlocks structural intelligence in large language models15 May 2026
- 2026ToxReason: A Benchmark for Mechanistic Chemical Toxicity Reasoning via Adverse Outcome Pathway7 Apr 2026
- 2026MolRGen: A Training and Evaluation Setting for De Novo Molecular Generation with Reasonning Models18 Mar 2026
- 2026ES-Merging: Biological MLLM Merging via Embedding Space Signals15 Mar 2026
- 2026Scaling-Aware Adapter for Structure-Grounded LLM Reasoning2 Feb 2026
- 2026Entropy-Guided Dynamic Tokens for Graph-LLM Alignment in Molecular Understanding2 Feb 2026
- 2026MolLangData: A Large-Scale Dataset for Molecular Structure-Language Description via a Rule-Regularized Method2 Feb 2026
- 2026Graph is a Substrate Across Data Modalities29 Jan 2026
- 2025NMIRacle: Multi-modal Generative Molecular Elucidation from IR and NMR Spectra17 Dec 2025
- 2025MoRA: On-the-fly Molecule-aware Low-Rank Adaptation Framework for LLM-based Multi-Modal Molecular Assistant14 Oct 2025
4 more
- 2025Multimodal Prompt Optimization: Why Not Leverage Multiple Modalities for MLLMs10 Oct 2025
- 2025MolReasoner: Toward Effective and Interpretable Reasoning for Molecular LLMs4 Aug 2025
- 2025Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification?12 Jun 2025
- 2025Flex-Judge: Text-Only Reasoning Unleashes Zero-Shot Multimodal Evaluators24 May 2025
- 2025MolReasoner: Toward Effective and Interpretable Reasoning for Molecular LLMscited by 11
- 2025Flex-Judge: Text-Only Reasoning Unleashes Zero-Shot Multimodal Evaluatorscited by 6
- 2026ToxReason: A Benchmark for Mechanistic Chemical Toxicity Reasoning via Adverse Outcome Pathwaycited by 2
- 2026Scaling-Aware Adapter for Structure-Grounded LLM Reasoningcited by 0
- 2026MolRGen: A Training and Evaluation Setting for De Novo Molecular Generation with Reasonning Modelscited by 0
- 2026ToxReason: A Benchmark for Mechanistic Chemical Toxicity Reasoning via Adverse Outcome Pathway7 Apr 2026
- 2026MolRGen: A Training and Evaluation Setting for De Novo Molecular Generation with Reasonning Models18 Mar 2026
- 2026Scaling-Aware Adapter for Structure-Grounded LLM Reasoning2 Feb 2026
- 2025MolReasoner: Toward Effective and Interpretable Reasoning for Molecular LLMs4 Aug 2025
- 2025Flex-Judge: Text-Only Reasoning Unleashes Zero-Shot Multimodal Evaluators24 May 2025
- 2026Graph is a Substrate Across Data Modalitiescited by 13
- 2025Multimodal Prompt Optimization: Why Not Leverage Multiple Modalities for MLLMscited by 5
- 2025Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification?cited by 2
- 2025MoRA: On-the-fly Molecule-aware Low-Rank Adaptation Framework for LLM-based Multi-Modal Molecular Assistantcited by 1
- 2025NMIRacle: Multi-modal Generative Molecular Elucidation from IR and NMR Spectracited by 1
- 2026Entropy-Guided Dynamic Tokens for Graph-LLM Alignment in Molecular Understandingcited by 1
- 2026MolLangData: A Large-Scale Dataset for Molecular Structure-Language Description via a Rule-Regularized Methodcited by 0
- 2026MoleCode unlocks structural intelligence in large language modelscited by 0
- 2026Multi-Granular Rationale-Guided Molecular LLM for Property Predictioncited by 0
- 2026Multi-Granular Rationale-Guided Molecular LLM for Property Prediction11 Aug 2026
- 2026MoleCode unlocks structural intelligence in large language models15 May 2026
- 2026Entropy-Guided Dynamic Tokens for Graph-LLM Alignment in Molecular Understanding2 Feb 2026
- 2026MolLangData: A Large-Scale Dataset for Molecular Structure-Language Description via a Rule-Regularized Method2 Feb 2026
- 2026Graph is a Substrate Across Data Modalities29 Jan 2026
- 2025NMIRacle: Multi-modal Generative Molecular Elucidation from IR and NMR Spectra17 Dec 2025
- 2025MoRA: On-the-fly Molecule-aware Low-Rank Adaptation Framework for LLM-based Multi-Modal Molecular Assistant14 Oct 2025
- 2025Multimodal Prompt Optimization: Why Not Leverage Multiple Modalities for MLLMs10 Oct 2025
- 2025Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification?12 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024Structural Reasoning Improves Molecular Understanding of LLM
- 2025BioMedGPT-Mol: Multi-task Learning for Molecular Understanding and Generation
- 2025Mol-R1: Towards Explicit Long-CoT Reasoning in Molecule Discovery
- 2026Molecular Representations for Large Language Models
- 2025Mol-LLM: Multimodal Generalist Molecular LLM with Improved Graph Utilization
- 2026Rethinking Molecular Text Representations for LLMs: An Empirical Study
- 2025Omni-Mol: Multitask Molecular Model for Any-to-any Modalities
- 2026Bolek: A Multimodal Language Model for Molecular Reasoning