Bolek: A Multimodal Language Model for Molecular Reasoning
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Molecular property models increasingly support high-stakes drug-discovery decisions, but their outputs are often difficult to audit: classical predictors return scores without rationale, while language models can produce fluent explanations weakly grounded in the input molecule. We introduce Bolek, a compact multimodal language model that grounds natural-language reasoning in molecular structure by injecting a Morgan fingerprint embedding into an instruction-tuned text decoder. Bolek is fine-tuned on molecular alignment tasks, including molecule description, RDKit descriptor prediction, and substructure detection, and on downstream reasoning over 15 TDC binary classification tasks using synthetic chains-of-thought anchored in concrete molecular features. Across these tasks, Bolek outperforms its Qwen3-4B-Instruct base on all endpoints in yes/no mode and on 13 of 15 in chain-of-thought mode, raising mean ROC/PR AUC from 0.55 to 0.76. It also outperforms TxGemma-9B-Chat on 13 of 15 binary classification tasks despite being less than half its size. Bolek's explanations are more grounded than those of the baseline LLMs: it cites numerical descriptors 10-100x more often per chain-of-thought, and the cited values agree strongly with RDKit for key descriptors such as TPSA, MolLogP, and MolWt (Spearman rho = 0.87-0.91). Generalisation extends beyond the training panel: on 15 unseen TDC classification endpoints, Bolek matches TxGemma on five, and it produces non-trivial rank correlations on three held-out regression endpoints despite never seeing downstream regression during training. These results suggest that targeted modality injection and reasoning supervision tied to verifiable molecular features can yield compact, auditable molecular reasoning models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 22 of its 72 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
22 of 72 references.
Closest ancestors · 1
Same direction, newest first
Other references · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 131
- 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
- 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 127
- 2024ChemLLM: A Chemical Large Language Modelcited by 106
- 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 100
- 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
- 2024Developing ChemDFM as a large language foundation model for chemistrycited by 52
9 more
- 2025TxGemma: Efficient and Agentic LLMs for Therapeuticscited by 41
- 2024Tx-LLM: A Large Language Model for Therapeuticscited by 25
- 2024LLaMo: Large Language Model-based Molecular Graph Assistantcited by 22
- 2024A quantitative analysis of knowledge-learning preferences in large language models in molecular sciencecited by 18
- 2024ChemToolAgent: The Impact of Tools on Language Agents for Chemistry Problem Solvingcited by 11
- 2024Advancing Molecular Graph-Text Pre-training via Fine-grained Alignmentcited by 9
- 2025KnowMol: Advancing Molecular Large Language Models with Multi-Level Chemical Knowledgecited by 7
- 2024MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extensioncited by 5
- 2025MolPILE -- large-scale, diverse dataset for molecular representation learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning-Enhanced Large Language Models for Molecular Property Prediction
- 2024Structural Reasoning Improves Molecular Understanding of LLM
- 2025Mol-R1: Towards Explicit Long-CoT Reasoning in Molecule Discovery
- 2025M2LLM: Multi-view Molecular Representation Learning with Large Language Models
- 2025BioMedGPT-Mol: Multi-task Learning for Molecular Understanding and Generation
- 2026MoleCode unlocks structural intelligence in large language models
- 2026Rethinking Molecular Text Representations for LLMs: An Empirical Study
- 2025Large Language Model Agent for Modular Task Execution in Drug Discovery