Improving Chemical Understanding of LLMs via SMILES Parsing
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly recognized as powerful tools for scientific discovery, particularly in molecular science. A fundamental requirement for these models is the ability to accurately understand molecular structures, commonly encoded in the SMILES representation. However, current LLMs struggle to interpret SMILES, even failing to carry out basic tasks such as counting molecular rings. To address this limitation, we introduce CLEANMOL, a novel framework that formulates SMILES parsing into a suite of clean and deterministic tasks explicitly designed to promote graph-level molecular comprehension. These tasks span from subgraph matching to global graph matching, providing structured supervision aligned with molecular structural properties. We construct a molecular pretraining dataset with adaptive difficulty scoring and pre-train open-source LLMs on these tasks. Our results show that CLEANMOL not only enhances structural comprehension but also achieves the best or competes with the baseline on the Mol-Instructions benchmark.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 19 of its 50 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
19 of 50 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
- 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 191
- 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 179
- 2022Translation between Molecules and Natural Languagecited by 173
- 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 146
- 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
- 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 124
- 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
7 more
- 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
- 2023Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspectivecited by 91
- 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
- 2024Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Modelscited by 83
- 2023MolXPT: Wrapping Molecules with Text for Generative Pre-trainingcited by 81
- 2025Nature Language Model: Deciphering the Language of Nature for Scientific Discoverycited by 35
- 2024Structural Reasoning Improves Molecular Understanding of LLMcited by 10
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025CoTox: Chain-of-Thought-Based Molecular Toxicity Reasoning and Predictioncited by 5
- 2025Exploring Modularity of Agentic Systems for Drug Discoverycited by 3
- 2026Evaluating Relational Reasoning in LLMs with RELcited by 2
- 2026MoleCode unlocks structural intelligence in large language modelscited by 0
- 2026MoleCode unlocks structural intelligence in large language models15 May 2026
- 2026Evaluating Relational Reasoning in LLMs with REL14 Apr 2026
- 2025CoTox: Chain-of-Thought-Based Molecular Toxicity Reasoning and Prediction5 Aug 2025
- 2025Exploring Modularity of Agentic Systems for Drug Discovery27 Jun 2025