mlsanityData to 7 Oct 2026

Improving Chemical Understanding of LLMs via SMILES Parsing

arXiv 2505.16340 ↗First posted 22 May 2025cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly recognized as powerful tools for scientific discovery, particularly in molecular science. A fundamental requirement for these models is the ability to accurately understand molecular structures, commonly encoded in the SMILES representation. However, current LLMs struggle to interpret SMILES, even failing to carry out basic tasks such as counting molecular rings. To address this limitation, we introduce CLEANMOL, a novel framework that formulates SMILES parsing into a suite of clean and deterministic tasks explicitly designed to promote graph-level molecular comprehension. These tasks span from subgraph matching to global graph matching, providing structured supervision aligned with molecular structural properties. We construct a molecular pretraining dataset with adaptive difficulty scoring and pre-train open-source LLMs on these tasks. Our results show that CLEANMOL not only enhances structural comprehension but also achieves the best or competes with the baseline on the Mol-Instructions benchmark.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 19 of its 50 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

19 of 50 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  4. 2022Galactica: A Large Language Model for Sciencecited by 736
  5. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  6. 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 191
  7. 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 179
  8. 2022Translation between Molecules and Natural Languagecited by 173
  9. 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 146
  10. 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
  11. 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 124
  12. 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
7 more
  1. 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
  2. 2023Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspectivecited by 91
  3. 2023InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discoverycited by 86
  4. 2024Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Modelscited by 83
  5. 2023MolXPT: Wrapping Molecules with Text for Generative Pre-trainingcited by 81
  6. 2025Nature Language Model: Deciphering the Language of Nature for Scientific Discoverycited by 35
  7. 2024Structural Reasoning Improves Molecular Understanding of LLMcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.