ChemVLR: Prioritizing Reasoning in Perception for Chemical Vision-Language Understanding
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
While Vision-Language Models (VLMs) have demonstrated significant potential in chemical visual understanding, current models are predominantly optimized for direct visual question-answering tasks. This paradigm often results in "black-box" systems that fail to utilize the inherent capability of Large Language Models (LLMs) to infer underlying reaction mechanisms. In this work, we introduce ChemVLR, a chemical VLM designed to prioritize reasoning within the perception process. Unlike conventional chemical VLMs, ChemVLR analyzes visual inputs in a fine-grained manner by explicitly identifying granular chemical descriptors, such as functional groups, prior to generating answers. This approach ensures the production of explicit and interpretable reasoning paths for complex visual chemical problems. To facilitate this methodology, we implement a cross-modality reverse-engineering strategy, combined with a rigorous filtering pipeline, to curate a large-scale reasoning-and-captioning dataset comprising 760k high-quality samples across molecular and reaction tasks. Furthermore, we adopt a three-stage training framework that systemically builds model perception and reasoning capacity. Experiments demonstrate that ChemVLR achieves state-of-the-art (SOTA) performance, surpassing both leading proprietary models and domain-specific open-source baselines. We also provide comprehensive ablation studies to validate our training strategy and data generation designs. Code and model weights will be available at https://github.com/xxlllz/ChemVLR.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 13 of its 16 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
13 of 16 references.
Closest ancestors · 2
Same direction, newest first
- 2025Mol-R1: Towards Explicit Long-CoT Reasoning in Molecule Discovery11 Aug
- 2025Training a Scientific Reasoning Model for Chemistry4 Jun
Other references · 11
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
- 2025Scalable Vision Language Model Training via High Quality Data Curationcited by 54
- 2022MolScribe: Robust Molecular Structure Recognition with Image-To-Graph Generationcited by 48
- 2025Reverse-Engineered Reasoning for Open-Ended Generationcited by 32
- 2023MolGrapher: Graph-based Visual Recognition of Chemical Structurescited by 24
- 2024A quantitative analysis of knowledge-learning preferences in large language models in molecular sciencecited by 18
- 2024From Generalist to Specialist: A Survey of Large Language Models for Chemistrycited by 11
- 2025TinyChemVL: Advancing Chemical Vision-Language Models via Efficient Visual Token Reduction and Complex Reaction Taskscited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Area
- 2025ChemVTS-Bench: Evaluating Visual-Textual-Symbolic Reasoning of Multimodal Large Language Models in Chemistry
- 2026DISSECT: Diagnosing Where Vision Ends and Language Priors Begin in Scientific VLMs
- 2026MolSight: A Graph-Aware Vision-Language Model for Unified Chemical Image Understanding
- 2025RxnBench: A Multimodal Benchmark for Evaluating Large Language Models on Chemical Reaction Understanding from Scientific Literature
- 2025ChemATP: A Training-Free Chemical Reasoning Framework for Large Language Models
- 2026Localize, Then Reason: Visual Latent Structural Reasoning for Molecular Properties and Edits
- 2026Molecular Identifier Visual Prompt and Verifiable Reinforcement Learning for Chemical Reaction Diagram Parsing