mlsanityData to 14 Oct 2026

Learning Transferable Reaction Mechanisms from Visual Chemical Knowledge

arXiv 2609.33608 ↗First posted 27 Sep 2026cs.CE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reaction mechanisms describe the step-by-step transformations underlying chemical reactions and are central to reaction analysis and synthesis. Learning-based models have achieved strong performance on established mechanism-prediction benchmarks, but transferring them to unseen chemistry remains challenging. Such transfer is difficult because familiar mechanisms must be applied to unfamiliar molecular structures, and some target mechanisms may be poorly covered by the training data. To address these challenges, we introduce MechaVLM, a visual framework that combines transferable chemical representations with external mechanistic knowledge. It learns reusable visual features through multiscale chemical grounding and cross-rendering contrastive learning. For open-book prediction, MechaVLM retrieves a fixed set of precedents from 70,384 literature mechanism figures and re-reads relevant visual evidence as the molecular state evolves, directly using the figures without symbolic mechanism parsing. An atom-indexed language decoder then recursively generates executable electron edits to construct the complete mechanism. We further introduce MechBench, a challenging literature-derived benchmark with 2,184 mechanisms and 9,146 elementary steps. Across cross-dataset and literature-derived benchmarks, MechaVLM establishes strong zero-shot mechanism prediction. Its closed-book model alone improves Step/Pathway Top-1 by 12.50/13.93 percentage points on FlowER-to-ReactMech transfer, while external visual precedents unlock further gains on challenging OOD reactions. The learned representation also generalizes beyond mechanism prediction to atom mapping and reaction center prediction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 26 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

20 of 26 references.

References · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documentscited by 245
  4. 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 229
  5. 2024ColPali: Efficient Document Retrieval with Vision Language Modelscited by 195
  6. 2020A Graph to Graphs Framework for Retrosynthesis Predictioncited by 86
  7. 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Areacited by 71
  8. 2020RetroXpert: Decompose Retrosynthesis Prediction like a Chemistcited by 68
  9. 2021Permutation invariant graph-to-sequence model for template-free retrosynthesis and reaction predictioncited by 68
  10. 2022MolScribe: Robust Molecular Structure Recognition with Image-To-Graph Generationcited by 49
  11. 2018A Generative Model For Electron Pathscited by 31
  12. 2025ChemDFM-R: A Chemical Reasoning LLM Enhanced with Atomized Chemical Knowledgecited by 20
8 more
  1. 2021Non-Autoregressive Electron Redistribution Modeling for Reaction Predictioncited by 17
  2. 2024OpenChemIE: An Information Extraction Toolkit For Chemistry Literaturecited by 17
  3. 2025Electron flow matching for generative reaction mechanism prediction obeying conservation lawscited by 13
  4. 2025GDiffRetro: Retrosynthesis Prediction with Dual Graph Enhanced Molecular Representation and Diffusion Generationcited by 7
  5. 2025TinyChemVL: Advancing Chemical Vision-Language Models via Efficient Visual Token Reduction and Complex Reaction Taskscited by 6
  6. 2026ChemVLR: Prioritizing Reasoning in Perception for Chemical Vision-Language Understandingcited by 2
  7. 2025DeepMech: A Machine Learning Framework for Chemical Reaction Mechanism Predictioncited by 1
  8. 2026Learning Mechanistic Reasoning for Chemical Reactions with Large Language Modelscited by 1

Built on by

Not cited yet.