mlsanityData to 14 Oct 2026

RxnScribe: A Sequence Generation Model for Reaction Diagram Parsing

arXiv 2305.11845 ↗First posted 19 May 2023cs.CL cs.AI cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

Reaction diagram parsing is the task of extracting reaction schemes from a diagram in the chemistry literature. The reaction diagrams can be arbitrarily complex, thus robustly parsing them into structured data is an open challenge. In this paper, we present RxnScribe, a machine learning model for parsing reaction diagrams of varying styles. We formulate this structured prediction task with a sequence generation approach, which condenses the traditional pipeline into an end-to-end model. We train RxnScribe on a dataset of 1,378 diagrams and evaluate it with cross validation, achieving an 80.0% soft match F1 score, with significant improvements over previous models. Our code and data are publicly available at https://github.com/thomas0809/RxnScribe.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 8 of its 34 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

8 of 34 references.

References · 8

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2020End-to-End Object Detection with Transformerscited by 7,414
  3. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 349
  4. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
  5. 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
  6. 2022MolScribe: Robust Molecular Structure Recognition with Image-To-Graph Generationcited by 49
  7. 2018Molecular Structure Extraction From Documents Using Deep Learningcited by 25
  8. 2020ChemGrapher: Optical Graph Recognition of Chemical Compounds by Deep Learningcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 5; 2026: 5.

17 papers.

Sort:

By area:

  1. 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Areacited by 71
  2. 2024OpenChemIE: An Information Extraction Toolkit For Chemistry Literaturecited by 17
  3. 2024From Generalist to Specialist: A Survey of Large Language Models for Chemistrycited by 11
  4. 2023Predictive Chemistry Augmented with Text Retrievalcited by 10
  5. 2025Evaluating Large Language Models on Multimodal Chemistry Olympiad Examscited by 6
  6. 2024textttPatentAgent: Intelligent Agent for Automated Pharmaceutical Patent Analysiscited by 4
  7. 2025Towards Large-scale Chemical Reaction Image Parsing via a Multimodal Large Language Modelcited by 4
  8. 2025RxnCaption: Reformulating Reaction Diagram Parsing as Visual Prompt Guided Captioningcited by 3
  9. 2024SMiCRM: A Benchmark Dataset of Mechanistic Molecular Imagescited by 2
  10. 2025MolMole: Molecule Mining from Scientific Literaturecited by 2
  11. 2026Molecular Identifier Visual Prompt and Verifiable Reinforcement Learning for Chemical Reaction Diagram Parsingcited by 2
  12. 2025Large Language Models Transform Organic Synthesis From Reaction Prediction to Automationcited by 1
5 more
  1. 2026MinerU.Chem: A High-Precision System for Optical Chemical Structure and Reaction Recognitioncited by 1
  2. 2024EnzChemRED, a rich enzyme chemistry relation extraction datasetcited by 0
  3. 2026Harnessing X-ray Absorption Spectroscopy Data through Multimodal Mining of Battery Literaturecited by 0
  4. 2026VERDICT: Agreement Beats Pixel-Space Verification in Real-Document OCSRcited by 0
  5. 2026ChemExplain: A Multimodal Benchmark for Explanatory Chemical Reasoningcited by 0