Mapping the Space of Chemical Reactions Using Attention-Based Neural Networks
Not on the map. Why?
Abstract (arXiv)
Organic reactions are usually assigned to classes containing reactions with similar reagents and mechanisms. Reaction classes facilitate the communication of complex concepts and efficient navigation through chemical reaction space. However, the classification process is a tedious task. It requires the identification of the corresponding reaction class template via annotation of the number of molecules in the reactions, the reaction center, and the distinction between reactants and reagents. This work shows that transformer-based models can infer reaction classes from non-annotated, simple text-based representations of chemical reactions. Our best model reaches a classification accuracy of 98.2%. We also show that the learned representations can be used as reaction fingerprints that capture fine-grained differences between reaction classes better than traditional reaction fingerprints. The insights into chemical reaction space enabled by our learned fingerprints are illustrated by an interactive reaction atlas providing visual clustering and similarity searching.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 21; 2024: 15; 2025: 12; 2026: 11.
70 papers.
Sort:
By area:
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2022Translation between Molecules and Natural Languagecited by 173
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domainscited by 80
- 2022Regression Transformer: Concurrent sequence regression and generation for molecular language modelingcited by 49
- 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
- 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
- 2024ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedbackcited by 32
- 2022MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Predictioncited by 28
- 2023PeptideBERT: A Language Model based on Transformers for Peptide Property Predictioncited by 21
38 more
- 2023Bayesian Optimization of Catalysis With In-Context Learningcited by 20
- 2023Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst Designcited by 16
- 2023SynerGPT: In-Context Learning for Personalized Drug Synergy Prediction and Drug Designcited by 13
- 2023Transformers and Large Language Models for Chemistry and Drug Discoverycited by 13
- 2024Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequencescited by 13
- 2021Multilingual Molecular Representation Learning via Contrastive Pre-trainingcited by 12
- 2025MOFGPT: Generative Design of Metal-Organic Frameworks using Language Modelscited by 11
- 2025Large language models as uncertainty-calibrated optimizers for experimental discoverycited by 10
- 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generationcited by 8
- 2023Towards out-of-distribution generalizable predictions of chemical kinetics propertiescited by 7
- 2024CARE: a Benchmark Suite for the Classification and Retrieval of Enzymescited by 7
- 2024Best Practices for Multi-Fidelity Bayesian Optimization in Materials and Molecular Researchcited by 7
- 2022Rxn Hypergraph: a Hypergraph Attention Model for Chemical Reaction Representationcited by 6
- 2023Explainability Techniques for Chemical Language Modelscited by 6
- 2023Language models in molecular discoverycited by 6
- 2024A Bayesian Flow Network Framework for Chemistry Taskscited by 6
- 2023Recent advances in artificial intelligence for retrosynthesiscited by 5
- 2023AI for Interpretable Chemistry: Predicting Radical Mechanistic Pathways via Contrastive Learningcited by 5
- 2024Retrosynthesis prediction enhanced by in-silico reaction data augmentationcited by 5
- 2024Peptide-GPT: Generative Design of Peptides using Generative Pre-trained Transformers and Bio-informatic Supervisioncited by 5
- 2025Synergistic Benefits of Joint Molecule Generation and Property Predictioncited by 5
- 2023Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Modelcited by 4
- 2023Atom-Motif Contrastive Transformer for Molecular Property Predictioncited by 4
- 2024Tokenization for Molecular Foundation Modelscited by 4
- 2022ImDrug: A Benchmark for Deep Imbalanced Learning in AI-aided Drug Discoverycited by 3
- 2024Leveraging Chemistry Foundation Models to Facilitate Structure Focused Retrieval Augmented Generation in Multi-Agent Workflows for Catalyst and Materials Designcited by 3
- 2025Survey on Recent Progress of AI for Chemistry: Methods, Applications, and Opportunitiescited by 3
- 2023Computational modeling of semantic changecited by 2
- 2023De Novo Drug Design with Joint Transformerscited by 2
- 2023GPCR-BERT: Interpreting Sequential Design of G Protein Coupled Receptors Using Protein Language Modelscited by 2
- 2023Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Datacited by 2
- 2023RetroOOD: Understanding Out-of-Distribution Generalization in Retrosynthesis Predictioncited by 2
- 2023Transfer Learning across Different Chemical Domains: Virtual Screening of Organic Materials with Deep Learning Models Pretrained on Small Molecule and Chemical Reaction Datacited by 1
- 2024Contextual Molecule Representation Learning from Chemical Reaction Knowledgecited by 1
- 2024A General-Purpose Framework for Chemical Reaction Representation with Atomic Correspondence and Flexible Condition Adaptationcited by 1
- 2025ChemHGNN: A Hierarchical Hypergraph Neural Network for Reaction Virtual Screening and Discoverycited by 1
- 2025SoDaDE: Solvent Data-Driven Embeddings with Small Transformer Modelscited by 1
- 2026SynRXN: An Open Benchmark and Curated Dataset for Computational Reaction Modelingcited by 1
50 most cited of 70 All 70 (JSON)
- 2026Role-Aware Morgan Fingerprints for Reaction Yield Prediction26 Aug 2026
- 2026Strategy-first synthesis planning for complex natural products7 Aug 2026
- 2026ChemFusion: A Multimodal Cross-Attention Network for Reaction Yield Prediction19 Jul 2026
- 2026Agentic generation of verifiable rules for deterministic, self-expanding reaction classification1 Jul 2026
- 2026Bridging Chemists and AI: An Expert-Augmented Framework for Interpretable Route Evaluation27 May 2026
- 2026CompleteRXN: Toward Completing Open Chemical Reaction Databases30 Apr 2026
- 2026Hybrid Quantum-Classical Encoding for Accurate Residue-Level pKa Prediction9 Mar 2026
- 2026Modular Multi-Task Learning for Chemical Reaction Prediction11 Feb 2026
- 2026TSSR: Two-Stage Swap-Reward-Driven Reinforcement Learning for Character-Level SMILES Generation8 Jan 2026
- 2026A Pre-trained Reaction Embedding Descriptor Capturing Bond Transformation Patterns7 Jan 2026
- 2026SynRXN: An Open Benchmark and Curated Dataset for Computational Reaction Modeling5 Jan 2026
- 2025Teaching Language Models Mechanistic Explainability Through MechSMILES5 Dec 2025
38 more
- 2025Reaction Prediction via Interaction Modeling of Symmetric Difference Shingle Sets9 Nov 2025
- 2025Guiding Evolutionary Molecular Design: Adding Reinforcement Learning for Mutation Selection1 Oct 2025
- 2025SoDaDE: Solvent Data-Driven Embeddings with Small Transformer Models26 Sep 2025
- 2025Learning to Align Molecules and Proteins: A Geometry-Aware Approach to Binding Affinity25 Sep 2025
- 2025SynBridge: Bridging Reaction States via Discrete Flow for Bidirectional Reaction Prediction11 Jul 2025
- 2025MOFGPT: Generative Design of Metal-Organic Frameworks using Language Models30 May 2025
- 2025ChemHGNN: A Hierarchical Hypergraph Neural Network for Reaction Virtual Screening and Discovery21 May 2025
- 2025Synergistic Benefits of Joint Molecule Generation and Property Prediction23 Apr 2025
- 2025Large language models as uncertainty-calibrated optimizers for experimental discovery8 Apr 2025
- 2025Chemical knowledge-informed framework for privacy-aware retrosynthesis learning26 Feb 2025
- 2025Survey on Recent Progress of AI for Chemistry: Methods, Applications, and Opportunities9 Feb 2025
- 2024A General-Purpose Framework for Chemical Reaction Representation with Atomic Correspondence and Flexible Condition Adaptation26 Nov 2024
- 2024Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequences6 Nov 2024
- 2024Peptide-GPT: Generative Design of Peptides using Generative Pre-trained Transformers and Bio-informatic Supervision25 Oct 2024
- 2024log-RRIM: Yield Prediction via Local-to-global Reaction Representation Learning and Interaction Modeling20 Oct 2024
- 2024Best Practices for Multi-Fidelity Bayesian Optimization in Materials and Molecular Research1 Oct 2024
- 2024Tokenization for Molecular Foundation Models19 Sep 2024
- 2024Leveraging Chemistry Foundation Models to Facilitate Structure Focused Retrieval Augmented Generation in Multi-Agent Workflows for Catalyst and Materials Design21 Aug 2024
- 2024A Bayesian Flow Network Framework for Chemistry Tasks28 Jul 2024
- 2024CARE: a Benchmark Suite for the Classification and Retrieval of Enzymes21 Jun 2024
- 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation11 Mar 2024
- 2024Contextual Molecule Representation Learning from Chemical Reaction Knowledge21 Feb 2024
- 2024ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedback15 Feb 2024
- 2024NLP for Knowledge Discovery and Information Extraction from Energetics Corpora10 Feb 2024
- 2024Retrosynthesis prediction enhanced by in-silico reaction data augmentation31 Jan 2024
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domains26 Jan 2024
- 2023RetroOOD: Understanding Out-of-Distribution Generalization in Retrosynthesis Prediction18 Dec 2023
- 2023Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data6 Dec 2023
- 2023Transfer Learning across Different Chemical Domains: Virtual Screening of Organic Materials with Deep Learning Models Pretrained on Small Molecule and Chemical Reaction Data30 Nov 2023
- 2023AI for Interpretable Chemistry: Predicting Radical Mechanistic Pathways via Contrastive Learning2 Nov 2023
- 2023GPCR-BERT: Interpreting Sequential Design of G Protein Coupled Receptors Using Protein Language Models30 Oct 2023
- 2023Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst Design22 Oct 2023
- 2023Atom-Motif Contrastive Transformer for Molecular Property Prediction11 Oct 2023
- 2023Deep reinforcement learning uncovers processes for separating azeotropic mixtures without prior knowledge10 Oct 2023
- 2023Transformers and Large Language Models for Chemistry and Drug Discovery9 Oct 2023
- 2023Towards out-of-distribution generalizable predictions of chemical kinetics properties4 Oct 2023
- 2023De Novo Drug Design with Joint Transformers3 Oct 2023
- 2023Language models in molecular discovery28 Sep 2023
50 newest of 70 All 70 (JSON)
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2022Translation between Molecules and Natural Languagecited by 173
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domainscited by 80
- 2022Regression Transformer: Concurrent sequence regression and generation for molecular language modelingcited by 49
- 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
- 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
- 2022MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Predictioncited by 28
- 2023PeptideBERT: A Language Model based on Transformers for Peptide Property Predictioncited by 21
- 2023Bayesian Optimization of Catalysis With In-Context Learningcited by 20
12 most cited of 66 All 66 (JSON)
- 2026Role-Aware Morgan Fingerprints for Reaction Yield Prediction26 Aug 2026
- 2026Strategy-first synthesis planning for complex natural products7 Aug 2026
- 2026ChemFusion: A Multimodal Cross-Attention Network for Reaction Yield Prediction19 Jul 2026
- 2026Bridging Chemists and AI: An Expert-Augmented Framework for Interpretable Route Evaluation27 May 2026
- 2026CompleteRXN: Toward Completing Open Chemical Reaction Databases30 Apr 2026
- 2026Hybrid Quantum-Classical Encoding for Accurate Residue-Level pKa Prediction9 Mar 2026
- 2026Modular Multi-Task Learning for Chemical Reaction Prediction11 Feb 2026
- 2026TSSR: Two-Stage Swap-Reward-Driven Reinforcement Learning for Character-Level SMILES Generation8 Jan 2026
- 2026A Pre-trained Reaction Embedding Descriptor Capturing Bond Transformation Patterns7 Jan 2026
- 2026SynRXN: An Open Benchmark and Curated Dataset for Computational Reaction Modeling5 Jan 2026
- 2025Teaching Language Models Mechanistic Explainability Through MechSMILES5 Dec 2025
- 2025Reaction Prediction via Interaction Modeling of Symmetric Difference Shingle Sets9 Nov 2025
12 newest of 66 All 66 (JSON)