mlsanityData to 7 Oct 2026

Mapping the Space of Chemical Reactions Using Attention-Based Neural Networks

arXiv 2012.06051 ↗First posted 9 Dec 2020physics.chem-ph cs.CL cs.LGcited by 70

Not on the map. Why?

Abstract (arXiv)

Organic reactions are usually assigned to classes containing reactions with similar reagents and mechanisms. Reaction classes facilitate the communication of complex concepts and efficient navigation through chemical reaction space. However, the classification process is a tedious task. It requires the identification of the corresponding reaction class template via annotation of the number of molecules in the reactions, the reaction center, and the distinction between reactants and reagents. This work shows that transformer-based models can infer reaction classes from non-annotated, simple text-based representations of chemical reactions. Our best model reaches a classification accuracy of 98.2%. We also show that the learned representations can be used as reaction fingerprints that capture fine-grained differences between reaction classes better than traditional reaction fingerprints. The insights into chemical reaction space enabled by our learned fingerprints are illustrated by an interactive reaction atlas providing visual clustering and similarity searching.

Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 7; 2023: 21; 2024: 15; 2025: 12; 2026: 11.

70 papers.

Sort:

By area:

  1. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  2. 2022Translation between Molecules and Natural Languagecited by 173
  3. 2021Geometric Deep Learning on Molecular Representationscited by 113
  4. 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
  5. 2024Scientific Large Language Models: A Survey on Biological & Chemical Domainscited by 80
  6. 2022Regression Transformer: Concurrent sequence regression and generation for molecular language modelingcited by 49
  7. 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
  8. 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
  9. 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
  10. 2024ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedbackcited by 32
  11. 2022MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Predictioncited by 28
  12. 2023PeptideBERT: A Language Model based on Transformers for Peptide Property Predictioncited by 21
38 more
  1. 2023Bayesian Optimization of Catalysis With In-Context Learningcited by 20
  2. 2023Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst Designcited by 16
  3. 2023SynerGPT: In-Context Learning for Personalized Drug Synergy Prediction and Drug Designcited by 13
  4. 2023Transformers and Large Language Models for Chemistry and Drug Discoverycited by 13
  5. 2024Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequencescited by 13
  6. 2021Multilingual Molecular Representation Learning via Contrastive Pre-trainingcited by 12
  7. 2025MOFGPT: Generative Design of Metal-Organic Frameworks using Language Modelscited by 11
  8. 2025Large language models as uncertainty-calibrated optimizers for experimental discoverycited by 10
  9. 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generationcited by 8
  10. 2023Towards out-of-distribution generalizable predictions of chemical kinetics propertiescited by 7
  11. 2024CARE: a Benchmark Suite for the Classification and Retrieval of Enzymescited by 7
  12. 2024Best Practices for Multi-Fidelity Bayesian Optimization in Materials and Molecular Researchcited by 7
  13. 2022Rxn Hypergraph: a Hypergraph Attention Model for Chemical Reaction Representationcited by 6
  14. 2023Explainability Techniques for Chemical Language Modelscited by 6
  15. 2023Language models in molecular discoverycited by 6
  16. 2024A Bayesian Flow Network Framework for Chemistry Taskscited by 6
  17. 2023Recent advances in artificial intelligence for retrosynthesiscited by 5
  18. 2023AI for Interpretable Chemistry: Predicting Radical Mechanistic Pathways via Contrastive Learningcited by 5
  19. 2024Retrosynthesis prediction enhanced by in-silico reaction data augmentationcited by 5
  20. 2024Peptide-GPT: Generative Design of Peptides using Generative Pre-trained Transformers and Bio-informatic Supervisioncited by 5
  21. 2025Synergistic Benefits of Joint Molecule Generation and Property Predictioncited by 5
  22. 2023Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Modelcited by 4
  23. 2023Atom-Motif Contrastive Transformer for Molecular Property Predictioncited by 4
  24. 2024Tokenization for Molecular Foundation Modelscited by 4
  25. 2022ImDrug: A Benchmark for Deep Imbalanced Learning in AI-aided Drug Discoverycited by 3
  26. 2024Leveraging Chemistry Foundation Models to Facilitate Structure Focused Retrieval Augmented Generation in Multi-Agent Workflows for Catalyst and Materials Designcited by 3
  27. 2025Survey on Recent Progress of AI for Chemistry: Methods, Applications, and Opportunitiescited by 3
  28. 2023Computational modeling of semantic changecited by 2
  29. 2023De Novo Drug Design with Joint Transformerscited by 2
  30. 2023GPCR-BERT: Interpreting Sequential Design of G Protein Coupled Receptors Using Protein Language Modelscited by 2
  31. 2023Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Datacited by 2
  32. 2023RetroOOD: Understanding Out-of-Distribution Generalization in Retrosynthesis Predictioncited by 2
  33. 2023Transfer Learning across Different Chemical Domains: Virtual Screening of Organic Materials with Deep Learning Models Pretrained on Small Molecule and Chemical Reaction Datacited by 1
  34. 2024Contextual Molecule Representation Learning from Chemical Reaction Knowledgecited by 1
  35. 2024A General-Purpose Framework for Chemical Reaction Representation with Atomic Correspondence and Flexible Condition Adaptationcited by 1
  36. 2025ChemHGNN: A Hierarchical Hypergraph Neural Network for Reaction Virtual Screening and Discoverycited by 1
  37. 2025SoDaDE: Solvent Data-Driven Embeddings with Small Transformer Modelscited by 1
  38. 2026SynRXN: An Open Benchmark and Curated Dataset for Computational Reaction Modelingcited by 1

50 most cited of 70 All 70 (JSON)