mlsanityData to 7 Oct 2026

Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Model

arXiv 2303.06965 ↗First posted 13 Mar 2023cs.LG q-bio.BMcited by 4

Not on the map. Why?

Abstract (arXiv)

Chemical reactions are the fundamental building blocks of drug design and organic chemistry research. In recent years, there has been a growing need for a large-scale deep-learning framework that can efficiently capture the basic rules of chemical reactions. In this paper, we have proposed a unified framework that addresses both the reaction representation learning and molecule generation tasks, which allows for a more holistic approach. Inspired by the organic chemistry mechanism, we develop a novel pretraining framework that enables us to incorporate inductive biases into the model. Our framework achieves state-of-the-art results on challenging downstream tasks. By possessing chemical knowledge, our generative framework overcome the limitations of current molecule generation models that rely on a small number of reaction templates. In the extensive experiments, our model generates synthesizable drug-like structures of high quality. Overall, our work presents a significant step toward a large-scale deep-learning framework for a variety of reaction-based applications.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 55 references that are in the map. First posted on arXiv 13 Mar 2023.

Builds on

17 of 55 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2017Billion-scale similarity search with GPUscited by 2,477
  5. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  6. 2020Pretrained Transformers Improve Out-of-Distribution Robustnesscited by 293
  7. 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 270
  8. 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
  9. 2017Predicting Organic Reaction Outcomes with Weisfeiler-Lehman Networkcited by 102
  10. 2019ChemBO: Bayesian Optimization of Small Organic Molecules with Synthesizable Recommendationscited by 77
  11. 2020Mapping the Space of Chemical Reactions Using Attention-Based Neural Networkscited by 70
  12. 2019Dynamic Graph Message Passing Networkscited by 62
5 more
  1. 2021Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Designcited by 44
  2. 2019A Model to Search for Synthesizable Moleculescited by 37
  3. 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
  4. 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
  5. 2020Barking up the right tree: an approach to search over molecule synthesis DAGscited by 31

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.