Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Model
Not on the map. Why?
Abstract (arXiv)
Chemical reactions are the fundamental building blocks of drug design and organic chemistry research. In recent years, there has been a growing need for a large-scale deep-learning framework that can efficiently capture the basic rules of chemical reactions. In this paper, we have proposed a unified framework that addresses both the reaction representation learning and molecule generation tasks, which allows for a more holistic approach. Inspired by the organic chemistry mechanism, we develop a novel pretraining framework that enables us to incorporate inductive biases into the model. Our framework achieves state-of-the-art results on challenging downstream tasks. By possessing chemical knowledge, our generative framework overcome the limitations of current molecule generation models that rely on a small number of reaction templates. In the extensive experiments, our model generates synthesizable drug-like structures of high quality. Overall, our work presents a significant step toward a large-scale deep-learning framework for a variety of reaction-based applications.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 55 references that are in the map. First posted on arXiv 13 Mar 2023.
Builds on
17 of 55 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2020Pretrained Transformers Improve Out-of-Distribution Robustnesscited by 293
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 270
- 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
- 2017Predicting Organic Reaction Outcomes with Weisfeiler-Lehman Networkcited by 102
- 2019ChemBO: Bayesian Optimization of Small Organic Molecules with Synthesizable Recommendationscited by 77
- 2020Mapping the Space of Chemical Reactions Using Attention-Based Neural Networkscited by 70
- 2019Dynamic Graph Message Passing Networkscited by 62
5 more
- 2021Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Designcited by 44
- 2019A Model to Search for Synthesizable Moleculescited by 37
- 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
- 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
- 2020Barking up the right tree: an approach to search over molecule synthesis DAGscited by 31
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 2.
4 papers.
- 2024RGFN: Synthesizable Molecular Generation Using GFlowNetscited by 39
- 2025A Conformation-Centric Generative Foundation Model for Linear Polymer Modeling and Designcited by 0
- 2026Representation-Guided Discrete Molecular Graph Retrosynthesiscited by 0
- 2026MEGA-CL: A Molecular Foundation Model for Generalizable ADMET Prediction through Graph External Attention and Contrastive Learningcited by 0
- 2026MEGA-CL: A Molecular Foundation Model for Generalizable ADMET Prediction through Graph External Attention and Contrastive Learning27 Jul 2026
- 2026Representation-Guided Discrete Molecular Graph Retrosynthesis23 May 2026
- 2025A Conformation-Centric Generative Foundation Model for Linear Polymer Modeling and Design15 Oct 2025
- 2024RGFN: Synthesizable Molecular Generation Using GFlowNets1 Jun 2024