Chemical-Reaction-Aware Molecule Representation Learning
Not on the map. Why?
Abstract (arXiv)
Molecule representation learning (MRL) methods aim to embed molecules into a real vector space. However, existing SMILES-based (Simplified Molecular-Input Line-Entry System) or GNN-based (Graph Neural Networks) MRL methods either take SMILES strings as input that have difficulty in encoding molecule structure information, or over-emphasize the importance of GNN architectures but neglect their generalization ability. Here we propose using chemical reactions to assist learning molecule representation. The key idea of our approach is to preserve the equivalence of molecules with respect to chemical reactions in the embedding space, i.e., forcing the sum of reactant embeddings and the sum of product embeddings to be equal for each chemical equation. This constraint is proven effective to 1) keep the embedding space well-organized and 2) improve the generalization ability of molecule embeddings. Moreover, our model can use any GNN as the molecule encoder and is thus agnostic to GNN architectures. Experimental results demonstrate that our method achieves state-of-the-art performance in a variety of downstream tasks, e.g., 17.4% absolute Hit@1 gain in chemical reaction prediction, 2.3% absolute AUC gain in molecule property prediction, and 18.5% relative RMSE gain in graph-edit-distance prediction, respectively, over the best baseline method. The code is available at https://github.com/hwwang55/MolR.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 21 Sep 2021.
Builds on
29 of 57 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
17 more
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
- 2020A Survey on Contrastive Self-supervised Learningcited by 553
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
- 2015Order Matters: Sequence to sequence for setscited by 236
- 2017Learning to Plan Chemical Synthesescited by 175
- 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
- 2017Topology Adaptive Graph Convolutional Networkscited by 112
- 2014word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding methodcited by 109
- 2017Predicting Organic Reaction Outcomes with Weisfeiler-Lehman Networkcited by 102
- 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 91
- 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
- 2020Mapping the Space of Chemical Reactions Using Attention-Based Neural Networkscited by 70
- 2017"Found in Translation": Predicting Outcomes of Complex Organic Chemistry Reactions using Neural Sequence-to-Sequence Modelscited by 54
- 2019Self-Attention Based Molecule Representation for Predicting Drug-Target Interactioncited by 22
- 2021A generative model for molecule generation based on chemical reaction treescited by 6
Built on by
Citing papers per year: 2022: 6; 2023: 11; 2024: 9; 2025: 8; 2026: 2.
36 papers.
Sort:
By area:
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 179
- 2022Translation between Molecules and Natural Languagecited by 173
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
- 2022DrugOOD: Out-of-Distribution (OOD) Dataset Curator and Benchmark for AI-aided Drug Discovery -- A Focus on Affinity Prediction Problems with Noise Annotationscited by 54
- 2022Graph-based Molecular Representation Learningcited by 51
- 2023Can Large Language Models Empower Molecular Property Prediction?cited by 43
- 2023ReLM: Leveraging Language Models for Enhanced Chemical Reaction Predictioncited by 24
- 2022BARTSmiles: Generative Masked Language Models for Molecular Representationscited by 18
- 2023Shift-Robust Molecular Relational Learning with Causal Substructurecited by 15
- 2025Benchmarking Pretrained Molecular Embedding Models For Molecular Representation Learningcited by 15
- 2025mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Moleculescited by 8
24 more
- 2023ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervisioncited by 7
- 2024When is an Embedding Model More Promising than Another?cited by 7
- 2023Bi-level Contrastive Learning for Knowledge-Enhanced Molecule Representationscited by 6
- 2022Pre-training Transformers for Molecular Property Prediction Using Reaction Predictioncited by 5
- 2024MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extensioncited by 5
- 2023Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Modelcited by 4
- 2023MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Predictioncited by 4
- 2023Atom-Motif Contrastive Transformer for Molecular Property Predictioncited by 4
- 2025Membership Inference Risks in Quantized Models: A Theoretical and Empirical Studycited by 3
- 2023MolCAP: Molecular Chemical reActivity pretraining and prompted-finetuning enhanced molecular representation learningcited by 2
- 2024GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learningcited by 2
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Modelscited by 2
- 2024FARM: Enhancing Molecular Representations with Functional Group Awarenesscited by 2
- 2025Learning Task-Agnostic Representations through Multi-Teacher Distillationcited by 2
- 2026Graph-GRPO: Training Graph Flow Models with Reinforcement Learningcited by 2
- 2024Graph Multi-Similarity Learning for Molecular Property Predictioncited by 1
- 2024Contextual Molecule Representation Learning from Chemical Reaction Knowledgecited by 1
- 2025ChemAmp: Amplified Chemistry Tools via Composable Agentscited by 1
- 2025MolPILE -- large-scale, diverse dataset for molecular representation learningcited by 1
- 2024A Strong Baseline for Molecular Few-Shot Learningcited by 0
- 2024MoleculeCLA: Rethinking Molecular Benchmark via Computational Ligand-Target Binding Analysiscited by 0
- 2025Topological Feature Compression for Molecular Graph Neural Networkscited by 0
- 2025Flow-Based Fragment Identification via Binding Site-Specific Latent Representationscited by 0
- 2026RetroMPA: A Molecular Property-Aware Auxiliary Framework for Enhancing Retrosynthesis Predictioncited by 0
- 2026RetroMPA: A Molecular Property-Aware Auxiliary Framework for Enhancing Retrosynthesis Prediction17 Aug 2026
- 2026Graph-GRPO: Training Graph Flow Models with Reinforcement Learning11 Mar 2026
- 2025Learning Task-Agnostic Representations through Multi-Teacher Distillation21 Oct 2025
- 2025MolPILE -- large-scale, diverse dataset for molecular representation learning22 Sep 2025
- 2025Flow-Based Fragment Identification via Binding Site-Specific Latent Representations16 Sep 2025
- 2025Topological Feature Compression for Molecular Graph Neural Networks11 Aug 2025
- 2025Benchmarking Pretrained Molecular Embedding Models For Molecular Representation Learning8 Aug 2025
- 2025ChemAmp: Amplified Chemistry Tools via Composable Agents27 May 2025
- 2025mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Molecules18 May 2025
- 2025Membership Inference Risks in Quantized Models: A Theoretical and Empirical Study10 Feb 2025
- 2024FARM: Enhancing Molecular Representations with Functional Group Awareness2 Oct 2024
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Models19 Aug 2024
24 more
- 2024GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learning31 Jul 2024
- 2024MoleculeCLA: Rethinking Molecular Benchmark via Computational Ligand-Target Binding Analysis13 Jun 2024
- 2024When is an Embedding Model More Promising than Another?11 Jun 2024
- 2024MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extension10 Jun 2024
- 2024A Strong Baseline for Molecular Few-Shot Learning2 Apr 2024
- 2024Contextual Molecule Representation Learning from Chemical Reaction Knowledge21 Feb 2024
- 2024Graph Multi-Similarity Learning for Molecular Property Prediction31 Jan 2024
- 2023Large Language Models on Graphs: A Comprehensive Survey5 Dec 2023
- 2023ReLM: Leveraging Language Models for Enhanced Chemical Reaction Prediction20 Oct 2023
- 2023Atom-Motif Contrastive Transformer for Molecular Property Prediction11 Oct 2023
- 2023Can Large Language Models Empower Molecular Property Prediction?14 Jul 2023
- 2023ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervision4 Jul 2023
- 2023MolCAP: Molecular Chemical reActivity pretraining and prompted-finetuning enhanced molecular representation learning13 Jun 2023
- 2023Bi-level Contrastive Learning for Knowledge-Enhanced Molecule Representations2 Jun 2023
- 2023Shift-Robust Molecular Relational Learning with Causal Substructure29 May 2023
- 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks27 May 2023
- 2023MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Prediction3 May 2023
- 2023Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Model13 Mar 2023
- 2022BARTSmiles: Generative Masked Language Models for Molecular Representations29 Nov 2022
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language12 Sep 2022
- 2022Graph-based Molecular Representation Learning8 Jul 2022
- 2022Pre-training Transformers for Molecular Property Prediction Using Reaction Prediction6 Jul 2022
- 2022Translation between Molecules and Natural Language25 Apr 2022
- 2022DrugOOD: Out-of-Distribution (OOD) Dataset Curator and Benchmark for AI-aided Drug Discovery -- A Focus on Affinity Prediction Problems with Noise Annotations24 Jan 2022
- 2025ChemAmp: Amplified Chemistry Tools via Composable Agentscited by 1
- 2025ChemAmp: Amplified Chemistry Tools via Composable Agents27 May 2025
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 179
- 2022Translation between Molecules and Natural Languagecited by 173
- 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
- 2022DrugOOD: Out-of-Distribution (OOD) Dataset Curator and Benchmark for AI-aided Drug Discovery -- A Focus on Affinity Prediction Problems with Noise Annotationscited by 54
- 2022Graph-based Molecular Representation Learningcited by 51
- 2023Can Large Language Models Empower Molecular Property Prediction?cited by 43
- 2023ReLM: Leveraging Language Models for Enhanced Chemical Reaction Predictioncited by 24
- 2022BARTSmiles: Generative Masked Language Models for Molecular Representationscited by 18
- 2023Shift-Robust Molecular Relational Learning with Causal Substructurecited by 15
- 2025Benchmarking Pretrained Molecular Embedding Models For Molecular Representation Learningcited by 15
- 2025mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Moleculescited by 8
12 most cited of 33 All 33 (JSON)
- 2026RetroMPA: A Molecular Property-Aware Auxiliary Framework for Enhancing Retrosynthesis Prediction17 Aug 2026
- 2025Learning Task-Agnostic Representations through Multi-Teacher Distillation21 Oct 2025
- 2025MolPILE -- large-scale, diverse dataset for molecular representation learning22 Sep 2025
- 2025Flow-Based Fragment Identification via Binding Site-Specific Latent Representations16 Sep 2025
- 2025Topological Feature Compression for Molecular Graph Neural Networks11 Aug 2025
- 2025Benchmarking Pretrained Molecular Embedding Models For Molecular Representation Learning8 Aug 2025
- 2025mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Molecules18 May 2025
- 2024FARM: Enhancing Molecular Representations with Functional Group Awareness2 Oct 2024
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Models19 Aug 2024
- 2024GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learning31 Jul 2024
- 2024MoleculeCLA: Rethinking Molecular Benchmark via Computational Ligand-Target Binding Analysis13 Jun 2024
- 2024When is an Embedding Model More Promising than Another?11 Jun 2024
12 newest of 33 All 33 (JSON)