mlsanityData to 7 Oct 2026

Chemical-Reaction-Aware Molecule Representation Learning

arXiv 2109.09888 ↗First posted 21 Sep 2021cs.LG physics.chem-ph q-bio.QMcited by 36

Not on the map. Why?

Abstract (arXiv)

Molecule representation learning (MRL) methods aim to embed molecules into a real vector space. However, existing SMILES-based (Simplified Molecular-Input Line-Entry System) or GNN-based (Graph Neural Networks) MRL methods either take SMILES strings as input that have difficulty in encoding molecule structure information, or over-emphasize the importance of GNN architectures but neglect their generalization ability. Here we propose using chemical reactions to assist learning molecule representation. The key idea of our approach is to preserve the equivalence of molecules with respect to chemical reactions in the embedding space, i.e., forcing the sum of reactant embeddings and the sum of product embeddings to be equal for each chemical equation. This constraint is proven effective to 1) keep the embedding space well-organized and 2) improve the generalization ability of molecule embeddings. Moreover, our model can use any GNN as the molecule encoder and is thus agnostic to GNN architectures. Experimental results demonstrate that our method achieves state-of-the-art performance in a variety of downstream tasks, e.g., 17.4% absolute Hit@1 gain in chemical reaction prediction, 2.3% absolute AUC gain in molecule property prediction, and 18.5% relative RMSE gain in graph-edit-distance prediction, respectively, over the best baseline method. The code is available at https://github.com/hwwang55/MolR.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 21 Sep 2021.

Builds on

29 of 57 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  6. 2017Graph Attention Networkscited by 8,854
  7. 2017Inductive Representation Learning on Large Graphscited by 6,284
  8. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  9. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  10. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  11. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  12. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
17 more
  1. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
  2. 2020A Survey on Contrastive Self-supervised Learningcited by 553
  3. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
  4. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  5. 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
  6. 2015Order Matters: Sequence to sequence for setscited by 236
  7. 2017Learning to Plan Chemical Synthesescited by 175
  8. 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
  9. 2017Topology Adaptive Graph Convolutional Networkscited by 112
  10. 2014word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding methodcited by 109
  11. 2017Predicting Organic Reaction Outcomes with Weisfeiler-Lehman Networkcited by 102
  12. 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 91
  13. 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
  14. 2020Mapping the Space of Chemical Reactions Using Attention-Based Neural Networkscited by 70
  15. 2017"Found in Translation": Predicting Outcomes of Complex Organic Chemistry Reactions using Neural Sequence-to-Sequence Modelscited by 54
  16. 2019Self-Attention Based Molecule Representation for Predicting Drug-Target Interactioncited by 22
  17. 2021A generative model for molecule generation based on chemical reaction treescited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 11; 2024: 9; 2025: 8; 2026: 2.

36 papers.

Sort:

By area:

  1. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
  2. 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 179
  3. 2022Translation between Molecules and Natural Languagecited by 173
  4. 2022A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Languagecited by 129
  5. 2022DrugOOD: Out-of-Distribution (OOD) Dataset Curator and Benchmark for AI-aided Drug Discovery -- A Focus on Affinity Prediction Problems with Noise Annotationscited by 54
  6. 2022Graph-based Molecular Representation Learningcited by 51
  7. 2023Can Large Language Models Empower Molecular Property Prediction?cited by 43
  8. 2023ReLM: Leveraging Language Models for Enhanced Chemical Reaction Predictioncited by 24
  9. 2022BARTSmiles: Generative Masked Language Models for Molecular Representationscited by 18
  10. 2023Shift-Robust Molecular Relational Learning with Causal Substructurecited by 15
  11. 2025Benchmarking Pretrained Molecular Embedding Models For Molecular Representation Learningcited by 15
  12. 2025mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Moleculescited by 8
24 more
  1. 2023ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervisioncited by 7
  2. 2024When is an Embedding Model More Promising than Another?cited by 7
  3. 2023Bi-level Contrastive Learning for Knowledge-Enhanced Molecule Representationscited by 6
  4. 2022Pre-training Transformers for Molecular Property Prediction Using Reaction Predictioncited by 5
  5. 2024MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extensioncited by 5
  6. 2023Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Modelcited by 4
  7. 2023MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Predictioncited by 4
  8. 2023Atom-Motif Contrastive Transformer for Molecular Property Predictioncited by 4
  9. 2025Membership Inference Risks in Quantized Models: A Theoretical and Empirical Studycited by 3
  10. 2023MolCAP: Molecular Chemical reActivity pretraining and prompted-finetuning enhanced molecular representation learningcited by 2
  11. 2024GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learningcited by 2
  12. 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Modelscited by 2
  13. 2024FARM: Enhancing Molecular Representations with Functional Group Awarenesscited by 2
  14. 2025Learning Task-Agnostic Representations through Multi-Teacher Distillationcited by 2
  15. 2026Graph-GRPO: Training Graph Flow Models with Reinforcement Learningcited by 2
  16. 2024Graph Multi-Similarity Learning for Molecular Property Predictioncited by 1
  17. 2024Contextual Molecule Representation Learning from Chemical Reaction Knowledgecited by 1
  18. 2025ChemAmp: Amplified Chemistry Tools via Composable Agentscited by 1
  19. 2025MolPILE -- large-scale, diverse dataset for molecular representation learningcited by 1
  20. 2024A Strong Baseline for Molecular Few-Shot Learningcited by 0
  21. 2024MoleculeCLA: Rethinking Molecular Benchmark via Computational Ligand-Target Binding Analysiscited by 0
  22. 2025Topological Feature Compression for Molecular Graph Neural Networkscited by 0
  23. 2025Flow-Based Fragment Identification via Binding Site-Specific Latent Representationscited by 0
  24. 2026RetroMPA: A Molecular Property-Aware Auxiliary Framework for Enhancing Retrosynthesis Predictioncited by 0