ReLM: Leveraging Language Models for Enhanced Chemical Reaction Prediction
Not on the map. Why?
Abstract (arXiv)
Predicting chemical reactions, a fundamental challenge in chemistry, involves forecasting the resulting products from a given reaction process. Conventional techniques, notably those employing Graph Neural Networks (GNNs), are often limited by insufficient training data and their inability to utilize textual information, undermining their applicability in real-world applications. In this work, we propose ReLM, a novel framework that leverages the chemical knowledge encoded in language models (LMs) to assist GNNs, thereby enhancing the accuracy of real-world chemical reaction predictions. To further enhance the model's robustness and interpretability, we incorporate the confidence score strategy, enabling the LMs to self-assess the reliability of their predictions. Our experimental results demonstrate that ReLM improves the performance of state-of-the-art GNN-based methods across various chemical reaction datasets, especially in out-of-distribution settings. Codes are available at https://github.com/syr-cn/ReLM.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 20 Oct 2023.
Builds on
15 of 28 references.
References · 15
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2021An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQAcited by 301
- 2017Topology Adaptive Graph Convolutional Networkscited by 113
- 2020Retrosynthesis Prediction with Conditional Graph Logic Networkcited by 104
- 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 94
3 more
Built on by
Citing papers per year: 2023: 2; 2024: 14; 2025: 7; 2026: 1.
24 papers.
Sort:
By area:
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 85
- 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 66
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2024ProtT3: Protein-to-Text Generation for Text-based Protein Understandingcited by 25
- 2024MolTC: Towards Molecular Relational Modeling In Language Modelscited by 22
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensationcited by 20
- 2025Benchmarking Retrieval-Augmented Generation for Chemistrycited by 20
- 2024ReactXT: Understanding Molecular "Reaction-ship" via Reaction-Contextualized Molecule-Text Pretrainingcited by 19
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 17
- 2025NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generationcited by 17
- 2024Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generationcited by 16
12 more
- 2024ChemDFM-X: Towards Large Multimodal Model for Chemistrycited by 16
- 2024GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaborationcited by 12
- 2024Regression with Large Language Models for Materials and Molecular Property Predictioncited by 11
- 2024Advancing Molecular Graph-Text Pre-training via Fine-grained Alignmentcited by 9
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applicationscited by 6
- 2024Bridging Text and Molecule: A Survey on Multimodal Frameworks for Moleculecited by 4
- 2024Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Modelscited by 3
- 2025Reforge: Low-Latency Distributed GNN Serving with Selective Embedding Recomputationcited by 2
- 2025ChemAmp: Amplified Chemistry Tools via Composable Agentscited by 1
- 2025SpecMol: A Spectroscopy-Grounded Foundation Model for Multi-Task Molecular Learningcited by 1
- 2025NOCL: Node-Oriented Conceptualization LLM for Graph Tasks without Message Passingcited by 0
- 2026Rethinking Message Passing as Retrieval for Text-Attributed Graph Learningcited by 0
- 2026Rethinking Message Passing as Retrieval for Text-Attributed Graph Learning27 Aug 2026
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applications24 Oct 2025
- 2025SpecMol: A Spectroscopy-Grounded Foundation Model for Multi-Task Molecular Learning26 Sep 2025
- 2025NOCL: Node-Oriented Conceptualization LLM for Graph Tasks without Message Passing28 May 2025
- 2025ChemAmp: Amplified Chemistry Tools via Composable Agents27 May 2025
- 2025Benchmarking Retrieval-Augmented Generation for Chemistry12 May 2025
- 2025NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation18 Feb 2025
- 2025Reforge: Low-Latency Distributed GNN Serving with Selective Embedding Recomputation15 Jan 2025
- 2024GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration23 Oct 2024
- 2024Advancing Molecular Graph-Text Pre-training via Fine-grained Alignment21 Sep 2024
- 2024ChemDFM-X: Towards Large Multimodal Model for Chemistry20 Sep 2024
- 2024Regression with Large Language Models for Materials and Molecular Property Prediction9 Sep 2024
12 more
- 2024Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generation3 Jun 2024
- 2024Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Models29 May 2024
- 2024ReactXT: Understanding Molecular "Reaction-ship" via Reaction-Contextualized Molecule-Text Pretraining23 May 2024
- 2024ProtT3: Protein-to-Text Generation for Text-based Protein Understanding21 May 2024
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)23 Apr 2024
- 2024Bridging Text and Molecule: A Survey on Multimodal Frameworks for Molecule7 Mar 2024
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey3 Mar 2024
- 2024MolTC: Towards Molecular Relational Modeling In Language Models6 Feb 2024
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensation5 Feb 2024
- 2024Towards 3D Molecule-Text Interpretation in Language Models25 Jan 2024
- 2023Large Language Models on Graphs: A Comprehensive Survey5 Dec 2023
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directions21 Nov 2023
- 2025Benchmarking Retrieval-Augmented Generation for Chemistrycited by 20
- 2025Benchmarking Retrieval-Augmented Generation for Chemistry12 May 2025
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 85
- 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 66
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2024ProtT3: Protein-to-Text Generation for Text-based Protein Understandingcited by 25
- 2024MolTC: Towards Molecular Relational Modeling In Language Modelscited by 22
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensationcited by 20
- 2024ReactXT: Understanding Molecular "Reaction-ship" via Reaction-Contextualized Molecule-Text Pretrainingcited by 19
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 17
- 2024Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generationcited by 16
- 2024ChemDFM-X: Towards Large Multimodal Model for Chemistrycited by 16
- 2024Regression with Large Language Models for Materials and Molecular Property Predictioncited by 11
12 most cited of 19 All 19 (JSON)
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applications24 Oct 2025
- 2025SpecMol: A Spectroscopy-Grounded Foundation Model for Multi-Task Molecular Learning26 Sep 2025
- 2025NOCL: Node-Oriented Conceptualization LLM for Graph Tasks without Message Passing28 May 2025
- 2025Reforge: Low-Latency Distributed GNN Serving with Selective Embedding Recomputation15 Jan 2025
- 2024Advancing Molecular Graph-Text Pre-training via Fine-grained Alignment21 Sep 2024
- 2024ChemDFM-X: Towards Large Multimodal Model for Chemistry20 Sep 2024
- 2024Regression with Large Language Models for Materials and Molecular Property Prediction9 Sep 2024
- 2024Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generation3 Jun 2024
- 2024Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Models29 May 2024
- 2024ReactXT: Understanding Molecular "Reaction-ship" via Reaction-Contextualized Molecule-Text Pretraining23 May 2024
- 2024ProtT3: Protein-to-Text Generation for Text-based Protein Understanding21 May 2024
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)23 Apr 2024
12 newest of 19 All 19 (JSON)