Can Large Language Models Empower Molecular Property Prediction?
Not on the map. Why?
Abstract (arXiv)
Molecular property prediction has gained significant attention due to its transformative potential in multiple scientific disciplines. Conventionally, a molecule graph can be represented either as a graph-structured data or a SMILES text. Recently, the rapid development of Large Language Models (LLMs) has revolutionized the field of NLP. Although it is natural to utilize LLMs to assist in understanding molecules represented by SMILES, the exploration of how LLMs will impact molecular property prediction is still in its early stage. In this work, we advance towards this objective through two perspectives: zero/few-shot molecular classification, and using the new explanations generated by LLMs as representations of molecules. To be specific, we first prompt LLMs to do in-context molecular classification and evaluate their performance. After that, we employ LLMs to generate semantically enriched explanations for the original SMILES and then leverage that to fine-tune a small-scale LM model for multiple downstream tasks. The experimental results highlight the superiority of text explanations as molecular representations across multiple benchmark datasets, and confirm the immense potential of LLMs in molecular property prediction tasks. Codes are available at urlhttps://github.com/ChnQ/LLM4Mol.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 14 Jul 2023.
Builds on
23 of 40 references.
References · 23
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
11 more
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2023Is ChatGPT a Good Recommender? A Preliminary Studycited by 192
- 2023Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspectivecited by 91
- 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
- 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
- 2023MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Predictioncited by 4
Built on by
Citing papers per year: 2023: 9; 2024: 21; 2025: 12; 2026: 1.
43 papers.
Sort:
By area:
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 217
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 84
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
- 2023Compressing LLMs: The Truth is Rarely Pure and Never Simplecited by 59
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Modelscited by 37
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2024ProG: A Graph Prompt Learning Benchmarkcited by 29
- 2024FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skippingcited by 23
- 2025PharmAgents: Building a Virtual Pharma with Large Language Model Agentscited by 20
31 more
- 2023Graph Meets LLMs: Towards Large Graph Modelscited by 19
- 2024LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learningcited by 17
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidationcited by 17
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 16
- 2023GPT-MolBERTa: GPT Molecular Features Language Model for molecular property predictioncited by 13
- 2024Large Language Model Meets Graph Neural Network in Knowledge Distillationcited by 13
- 2024Learning on Graphs with Large Language Models(LLMs): A Deep Dive into Model Robustnesscited by 11
- 2025Synthelite: Chemist-aligned and feasibility-aware synthesis planning with LLMscited by 10
- 2024A Survey on Self-Supervised Graph Foundation Models: Knowledge-Based Perspectivecited by 9
- 2024BatGPT-Chem: A Foundation Large Model For Retrosynthesis Predictioncited by 9
- 202534 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discoverycited by 9
- 2024Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistrycited by 8
- 2025FGBench: A Dataset and Benchmark for Molecular Property Reasoning at Functional Group-Level in Large Language Modelscited by 8
- 2025Towards A Universal Graph Structural Encodercited by 7
- 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Modelscited by 7
- 2024Many-Shot In-Context Learning for Molecular Inverse Designcited by 6
- 2024GUNDAM: Aligning Large Language Models with Graph Understandingcited by 5
- 2025Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstrationcited by 4
- 2024DRAK: Unlocking Molecular Insights with Domain-Specific Retrieval-Augmented Knowledge in LLMscited by 3
- 2024Question Rephrasing for Quantifying Uncertainty in Large Language Models: Applications in Molecular Chemistry Taskscited by 3
- 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphscited by 3
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Modelscited by 2
- 2024Scalable Multi-Task Transfer Learning for Molecular Property Predictioncited by 2
- 2025ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimationcited by 2
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2024Towards Versatile Graph Learning Approach: from the Perspective of Large Language Modelscited by 1
- 2024Microstructures and Accuracy of Graph Recall by Large Language Modelscited by 1
- 2024A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseasescited by 1
- 2025DP-GPL: Differentially Private Graph Prompt Learningcited by 0
- 2025OPENXRD: A Comprehensive Benchmark Framework for LLM/MLLM XRD Question Answeringcited by 0
- 2026Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answeringcited by 0
- 2026Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answering22 Feb 2026
- 2025Synthelite: Chemist-aligned and feasibility-aware synthesis planning with LLMs18 Dec 2025
- 2025Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstration18 Oct 2025
- 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs24 Sep 2025
- 2025FGBench: A Dataset and Benchmark for Molecular Property Reasoning at Functional Group-Level in Large Language Models1 Aug 2025
- 2025OPENXRD: A Comprehensive Benchmark Framework for LLM/MLLM XRD Question Answering12 Jul 2025
- 2025ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimation1 Jun 2025
- 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Models18 May 2025
- 202534 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discovery5 May 2025
- 2025Towards A Universal Graph Structural Encoder15 Apr 2025
- 2025PharmAgents: Building a Virtual Pharma with Large Language Model Agents28 Mar 2025
- 2025DP-GPL: Differentially Private Graph Prompt Learning13 Mar 2025
31 more
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidation11 Mar 2025
- 2024A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases9 Dec 2024
- 2024Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry20 Nov 2024
- 2024Scalable Multi-Task Transfer Learning for Molecular Property Prediction1 Oct 2024
- 2024GUNDAM: Aligning Large Language Models with Graph Understanding30 Sep 2024
- 2024BatGPT-Chem: A Foundation Large Model For Retrosynthesis Prediction19 Aug 2024
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Models19 Aug 2024
- 2024Question Rephrasing for Quantifying Uncertainty in Large Language Models: Applications in Molecular Chemistry Tasks7 Aug 2024
- 2024Many-Shot In-Context Learning for Molecular Inverse Design26 Jul 2024
- 2024Learning on Graphs with Large Language Models(LLMs): A Deep Dive into Model Robustness16 Jul 2024
- 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun 2024
- 2024ProG: A Graph Prompt Learning Benchmark8 Jun 2024
- 2024LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning3 Jun 2024
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)23 Apr 2024
- 2024FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping5 Apr 2024
- 2024A Survey on Self-Supervised Graph Foundation Models: Knowledge-Based Perspective24 Mar 2024
- 2024DRAK: Unlocking Molecular Insights with Domain-Specific Retrieval-Augmented Knowledge in LLMs4 Mar 2024
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey3 Mar 2024
- 2024Microstructures and Accuracy of Graph Recall by Large Language Models19 Feb 2024
- 2024Towards Versatile Graph Learning Approach: from the Perspective of Large Language Models18 Feb 2024
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering12 Feb 2024
- 2024Large Language Model Meets Graph Neural Network in Knowledge Distillation8 Feb 2024
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Research6 Dec 2023
- 2023Large Language Models on Graphs: A Comprehensive Survey5 Dec 2023
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyond28 Nov 2023
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directions21 Nov 2023
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models6 Oct 2023
- 2023Compressing LLMs: The Truth is Rarely Pure and Never Simple2 Oct 2023
- 2023One for All: Towards Training One Graph Model for All Classification Tasks29 Sep 2023
- 2023GPT-MolBERTa: GPT Molecular Features Language Model for molecular property prediction20 Sep 2023
- 2023Graph Meets LLMs: Towards Large Graph Models28 Aug 2023
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Modelscited by 37
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidationcited by 17
- 2025FGBench: A Dataset and Benchmark for Molecular Property Reasoning at Functional Group-Level in Large Language Modelscited by 8
- 2025ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimationcited by 2
- 2026Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answeringcited by 0
- 2026Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answering22 Feb 2026
- 2025FGBench: A Dataset and Benchmark for Molecular Property Reasoning at Functional Group-Level in Large Language Models1 Aug 2025
- 2025ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimation1 Jun 2025
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidation11 Mar 2025
- 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models6 Oct 2023
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 84
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
- 2023Compressing LLMs: The Truth is Rarely Pure and Never Simplecited by 59
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2024ProG: A Graph Prompt Learning Benchmarkcited by 29
- 2023Graph Meets LLMs: Towards Large Graph Modelscited by 19
- 2024LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learningcited by 17
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 16
- 2023GPT-MolBERTa: GPT Molecular Features Language Model for molecular property predictioncited by 13
- 2024Large Language Model Meets Graph Neural Network in Knowledge Distillationcited by 13
12 most cited of 31 All 31 (JSON)
- 2025Synthelite: Chemist-aligned and feasibility-aware synthesis planning with LLMs18 Dec 2025
- 2025Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstration18 Oct 2025
- 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs24 Sep 2025
- 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Models18 May 2025
- 202534 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discovery5 May 2025
- 2025Towards A Universal Graph Structural Encoder15 Apr 2025
- 2025DP-GPL: Differentially Private Graph Prompt Learning13 Mar 2025
- 2024A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases9 Dec 2024
- 2024Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry20 Nov 2024
- 2024Scalable Multi-Task Transfer Learning for Molecular Property Prediction1 Oct 2024
- 2024BatGPT-Chem: A Foundation Large Model For Retrosynthesis Prediction19 Aug 2024
- 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Models19 Aug 2024
12 newest of 31 All 31 (JSON)