mlsanityData to 7 Oct 2026

Can Large Language Models Empower Molecular Property Prediction?

arXiv 2307.07443 ↗First posted 14 Jul 2023cs.LG cs.AI q-bio.QMcited by 43

Not on the map. Why?

Abstract (arXiv)

Molecular property prediction has gained significant attention due to its transformative potential in multiple scientific disciplines. Conventionally, a molecule graph can be represented either as a graph-structured data or a SMILES text. Recently, the rapid development of Large Language Models (LLMs) has revolutionized the field of NLP. Although it is natural to utilize LLMs to assist in understanding molecules represented by SMILES, the exploration of how LLMs will impact molecular property prediction is still in its early stage. In this work, we advance towards this objective through two perspectives: zero/few-shot molecular classification, and using the new explanations generated by LLMs as representations of molecules. To be specific, we first prompt LLMs to do in-context molecular classification and evaluate their performance. After that, we employ LLMs to generate semantically enriched explanations for the original SMILES and then leverage that to fine-tune a small-scale LM model for multiple downstream tasks. The experimental results highlight the superiority of text explanations as molecular representations across multiple benchmark datasets, and confirm the immense potential of LLMs in molecular property prediction tasks. Codes are available at urlhttps://github.com/ChnQ/LLM4Mol.

Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 14 Jul 2023.

Builds on

23 of 40 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2023A Survey of Large Language Modelscited by 2,537
  7. 2022Emergent Abilities of Large Language Modelscited by 2,483
  8. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  9. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  10. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  11. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  12. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
11 more
  1. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  2. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  3. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
  4. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
  5. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  6. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  7. 2023Is ChatGPT a Good Recommender? A Preliminary Studycited by 192
  8. 2023Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspectivecited by 91
  9. 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
  10. 2021Chemical-Reaction-Aware Molecule Representation Learningcited by 36
  11. 2023MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Predictioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 21; 2025: 12; 2026: 1.

43 papers.

Sort:

By area:

  1. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  2. 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 217
  3. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
  4. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
  5. 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 84
  6. 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
  7. 2023Compressing LLMs: The Truth is Rarely Pure and Never Simplecited by 59
  8. 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Modelscited by 37
  9. 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
  10. 2024ProG: A Graph Prompt Learning Benchmarkcited by 29
  11. 2024FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skippingcited by 23
  12. 2025PharmAgents: Building a Virtual Pharma with Large Language Model Agentscited by 20
31 more
  1. 2023Graph Meets LLMs: Towards Large Graph Modelscited by 19
  2. 2024LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learningcited by 17
  3. 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidationcited by 17
  4. 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 16
  5. 2023GPT-MolBERTa: GPT Molecular Features Language Model for molecular property predictioncited by 13
  6. 2024Large Language Model Meets Graph Neural Network in Knowledge Distillationcited by 13
  7. 2024Learning on Graphs with Large Language Models(LLMs): A Deep Dive into Model Robustnesscited by 11
  8. 2025Synthelite: Chemist-aligned and feasibility-aware synthesis planning with LLMscited by 10
  9. 2024A Survey on Self-Supervised Graph Foundation Models: Knowledge-Based Perspectivecited by 9
  10. 2024BatGPT-Chem: A Foundation Large Model For Retrosynthesis Predictioncited by 9
  11. 202534 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discoverycited by 9
  12. 2024Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistrycited by 8
  13. 2025FGBench: A Dataset and Benchmark for Molecular Property Reasoning at Functional Group-Level in Large Language Modelscited by 8
  14. 2025Towards A Universal Graph Structural Encodercited by 7
  15. 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Modelscited by 7
  16. 2024Many-Shot In-Context Learning for Molecular Inverse Designcited by 6
  17. 2024GUNDAM: Aligning Large Language Models with Graph Understandingcited by 5
  18. 2025Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstrationcited by 4
  19. 2024DRAK: Unlocking Molecular Insights with Domain-Specific Retrieval-Augmented Knowledge in LLMscited by 3
  20. 2024Question Rephrasing for Quantifying Uncertainty in Large Language Models: Applications in Molecular Chemistry Taskscited by 3
  21. 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphscited by 3
  22. 2024Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Modelscited by 2
  23. 2024Scalable Multi-Task Transfer Learning for Molecular Property Predictioncited by 2
  24. 2025ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimationcited by 2
  25. 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
  26. 2024Towards Versatile Graph Learning Approach: from the Perspective of Large Language Modelscited by 1
  27. 2024Microstructures and Accuracy of Graph Recall by Large Language Modelscited by 1
  28. 2024A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseasescited by 1
  29. 2025DP-GPL: Differentially Private Graph Prompt Learningcited by 0
  30. 2025OPENXRD: A Comprehensive Benchmark Framework for LLM/MLLM XRD Question Answeringcited by 0
  31. 2026Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answeringcited by 0