SynLlama: Generating Synthesizable Molecules and Their Analogs with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Generative machine learning models for exploring chemical space have shown immense promise, but many molecules they generate are too difficult to synthesize, making them impractical for further investigation or development. In this work, we present a novel approach by fine-tuning Meta's Llama3 Large Language Models (LLMs) to create SynLlama, which generates full synthetic pathways made of commonly accessible building blocks and robust organic reaction templates. SynLlama explores a large synthesizable space using significantly less data, and offers strong performance in both forward and bottom-up synthesis planning compared to other state-of-the-art methods. We find that SynLlama, even without training on external building blocks, can effectively generalize to unseen yet purchasable building blocks, meaning that its reconstruction capabilities extend to a broader synthesizable chemical space than the training data. We also demonstrate the use of SynLlama in a pharmaceutical context for synthesis planning of analog molecules and hit expansion leads for proposed inhibitors of target proteins, offering medicinal chemists a valuable tool for discovery.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 121 references that are in the map. First posted on arXiv 16 Mar 2025.
Builds on
25 of 121 references.
References · 25
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
- 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
- 2022Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pocketscited by 183
- 20233D Equivariant Diffusion for Target-Aware Molecule Generation and Affinity Predictioncited by 177
- 2022A 3D Generative Model for Structure-Based Drug Designcited by 149
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
13 more
- 2020The Synthesizability of Molecules Proposed by Generative Modelscited by 68
- 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
- 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
- 2023OpenMM 8: Molecular Dynamics Simulation with Machine Learning Potentialscited by 47
- 2021Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Designcited by 44
- 2022LIMO: Latent Inceptionism for Targeted Molecule Generationcited by 40
- 2020A Deep Generative Model for Molecule Optimization via One Fragment Modificationcited by 37
- 2024SynFlowNet: Design of Diverse and Novel Molecules with Synthesis Constraintscited by 26
- 2020A Deep Generative Model for Fragment-Based Molecule Generationcited by 24
- 2024Generative Flows on Synthetic Pathway for Drug Designcited by 20
- 2024Projecting Molecules into Synthesizable Chemical Spacescited by 17
- 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Explorationcited by 14
- 2019Optimal measurement network of pairwise differencescited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 4.
9 papers.
- 2025A Genetic Algorithm for Navigating Synthesizable Molecular Spacescited by 4
- 2025Procrustean Bed for AI-Driven Retrosynthesis: A Unified Framework for Reproducible Evaluationcited by 4
- 2025Efficient and Programmable Exploration of Synthesizable Chemical Spacecited by 3
- 2025Toward Closed-loop Molecular Discovery via Language Model, Property Alignment and Strategic Searchcited by 3
- 2026Towards Diverse Scientific Hypothesis Search with Large Language Modelscited by 3
- 2026LLM-Guided Dynamic Action Spaces for Synthesizable Molecular Optimizationcited by 2
- 2025SynCraft: Guiding Large Language Models to Predict Edit Sequences for Molecular Synthesizability Optimizationcited by 1
- 2026Project Ariadne: Prompt-Conditioned Route Generation for Synthesis Planningcited by 1
- 2026DrugPlayGround: Benchmarking Large Language Models and Embeddings for Drug Discoverycited by 0
- 2026Project Ariadne: Prompt-Conditioned Route Generation for Synthesis Planning23 Jun 2026
- 2026Towards Diverse Scientific Hypothesis Search with Large Language Models9 Jun 2026
- 2026LLM-Guided Dynamic Action Spaces for Synthesizable Molecular Optimization9 Apr 2026
- 2026DrugPlayGround: Benchmarking Large Language Models and Embeddings for Drug Discovery11 Feb 2026
- 2025SynCraft: Guiding Large Language Models to Predict Edit Sequences for Molecular Synthesizability Optimization23 Dec 2025
- 2025Toward Closed-loop Molecular Discovery via Language Model, Property Alignment and Strategic Search10 Dec 2025
- 2025Procrustean Bed for AI-Driven Retrosynthesis: A Unified Framework for Reproducible Evaluation8 Dec 2025
- 2025Efficient and Programmable Exploration of Synthesizable Chemical Space29 Nov 2025
- 2025A Genetic Algorithm for Navigating Synthesizable Molecular Spaces25 Sep 2025