mlsanityData to 14 Oct 2026

SynLlama: Generating Synthesizable Molecules and Their Analogs with Large Language Models

arXiv 2503.12602 ↗First posted 16 Mar 2025cs.LG physics.bio-phcited by 9

Not on the map. Why?

Abstract (arXiv)

Generative machine learning models for exploring chemical space have shown immense promise, but many molecules they generate are too difficult to synthesize, making them impractical for further investigation or development. In this work, we present a novel approach by fine-tuning Meta's Llama3 Large Language Models (LLMs) to create SynLlama, which generates full synthetic pathways made of commonly accessible building blocks and robust organic reaction templates. SynLlama explores a large synthesizable space using significantly less data, and offers strong performance in both forward and bottom-up synthesis planning compared to other state-of-the-art methods. We find that SynLlama, even without training on external building blocks, can effectively generalize to unseen yet purchasable building blocks, meaning that its reconstruction capabilities extend to a broader synthesizable chemical space than the training data. We also demonstrate the use of SynLlama in a pharmaceutical context for synthesis planning of analog molecules and hit expansion leads for proposed inhibitors of target proteins, offering medicinal chemists a valuable tool for discovery.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 121 references that are in the map. First posted on arXiv 16 Mar 2025.

Builds on

25 of 121 references.

References · 25

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  5. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  6. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
  7. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
  8. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
  9. 2022Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pocketscited by 183
  10. 20233D Equivariant Diffusion for Target-Aware Molecule Generation and Affinity Predictioncited by 177
  11. 2022A 3D Generative Model for Structure-Based Drug Designcited by 149
  12. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
13 more
  1. 2020The Synthesizability of Molecules Proposed by Generative Modelscited by 68
  2. 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
  3. 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
  4. 2023OpenMM 8: Molecular Dynamics Simulation with Machine Learning Potentialscited by 47
  5. 2021Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Designcited by 44
  6. 2022LIMO: Latent Inceptionism for Targeted Molecule Generationcited by 40
  7. 2020A Deep Generative Model for Molecule Optimization via One Fragment Modificationcited by 37
  8. 2024SynFlowNet: Design of Diverse and Novel Molecules with Synthesis Constraintscited by 26
  9. 2020A Deep Generative Model for Fragment-Based Molecule Generationcited by 24
  10. 2024Generative Flows on Synthetic Pathway for Drug Designcited by 20
  11. 2024Projecting Molecules into Synthesizable Chemical Spacescited by 17
  12. 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Explorationcited by 14
  13. 2019Optimal measurement network of pairwise differencescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 4.

9 papers.