Instruction Multi-Constraint Molecular Generation Using a Teacher-Student Large Language Model
Not on the map. Why?
Abstract (arXiv)
While various models and computational tools have been proposed for structure and property analysis of molecules, generating molecules that conform to all desired structures and properties remains a challenge. Here, we introduce a multi-constraint molecular generation large language model, TSMMG, which, akin to a student, incorporates knowledge from various small models and tools, namely, the 'teachers'. To train TSMMG, we construct a large set of text-molecule pairs by extracting molecular knowledge from these 'teachers', enabling it to generate novel molecules that conform to the descriptions through various text prompts. We experimentally show that TSMMG remarkably performs in generating molecules meeting complex, natural language-described property requirements across two-, three-, and four-constraint tasks, with an average molecular validity of over 99% and success ratio of 82.58%, 68.03%, and 67.48%, respectively. The model also exhibits adaptability through zero-shot testing, creating molecules that satisfy combinations of properties that have not been encountered. It can comprehend text inputs with various language styles, extending beyond the confines of outlined prompts, as confirmed through empirical validation. Additionally, the knowledge distillation feature of TSMMG contributes to the continuous enhancement of small models, while the innovative approach to dataset construction effectively addresses the issues of data scarcity and quality, which positions TSMMG as a promising tool in the domains of drug discovery and materials science.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 55 references that are in the map. First posted on arXiv 20 Mar 2024.
Builds on
23 of 55 references.
References · 23
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 264
- 2020MoFlow: An Invertible Flow Model for Generating Molecular Graphscited by 183
- 2022Translation between Molecules and Natural Languagecited by 173
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 165
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2018Multi-Objective De Novo Drug Design with Conditional Graph Generative Modelcited by 101
11 more
- 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 92
- 2023Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspectivecited by 91
- 2023MolXPT: Wrapping Molecules with Text for Generative Pre-trainingcited by 81
- 2020MolTrans: Molecular Interaction Transformer for Drug Target Interaction Predictioncited by 63
- 2020Learning To Navigate The Synthetically Accessible Chemical Space Using Reinforcement Learningcited by 57
- 2023Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Languagecited by 44
- 2022Interpretable bilinear attention network with domain adaptation improves drug-target predictioncited by 39
- 2020Improved Protein-ligand Binding Affinity Prediction with Structure-Based Deep Fusion Inferencecited by 35
- 2019Generative Models for Automatic Chemical Designcited by 23
- 2021MolGrow: A Graph Normalizing Flow for Hierarchical Molecular Generationcited by 22
- 2020Multi-Objective Molecule Generation using Interpretable Substructurescited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.