Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Models
On the map: LLM alignment / RLHF / preference optimisation → Preference optimization for molecular design
Abstract (arXiv)
Molecular property optimization is central to drug discovery, yet many deep learning methods rely on black-box scoring and offer limited control over scaffold preservation, often producing unstable or biologically implausible edits. While large language models (LLMs) are promising molecular generators, optimization remains constrained by the lack of chemistry-grounded preference supervision and principled data curation. We introduce Scaffold-Conditioned Preference Triplets (SCPT), a pipeline that constructs similarity-constrained triplets langlescaffold, better, worserangle via scaffold alignment and chemistry-driven filters for validity, synthesizability, and meaningful property gains. Using these preferences, we align a pretrained molecular LLM as a conditional editor, enabling property-improving edits that retain the scaffold. Across single- and multi-objective benchmarks, SCPT improves optimization success and property gains while maintaining higher scaffold similarity than competitive baselines. Compared with representative non-LLM molecular optimization methods, SCPT-trained LLMs are better suited to scaffold-constrained and multi-objective optimization. In addition, models trained on single-property and two-property supervision generalize effectively to three-property tasks, indicating promising extrapolative generalization under limited higher-order supervision. SCPT also provides controllable data-construction knobs that yield a predictable similarity-gain frontier, enabling systematic adaptation to diverse optimization regimes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Preference optimization for molecular design, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 24 of its 40 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
24 of 40 references.
References · 24
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 264
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
- 2022Graph neural networks for materials science and chemistrycited by 181
12 more
- 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 151
- 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 124
- 2024ChemLLM: A Chemical Large Language Modelcited by 100
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domainscited by 80
- 2024Efficient Evolutionary Search Over Chemical Space with Large Language Modelscited by 59
- 2021Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphscited by 44
- 2020A Deep Generative Model for Molecule Optimization via One Fragment Modificationcited by 36
- 2024LICO: Large Language Models for In-Context Molecular Optimizationcited by 26
- 2024Training Free Guided Flow Matching with Optimal Controlcited by 23
- 2019Self-Referencing Embedded Strings (SELFIES): A 100% robust molecular string representationcited by 22
- 2024Molecule Generation with Fragment Retrieval Augmentationcited by 22
- 2025GeLLMO: Generalizing Large Language Models for Multi-property Molecule Optimizationcited by 16
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026C-MORAL: Controllable Multi-Objective Molecular Optimization with Reinforcement Alignment for LLMs
- 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Exploration
- 2026One Sequence, Many Decodings: CAGenMol-2 Recasts Drug Design as Masked Molecular Inference
- 2026Training Large Language Models for Small-Molecule Design with Synthetic Task Scaling
- 2025Reasoning-Enhanced Large Language Models for Molecular Property Prediction
- 2026DrugR: Optimizing Molecular Drugs through LLM-based Explicit Reasoning
- 2025Mol-LLM: Multimodal Generalist Molecular LLM with Improved Graph Utilization
- 2024MolecularGPT: Open Large Language Model (LLM) for Few-Shot Molecular Property Prediction