Molecular De Novo Design through Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
This work introduces a method to tune a sequence-based generative model for molecular de novo design that through augmented episodic likelihood can learn to generate structures with certain specified desirable properties. We demonstrate how this model can execute a range of tasks such as generating analogues to a query structure and generating compounds predicted to be active against a biological target. As a proof of principle, the model is first trained to generate molecules that do not contain sulphur. As a second example, the model is trained to generate analogues to the drug Celecoxib, a technique that could be used for scaffold hopping or library expansion starting from a single molecule. Finally, when tuning the model towards generating compounds predicted to be active against the dopamine receptor type 2, the model generates structures of which more than 95% are predicted to be active, including experimentally confirmed actives that have not been included in either the generative model nor the activity prediction model.
Key facts. Cited by 264 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 33; 2022: 39; 2023: 34; 2024: 55; 2025: 48; 2026: 54.
264 papers.
Sort:
By area:
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
- 2022Translation between Molecules and Natural Languagecited by 173
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2023Generative Diffusion Models on Graphs: Methods and Applicationscited by 79
- 2022Local Latent Space Bayesian Optimization over Structured Inputscited by 78
- 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2024Efficient Evolutionary Search Over Chemical Space with Large Language Modelscited by 59
- 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 57
38 more
- 2025GenMol: A Drug Discovery Generalist with Discrete Diffusioncited by 47
- 2022Reinforced Genetic Algorithm for Structure-based Drug Designcited by 46
- 2021Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spacescited by 45
- 2022Retrieval-based Controllable Molecule Generationcited by 44
- 2023Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Languagecited by 44
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 43
- 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 42
- 2022LIMO: Latent Inceptionism for Targeted Molecule Generationcited by 40
- 2024RGFN: Synthesizable Molecular Generation Using GFlowNetscited by 39
- 2021Learning to design drug-like molecules in three-dimensional space using deep generative modelscited by 37
- 2024Genetic-guided GFlowNets for Sample Efficient Molecular Optimizationcited by 36
- 2021DOCKSTRING: easy molecular docking yields better benchmarks for ligand designcited by 33
- 2021JANUS: Parallel Tempered Genetic Algorithm Guided by Deep Neural Networks for Inverse Molecular Designcited by 31
- 2022Computer-Aided Multi-Objective Optimization in Small Molecule Discoverycited by 31
- 2025KL-Regularized Reinforcement Learning is Designed to Mode Collapsecited by 29
- 2021Artificial Intelligence in Drug Discovery: Applications and Techniquescited by 28
- 2021How Much Space Has Been Explored? Measuring the Chemical Space Covered by Databases and Machine-Generated Moleculescited by 27
- 2024DecompOpt: Controllable and Decomposed Diffusion Models for Structure-based Molecular Optimizationcited by 27
- 2022Data-Efficient Graph Grammar Learning for Molecular Generationcited by 26
- 2024SynFlowNet: Design of Diverse and Novel Molecules with Synthesis Constraintscited by 26
- 2024LICO: Large Language Models for In-Context Molecular Optimizationcited by 26
- 2021Off-Policy Reinforcement Learning with Delayed Rewardscited by 25
- 2022Bidirectional Generation of Structure and Properties Through a Single Molecular Foundation Modelcited by 25
- 2024Large Language Models in Drug Discovery and Development: From Disease Mechanisms to Clinical Trialscited by 24
- 2022Learning to Predict Graphs with Fused Gromov-Wasserstein Barycenterscited by 22
- 2024Molecule Generation with Fragment Retrieval Augmentationcited by 22
- 2022Graph Neural Networks for Moleculescited by 21
- 2021Generative Chemical Transformer: Neural Machine Learning of Molecular Geometric Structures from Chemical Language via Attentioncited by 20
- 2022Equivariant Shape-Conditioned Generation of 3D Molecules for Ligand-Based Drug Designcited by 19
- 2023Drug Discovery with Dynamic Goal-aware Fragmentscited by 19
- 2023De novo Drug Design using Reinforcement Learning with Multiple GPT Agentscited by 19
- 2021GeneDisco: A Benchmark for Experimental Design in Drug Discoverycited by 18
- 2022Deep Reinforcement Learning for Inverse Inorganic Materials Designcited by 18
- 2023Searching for High-Value Molecules Using Reinforcement Learning and Transformerscited by 18
- 2024Generative Artificial Intelligence for Navigating Synthesizable Chemical Spacecited by 18
- 2025Graph Generative Pre-trained Transformercited by 16
- 2021C5T5: Controllable Generation of Organic Molecules with Transformerscited by 15
- 2024ACEGEN: Reinforcement learning of generative chemical agents for drug discoverycited by 14
50 most cited of 264 All 264 (JSON)
- 2026pCoMole: Pareto-Constrained Molecule Editing with Discrete Flows1 Oct 2026
- 2026MARCO: Multi-Round Agentic Reinforcement for Conditional Molecular Optimization29 Sep 2026
- 2026One Sequence, Many Decodings: CAGenMol-2 Recasts Drug Design as Masked Molecular Inference28 Sep 2026
- 2026CellRFT: Reinforcement Fine-Tuning for Single-Cell Perturbation Modeling17 Sep 2026
- 2026QALPA: Property-guided diffusion modeling for efficient exploration of chemical spaces of flexible molecules15 Sep 2026
- 2026Elite-Weighted Supervised Fine-tuning for Goal-Directed Molecular Optimization31 Aug 2026
- 2026Conditional GraphGANFed: Optimizing Graph-Structured Molecule Generation in Federated Generative Adversarial Networks24 Aug 2026
- 2026Molecular LLM Agents: From Architectural Design to Scientific Autonomy24 Aug 2026
- 2026Closed-Loop Bayesian Molecular Inverse Design with Semantic LLM Surrogates24 Aug 2026
- 2026FAR-DPO: Feasibility-Aware and Robust Direct Preference Optimization for Cyclic Peptide Design20 Aug 2026
- 2026D2R2: Discrete Diffusion with Regulation Reinforcement for Single-Cell Perturbation Prediction15 Aug 2026
- 2026Momba: Network Modernization Improves Multi-Objective Reinforcement Learning7 Aug 2026
38 more
- 2026Oracle-Budgeted Molecular Optimization with Short-Term Graph Memory30 Jul 2026
- 2026Q-Steer: Action-Value Guidance for Molecular Policy Optimization29 Jul 2026
- 2026OLEDLM: A Unified Language Model for OLED Molecular Design22 Jul 2026
- 2026ABOPD: Antibody CDR Design via On-Policy Distillation21 Jul 2026
- 2026Sample Efficient Generative Optimization for Molecular Design14 Jul 2026
- 2026Rethinking Scientific Discovery in the Agentic Era4 Jul 2026
- 2026On the Design Space of Discrete Diffusion Online Adaptation for Molecular Optimization3 Jul 2026
- 2026SynLaD: Latent Diffusion for Generating Synthesizable Molecules Conditioned on 3D Pharmacophore Profiles1 Jul 2026
- 2026Beyond Drug Discovery: The Nanotechnology Molecular Optimization (NMO) Benchmark29 Jun 2026
- 2026Uncertainty-aware reinforcement learning for chemical language models23 Jun 2026
- 2026Multigrid Training for Molecular Generation using Graph Neural Networks21 Jun 2026
- 2026Fairness Definitions and Metrics in Deep Reinforcement Learning for Drug Discovery in Healthcare: A Rapid Evidence Review1 Jun 2026
- 2026AtomComposer: Discovering Chemical Space from First Principles with Reinforcement Learning27 May 2026
- 2026Domain-Gated Latent Diffusion: Generative Inverse Design of HMX-Class Energetic Materials with First-Principles Validation26 May 2026
- 2026FORGE: Fragment-Oriented Ranking and Generation for Context-Aware Molecular Optimization11 May 2026
- 2026MolWorld: Molecule World Models for Actionable Molecular Optimization9 May 2026
- 2026SMolLM: Small Language Models Learn Small Molecular Grammar7 May 2026
- 2026Confidence is the key: how conformal prediction enhances the generative design of permeable peptides7 May 2026
- 2026Advancing Ligand-based Virtual Screening and Molecular Generation with Pretrained Molecular Embedding Distance27 Apr 2026
- 2026CombiMOTS: Combinatorial Multi-Objective Tree Search for Dual-Target Molecule Generation25 Apr 2026
- 2026C-MORAL: Controllable Multi-Objective Molecular Optimization with Reinforcement Alignment for LLMs24 Apr 2026
- 2026Structure-guided molecular design with contrastive 3D protein-ligand learning21 Apr 2026
- 2026Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Models14 Apr 2026
- 2026MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimization14 Apr 2026
- 2026Property-Guided Molecular Generation and Optimization via Latent Flows27 Mar 2026
- 2026SIGMA: Semantic Identifier Grouping for Molecular Autoregression26 Mar 2026
- 2026SciDesignBench: Benchmarking and Improving Language Models for Scientific Inverse Design13 Mar 2026
- 2026Graph-GRPO: Training Graph Flow Models with Reinforcement Learning11 Mar 2026
- 2026Reference-guided Policy Optimization for Molecular Optimization via LLM Reasoning6 Mar 2026
- 2026AI4S-SDS: A Neuro-Symbolic Solvent Design System via Sparse MCTS and Differentiable Physics Alignment4 Mar 2026
- 2026Retrieval-Augmented Foundation Models for Matched Molecular Pair Transformations to Recapitulate Medicinal Chemistry Intuition18 Feb 2026
- 2026Amortized Molecular Optimization via Group Relative Policy Optimization12 Feb 2026
- 2026Synthesizable Molecular Generation via Soft-constrained GFlowNets with Rich Chemical Priors4 Feb 2026
- 2026INDIBATOR: Diverse and Fact-Grounded Individuality for Multi-Agent Debate in Molecular Discovery2 Feb 2026
- 2026SEISMO: Explanation-Aware, Trajectory-Conditioned LLM Agents for Sample-Efficient Molecular Optimisation31 Jan 2026
- 2026MolLIBRA: Genetic Molecular Optimization with Multi-Fingerprint Surrogates and Text-Molecule Aligned Critic29 Jan 2026
- 2026ProDCARL: Reinforcement Learning-Aligned Diffusion Models for De Novo Antimicrobial Peptide Design29 Jan 2026
- 2026From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generation29 Jan 2026
50 newest of 264 All 264 (JSON)
- 2023Generative Diffusion Models on Graphs: Methods and Applicationscited by 79
- 2025GenMol: A Drug Discovery Generalist with Discrete Diffusioncited by 47
- 2024DecompOpt: Controllable and Decomposed Diffusion Models for Structure-based Molecular Optimizationcited by 27
- 2024Graph Diffusion Policy Optimizationcited by 12
- 2024LDMol: A Text-to-Molecule Diffusion Model with Structurally Informative Latent Space Surpasses AR Modelscited by 11
- 2024Decomposed Direct Preference Optimization for Structure-Based Drug Designcited by 7
- 2025Uncertainty-Aware Multi-Objective Reinforcement Learning-Guided Diffusion Models for 3D De Novo Molecular Designcited by 2
- 2025MolEditRL: Structure-Preserving Molecular Editing via Discrete Diffusion and Reinforcement Learningcited by 1
- 2026D2R2: Discrete Diffusion with Regulation Reinforcement for Single-Cell Perturbation Predictioncited by 1
- 2025TransDiffSBDD: Causality-Aware Multi-Modal Structure-Based Drug Designcited by 0
- 2025A 3D pocket-aware and affinity-guided diffusion model for lead optimizationcited by 0
- 2026ProDCARL: Reinforcement Learning-Aligned Diffusion Models for De Novo Antimicrobial Peptide Designcited by 0
12 most cited of 16 All 16 (JSON)
- 2026QALPA: Property-guided diffusion modeling for efficient exploration of chemical spaces of flexible molecules15 Sep 2026
- 2026D2R2: Discrete Diffusion with Regulation Reinforcement for Single-Cell Perturbation Prediction15 Aug 2026
- 2026On the Design Space of Discrete Diffusion Online Adaptation for Molecular Optimization3 Jul 2026
- 2026SynLaD: Latent Diffusion for Generating Synthesizable Molecules Conditioned on 3D Pharmacophore Profiles1 Jul 2026
- 2026Domain-Gated Latent Diffusion: Generative Inverse Design of HMX-Class Energetic Materials with First-Principles Validation26 May 2026
- 2026ProDCARL: Reinforcement Learning-Aligned Diffusion Models for De Novo Antimicrobial Peptide Design29 Jan 2026
- 2025Uncertainty-Aware Multi-Objective Reinforcement Learning-Guided Diffusion Models for 3D De Novo Molecular Design24 Oct 2025
- 2025MolEditRL: Structure-Preserving Molecular Editing via Discrete Diffusion and Reinforcement Learning26 May 2025
- 2025A 3D pocket-aware and affinity-guided diffusion model for lead optimization29 Apr 2025
- 2025TransDiffSBDD: Causality-Aware Multi-Modal Structure-Based Drug Design26 Mar 2025
- 2025GenMol: A Drug Discovery Generalist with Discrete Diffusion10 Jan 2025
- 2024Decomposed Direct Preference Optimization for Structure-Based Drug Design19 Jul 2024
12 newest of 16 All 16 (JSON)
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 43
- 2024AgentDrug: Utilizing Large Language Models in An Agentic Workflow for Zero-Shot Molecular Editingcited by 3
- 2026MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimizationcited by 3
- 2026SEISMO: Explanation-Aware, Trajectory-Conditioned LLM Agents for Sample-Efficient Molecular Optimisationcited by 1
- 2025FRAGMENTA: End-to-end Fragmentation-based Generative Model with Agentic Tuning for Drug Lead Optimizationcited by 0
- 2026INDIBATOR: Diverse and Fact-Grounded Individuality for Multi-Agent Debate in Molecular Discoverycited by 0
- 2026Rethinking Scientific Discovery in the Agentic Eracited by 0
- 2026Molecular LLM Agents: From Architectural Design to Scientific Autonomycited by 0
- 2026MARCO: Multi-Round Agentic Reinforcement for Conditional Molecular Optimizationcited by 0
- 2026MARCO: Multi-Round Agentic Reinforcement for Conditional Molecular Optimization29 Sep 2026
- 2026Molecular LLM Agents: From Architectural Design to Scientific Autonomy24 Aug 2026
- 2026Rethinking Scientific Discovery in the Agentic Era4 Jul 2026
- 2026MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimization14 Apr 2026
- 2026INDIBATOR: Diverse and Fact-Grounded Individuality for Multi-Agent Debate in Molecular Discovery2 Feb 2026
- 2026SEISMO: Explanation-Aware, Trajectory-Conditioned LLM Agents for Sample-Efficient Molecular Optimisation31 Jan 2026
- 2025FRAGMENTA: End-to-end Fragmentation-based Generative Model with Agentic Tuning for Drug Lead Optimization25 Nov 2025
- 2025El Agente: An Autonomous Agent for Quantum Chemistry5 May 2025
- 2024AgentDrug: Utilizing Large Language Models in An Agentic Workflow for Zero-Shot Molecular Editing17 Oct 2024
- 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 42
- 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Explorationcited by 14
- 2025De Novo Molecular Design Enabled by Direct Preference Optimization and Curriculum Learningcited by 4
- 2026Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Modelscited by 0
- 2026Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Models14 Apr 2026
- 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparison11 Nov 2025
- 2025De Novo Molecular Design Enabled by Direct Preference Optimization and Curriculum Learning2 Apr 2025
- 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Exploration3 Sep 2024
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
- 2022Translation between Molecules and Natural Languagecited by 173
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2022Local Latent Space Bayesian Optimization over Structured Inputscited by 78
- 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2024Efficient Evolutionary Search Over Chemical Space with Large Language Modelscited by 59
- 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 57
- 2022Reinforced Genetic Algorithm for Structure-based Drug Designcited by 46
12 most cited of 228 All 228 (JSON)
- 2026pCoMole: Pareto-Constrained Molecule Editing with Discrete Flows1 Oct 2026
- 2026One Sequence, Many Decodings: CAGenMol-2 Recasts Drug Design as Masked Molecular Inference28 Sep 2026
- 2026CellRFT: Reinforcement Fine-Tuning for Single-Cell Perturbation Modeling17 Sep 2026
- 2026Elite-Weighted Supervised Fine-tuning for Goal-Directed Molecular Optimization31 Aug 2026
- 2026Conditional GraphGANFed: Optimizing Graph-Structured Molecule Generation in Federated Generative Adversarial Networks24 Aug 2026
- 2026Closed-Loop Bayesian Molecular Inverse Design with Semantic LLM Surrogates24 Aug 2026
- 2026FAR-DPO: Feasibility-Aware and Robust Direct Preference Optimization for Cyclic Peptide Design20 Aug 2026
- 2026Momba: Network Modernization Improves Multi-Objective Reinforcement Learning7 Aug 2026
- 2026Oracle-Budgeted Molecular Optimization with Short-Term Graph Memory30 Jul 2026
- 2026Q-Steer: Action-Value Guidance for Molecular Policy Optimization29 Jul 2026
- 2026OLEDLM: A Unified Language Model for OLED Molecular Design22 Jul 2026
- 2026ABOPD: Antibody CDR Design via On-Policy Distillation21 Jul 2026
12 newest of 228 All 228 (JSON)