Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models
Not on the map. Why?
Abstract (arXiv)
In unsupervised data generation tasks, besides the generation of a sample based on previous observations, one would often like to give hints to the model in order to bias the generation towards desirable metrics. We propose a method that combines Generative Adversarial Networks (GANs) and reinforcement learning (RL) in order to accomplish exactly that. While RL biases the data generation process towards arbitrary metrics, the GAN component of the reward function ensures that the model still remembers information learned from data. We build upon previous results that incorporated GANs and RL in order to generate sequence data and test this model in several settings for the generation of molecules encoded as text sequences (SMILES) and in the context of music generation, showing for each case that we can effectively bias the generation process towards desired metrics.
Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 23; 2022: 27; 2023: 23; 2024: 23; 2025: 12; 2026: 7.
116 papers.
Sort:
By area:
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2023Return of Unconditional Generation: A Self-supervised Representation Generation Methodcited by 95
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2023On the Constrained Time-Series Generation Problemcited by 52
- 2022Reinforced Genetic Algorithm for Structure-based Drug Designcited by 46
- 2022LIMO: Latent Inceptionism for Targeted Molecule Generationcited by 40
- 20233D molecule generation by denoising voxel gridscited by 38
- 2021Quantum Generative Models for Small Molecule Drug Discoverycited by 37
- 2024MusicRL: Aligning Music Generation to Human Preferencescited by 32
- 2021JANUS: Parallel Tempered Genetic Algorithm Guided by Deep Neural Networks for Inverse Molecular Designcited by 31
- 2021PcDGAN: A Continuous Conditional Diverse Generative Adversarial Network For Inverse Designcited by 30
- 2021Artificial Intelligence in Drug Discovery: Applications and Techniquescited by 28
38 more
- 2022Data-Efficient Graph Grammar Learning for Molecular Generationcited by 26
- 2024SynFlowNet: Design of Diverse and Novel Molecules with Synthesis Constraintscited by 26
- 2024Large Language Models in Drug Discovery and Development: From Disease Mechanisms to Clinical Trialscited by 24
- 2021Creativity and Machine Learning: A Surveycited by 21
- 2022Graph Neural Networks for Moleculescited by 21
- 2024Evaluating Creative Short Story Generation in Humans and Large Language Modelscited by 21
- 2023De novo Drug Design using Reinforcement Learning with Multiple GPT Agentscited by 19
- 2022Target-aware Molecular Graph Generationcited by 18
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2022MGCVAE: Multi-objective Inverse Design via Molecular Graph Conditional Variational Autoencodercited by 16
- 2022A survey on text generation using generative adversarial networkscited by 16
- 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspectivecited by 16
- 2021C5T5: Controllable Generation of Organic Molecules with Transformerscited by 15
- 2022Interpretable Molecular Graph Generation via Monotonic Constraintscited by 15
- 2022Accelerating Material Design with the Generative Toolkit for Scientific Discoverycited by 15
- 2021Assigning Confidence to Molecular Property Predictioncited by 14
- 2024Saturn: Sample-efficient Generative Molecular Design using Memory Manipulationcited by 14
- 2023t-SMILES: A Scalable Fragment-based Molecular Representation Framework for De Novo Molecule Generationcited by 13
- 2022Scalable Fragment-Based 3D Molecular Design with Reinforcement Learningcited by 11
- 2023Reinforcement Learning for Generative AI: A Surveycited by 11
- 2021Hybrid quantum-classical machine learning for generative chemistry and drug designcited by 10
- 2021Unifying Likelihood-free Inference with Black-box Optimization and Beyondcited by 10
- 2023Reinforcement Learning for Generative AI: State of the Art, Opportunities and Open Research Challengescited by 10
- 2024Generative Adversarial Model-Based Optimization via Source Critic Regularizationcited by 10
- 2024Diversity-Rewarded CFG Distillationcited by 9
- 2022Conditional β-VAE for De Novo Molecular Generationcited by 8
- 2022Probabilistic Generative Transformer Language models for Generative Design of Moleculescited by 8
- 2022Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Designcited by 7
- 2023Augmented Memory: Capitalizing on Experience Replay to Accelerate De Novo Molecular Designcited by 7
- 2024Creativity in AI: Progresses and Challengescited by 7
- 2021Game of GANs: Game-Theoretical Models for Generative Adversarial Networkscited by 6
- 2021Fragment-based Sequential Translation for Molecular Optimizationcited by 6
- 2022Graph Machine Learning for Design of High-Octane Fuelscited by 6
- 2024Entropy-Reinforced Planning with Large Language Models for Drug Discoverycited by 6
- 2021Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discoverycited by 5
- 2023Target Specific De Novo Design of Drug Candidate Molecules with Graph Transformer-based Generative Adversarial Networkscited by 5
- 2023Application of quantum-inspired generative models to small molecular datasetscited by 5
- 2023Beam Enumeration: Probabilistic Explainability For Sample Efficient Self-conditioned Molecular Designcited by 5
50 most cited of 116 All 116 (JSON)
- 2026A Systematic Evaluation of Molecule Generation Models for De Novo Drug Design: From Benchmarks to Practical Insights9 Sep 2026
- 2026Conditional GraphGANFed: Optimizing Graph-Structured Molecule Generation in Federated Generative Adversarial Networks24 Aug 2026
- 2026Adopting Reinforcement Learning with Verifiable Rewards for Molecular Generation21 Jul 2026
- 2026MolWorld: Molecule World Models for Actionable Molecular Optimization9 May 2026
- 2026CombiMOTS: Combinatorial Multi-Objective Tree Search for Dual-Target Molecule Generation25 Apr 2026
- 2026How Creative Are Large Language Models in Generating Molecules?20 Apr 2026
- 2026Agents on a Tree: Pathwise Coordination for Multi-Objective Molecular Optimization27 Mar 2026
- 2025CycleChemist: A Dual-Pronged Machine Learning Framework for Organic Photovoltaic Discovery23 Nov 2025
- 2025MADD: Multi-Agent Drug Discovery Orchestra11 Nov 2025
- 2025SOLD: SELFIES-based Objective-driven Latent Diffusion3 Sep 2025
- 2025Quantum latent distributions in deep generative models27 Aug 2025
- 2025ActivityDiff: A diffusion model with Positive and Negative Activity Guidance for De Novo Drug Design8 Aug 2025
38 more
- 2025Heterophily-informed Message Passing28 Apr 2025
- 2025MetaMolGen: A Neural Graph Motif Generation Model for De Novo Molecular Design22 Apr 2025
- 2025A Reinforcement Learning-Driven Transformer GAN for Molecular Generation17 Mar 2025
- 2025InversionGNN: A Dual Path Network for Multi-Property Molecular Optimization3 Mar 2025
- 2025Auxiliary Discrminator Sequence Generative Adversarial Networks (ADSeqGAN) for Few Sample Molecule Generation23 Feb 2025
- 2025DrugImproverGPT: A Large Language Model for Drug Optimization with Fine-Tuning via Structured Policy Optimization11 Feb 2025
- 2025ScaffoldGPT: A Scaffold-based GPT Model for Drug Optimization9 Feb 2025
- 2024Enhancing Molecular Design through Graph-based Topological Reinforcement Learning22 Nov 2024
- 2024Evaluating Creative Short Story Generation in Humans and Large Language Models4 Nov 2024
- 2024Creativity in AI: Progresses and Challenges22 Oct 2024
- 2024Hybrid Generative AI for De Novo Design of Co-Crystals with Enhanced Tabletability22 Oct 2024
- 2024SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation21 Oct 2024
- 2024Diversity-Rewarded CFG Distillation8 Oct 2024
- 2024When Molecular GAN Meets Byte-Pair Encoding29 Sep 2024
- 2024Quantum-inspired Reinforcement Learning for Synthesizable Drug Design13 Sep 2024
- 2024Large Language Models in Drug Discovery and Development: From Disease Mechanisms to Clinical Trials6 Sep 2024
- 2024Repurformer: Transformers for Repurposing-Aware Molecule Generation16 Jul 2024
- 2024NEBULA: Neural Empirical Bayes Under Latent Representations for Efficient and Controllable Design of Molecular Libraries3 Jul 2024
- 2024Entropy-Reinforced Planning with Large Language Models for Drug Discovery11 Jun 2024
- 2024GANetic Loss for Generative Adversarial Networks with a Focus on Medical Applications7 Jun 2024
- 2024Using GNN property predictors as molecule generators5 Jun 2024
- 2024Saturn: Sample-efficient Generative Molecular Design using Memory Manipulation27 May 2024
- 2024Navigating Chemical Space with Latent Flows7 May 2024
- 2024SynFlowNet: Design of Diverse and Novel Molecules with Synthesis Constraints2 May 2024
- 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspective9 Apr 2024
- 2024Molecular Generative Adversarial Network with Multi-Property Optimization29 Mar 2024
- 2024When SMILES have Language: Drug Classification using Text Classification Methods on Drug SMILES Strings3 Mar 2024
- 2024Generative Adversarial Model-Based Optimization via Source Critic Regularization9 Feb 2024
- 2024MusicRL: Aligning Music Generation to Human Preferences6 Feb 2024
- 2024Empirical Evidence for the Fragment level Understanding on Drug Molecular Structure of LLMs15 Jan 2024
- 2023De novo Drug Design using Reinforcement Learning with Multiple GPT Agents21 Dec 2023
- 2023Return of Unconditional Generation: A Self-supervised Representation Generation Method6 Dec 2023
- 2023STRIDE: Structure-guided Generation for Inverse Design of Molecules6 Nov 2023
- 2023Reward Dropout Improves Control: Bi-objective Perspective on Reinforced LM6 Oct 2023
- 2023Diffusing on Two Levels and Optimizing for Multiple Properties: A Novel Approach to Generating Molecules with Desirable Properties5 Oct 2023
- 2023Beam Enumeration: Probabilistic Explainability For Sample Efficient Self-conditioned Molecular Design25 Sep 2023
- 2023Reinforcement Learning for Generative AI: A Survey28 Aug 2023
- 2023Objective-Agnostic Enhancement of Molecule Properties via Multi-Stage VAE24 Aug 2023
50 newest of 116 All 116 (JSON)
- 2023Diffusing on Two Levels and Optimizing for Multiple Properties: A Novel Approach to Generating Molecules with Desirable Propertiescited by 5
- 2022ParticleGrid: Enabling Deep Learning using 3D Representation of Materialscited by 2
- 2023Modeling and design of heterogeneous hierarchical bioinspired spider web structures using generative deep learning and additive manufacturingcited by 2
- 2024SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generationcited by 1
- 2025ActivityDiff: A diffusion model with Positive and Negative Activity Guidance for De Novo Drug Designcited by 1
- 2025SOLD: SELFIES-based Objective-driven Latent Diffusioncited by 0
- 2025SOLD: SELFIES-based Objective-driven Latent Diffusion3 Sep 2025
- 2025ActivityDiff: A diffusion model with Positive and Negative Activity Guidance for De Novo Drug Design8 Aug 2025
- 2024SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation21 Oct 2024
- 2023Diffusing on Two Levels and Optimizing for Multiple Properties: A Novel Approach to Generating Molecules with Desirable Properties5 Oct 2023
- 2023Modeling and design of heterogeneous hierarchical bioinspired spider web structures using generative deep learning and additive manufacturing11 Apr 2023
- 2022ParticleGrid: Enabling Deep Learning using 3D Representation of Materials15 Nov 2022
- 2025MADD: Multi-Agent Drug Discovery Orchestracited by 4
- 2025MADD: Multi-Agent Drug Discovery Orchestra11 Nov 2025
- 2024MusicRL: Aligning Music Generation to Human Preferencescited by 32
- 2024MusicRL: Aligning Music Generation to Human Preferences6 Feb 2024
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2023Return of Unconditional Generation: A Self-supervised Representation Generation Methodcited by 95
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2023On the Constrained Time-Series Generation Problemcited by 52
- 2022Reinforced Genetic Algorithm for Structure-based Drug Designcited by 46
- 2022LIMO: Latent Inceptionism for Targeted Molecule Generationcited by 40
- 20233D molecule generation by denoising voxel gridscited by 38
- 2021Quantum Generative Models for Small Molecule Drug Discoverycited by 37
- 2021JANUS: Parallel Tempered Genetic Algorithm Guided by Deep Neural Networks for Inverse Molecular Designcited by 31
- 2021PcDGAN: A Continuous Conditional Diverse Generative Adversarial Network For Inverse Designcited by 30
- 2021Artificial Intelligence in Drug Discovery: Applications and Techniquescited by 28
- 2022Data-Efficient Graph Grammar Learning for Molecular Generationcited by 26
12 most cited of 107 All 107 (JSON)
- 2026A Systematic Evaluation of Molecule Generation Models for De Novo Drug Design: From Benchmarks to Practical Insights9 Sep 2026
- 2026Conditional GraphGANFed: Optimizing Graph-Structured Molecule Generation in Federated Generative Adversarial Networks24 Aug 2026
- 2026Adopting Reinforcement Learning with Verifiable Rewards for Molecular Generation21 Jul 2026
- 2026MolWorld: Molecule World Models for Actionable Molecular Optimization9 May 2026
- 2026CombiMOTS: Combinatorial Multi-Objective Tree Search for Dual-Target Molecule Generation25 Apr 2026
- 2026How Creative Are Large Language Models in Generating Molecules?20 Apr 2026
- 2026Agents on a Tree: Pathwise Coordination for Multi-Objective Molecular Optimization27 Mar 2026
- 2025CycleChemist: A Dual-Pronged Machine Learning Framework for Organic Photovoltaic Discovery23 Nov 2025
- 2025Quantum latent distributions in deep generative models27 Aug 2025
- 2025Heterophily-informed Message Passing28 Apr 2025
- 2025MetaMolGen: A Neural Graph Motif Generation Model for De Novo Molecular Design22 Apr 2025
- 2025A Reinforcement Learning-Driven Transformer GAN for Molecular Generation17 Mar 2025
12 newest of 107 All 107 (JSON)