ACEGEN: Reinforcement learning of generative chemical agents for drug discovery
Not on the map. Why?
Abstract (arXiv)
In recent years, reinforcement learning (RL) has emerged as a valuable tool in drug design, offering the potential to propose and optimize molecules with desired properties. However, striking a balance between capabilities, flexibility, reliability, and efficiency remains challenging due to the complexity of advanced RL algorithms and the significant reliance on specialized code. In this work, we introduce ACEGEN, a comprehensive and streamlined toolkit tailored for generative drug design, built using TorchRL, a modern RL library that offers thoroughly tested reusable components. We validate ACEGEN by benchmarking against other published generative modeling algorithms and show comparable or improved performance. We also show examples of ACEGEN applied in multiple drug discovery case studies. ACEGEN is accessible at urlhttps://github.com/acellera/acegen-open and available for use under the MIT license.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 25 of its 71 references that are in the map. First posted on arXiv 7 May 2024.
Builds on
25 of 71 references.
References · 25
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 294
13 more
- 2022Teaching language models to support answers with verified quotescited by 290
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 270
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 264
- 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 214
- 2017Deep Reinforcement Learning for De-Novo Drug Designcited by 161
- 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 151
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2023TorchRL: A data-driven decision-making library for PyTorchcited by 59
- 2023Gotta be SAFE: A New Framework for Molecular Designcited by 45
- 2023OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone Controlcited by 28
- 2021How Much Space Has Been Explored? Measuring the Chemical Space Covered by Databases and Machine-Generated Moleculescited by 27
- 2020Exploring Chemical Space using Natural Language Processing Methodologies for Drug Discoverycited by 24
- 2020Guided Exploration with Proximal Policy Optimization using a Single Demonstrationcited by 19
Built on by
Citing papers per year: 2024: 3; 2025: 8; 2026: 3.
14 papers.
Sort:
By area:
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
- 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworkscited by 14
- 2024Aligning Transformers with Continuous Feedback via Energy Rank Alignmentcited by 6
- 2024Small Molecule Optimization with Large Language Modelscited by 5
- 2025Refine Drugs, Don't Complete Them: Uniform-Source Discrete Flows for Fragment-Based Drug Discoverycited by 4
- 2025REINFORCE-ING Chemical Language Models for Drug Discoverycited by 3
- 2025Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learningcited by 2
- 2025Test-Time Training Scaling Laws for Chemical Exploration in Drug Designcited by 1
- 2025Generative molecule evolution using 3D pharmacophore for efficient Structure-Based Drug Designcited by 1
- 2025NovoMolGen: Rethinking Molecular Language Model Pretrainingcited by 0
- 2025Valid Property-Enhanced Contrastive Learning for Targeted Optimization & Resampling for Novel Drug Designcited by 0
- 2026Fairness Definitions and Metrics in Deep Reinforcement Learning for Drug Discovery in Healthcare: A Rapid Evidence Reviewcited by 0
- 2026A Systematic Evaluation of Molecule Generation Models for De Novo Drug Design: From Benchmarks to Practical Insights9 Sep 2026
- 2026Uncertainty-aware reinforcement learning for chemical language models23 Jun 2026
- 2026Fairness Definitions and Metrics in Deep Reinforcement Learning for Drug Discovery in Healthcare: A Rapid Evidence Review1 Jun 2026
- 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworks1 Dec 2025
- 2025Refine Drugs, Don't Complete Them: Uniform-Source Discrete Flows for Fragment-Based Drug Discovery30 Sep 2025
- 2025Valid Property-Enhanced Contrastive Learning for Targeted Optimization & Resampling for Novel Drug Design31 Aug 2025
- 2025NovoMolGen: Rethinking Molecular Language Model Pretraining19 Aug 2025
- 2025Generative molecule evolution using 3D pharmacophore for efficient Structure-Based Drug Design27 Jul 2025
- 2025Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learning20 Jun 2025
- 2025Test-Time Training Scaling Laws for Chemical Exploration in Drug Design31 Jan 2025
- 2025REINFORCE-ING Chemical Language Models for Drug Discovery27 Jan 2025
- 2024Small Molecule Optimization with Large Language Models26 Jul 2024
2 more
- 2025NovoMolGen: Rethinking Molecular Language Model Pretraining19 Aug 2025
- 2024Small Molecule Optimization with Large Language Modelscited by 5
- 2025Refine Drugs, Don't Complete Them: Uniform-Source Discrete Flows for Fragment-Based Drug Discoverycited by 4
- 2025REINFORCE-ING Chemical Language Models for Drug Discoverycited by 3
- 2025Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learningcited by 2
- 2025Test-Time Training Scaling Laws for Chemical Exploration in Drug Designcited by 1
- 2025Generative molecule evolution using 3D pharmacophore for efficient Structure-Based Drug Designcited by 1
- 2025Valid Property-Enhanced Contrastive Learning for Targeted Optimization & Resampling for Novel Drug Designcited by 0
- 2026Fairness Definitions and Metrics in Deep Reinforcement Learning for Drug Discovery in Healthcare: A Rapid Evidence Reviewcited by 0
- 2026Uncertainty-aware reinforcement learning for chemical language modelscited by 0
- 2026A Systematic Evaluation of Molecule Generation Models for De Novo Drug Design: From Benchmarks to Practical Insightscited by 0
- 2026A Systematic Evaluation of Molecule Generation Models for De Novo Drug Design: From Benchmarks to Practical Insights9 Sep 2026
- 2026Uncertainty-aware reinforcement learning for chemical language models23 Jun 2026
- 2026Fairness Definitions and Metrics in Deep Reinforcement Learning for Drug Discovery in Healthcare: A Rapid Evidence Review1 Jun 2026
- 2025Refine Drugs, Don't Complete Them: Uniform-Source Discrete Flows for Fragment-Based Drug Discovery30 Sep 2025
- 2025Valid Property-Enhanced Contrastive Learning for Targeted Optimization & Resampling for Novel Drug Design31 Aug 2025
- 2025Generative molecule evolution using 3D pharmacophore for efficient Structure-Based Drug Design27 Jul 2025
- 2025Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learning20 Jun 2025
- 2025Test-Time Training Scaling Laws for Chemical Exploration in Drug Design31 Jan 2025
- 2025REINFORCE-ING Chemical Language Models for Drug Discovery27 Jan 2025
- 2024Small Molecule Optimization with Large Language Models26 Jul 2024