GeneDisco: A Benchmark for Experimental Design in Drug Discovery
Not on the map. Why?
Abstract (arXiv)
In vitro cellular experimentation with genetic interventions, using for example CRISPR technologies, is an essential step in early-stage drug discovery and target validation that serves to assess initial hypotheses about causal associations between biological mechanisms and disease pathologies. With billions of potential hypotheses to test, the experimental design space for in vitro genetic experiments is extremely vast, and the available experimental capacity - even at the largest research institutions in the world - pales in relation to the size of this biological hypothesis space. Machine learning methods, such as active and reinforcement learning, could aid in optimally exploring the vast biological space by integrating prior knowledge from various information sources as well as extrapolating to yet unexplored areas of the experimental design space based on available data. However, there exist no standardised benchmarks and data sets for this challenging task and little research has been conducted in this area to date. Here, we introduce GeneDisco, a benchmark suite for evaluating active learning algorithms for experimental design in drug discovery. GeneDisco contains a curated set of multiple publicly available experimental data sets as well as open-source implementations of state-of-the-art active learning policies for experimental design and exploration.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 28 of its 99 references that are in the map. First posted on arXiv 22 Oct 2021.
Builds on
28 of 99 references.
References · 28
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Adversarial examples in the physical worldcited by 1,769
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
- 2017Deep Bayesian Active Learning with Image Datacited by 819
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 610
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 267
- 2017Are GANs Created Equal? A Large-Scale Studycited by 267
- 2017Deep Reinforcement Learning for De-Novo Drug Designcited by 161
- 2019Learning Neural Causal Models from Unknown Interventionscited by 113
16 more
- 2020CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learningcited by 109
- 2017Automated versus do-it-yourself methods for causal inference: Lessons learned from a data analysis competitioncited by 106
- 2021DiBS: Differentiable Bayesian Structure Learningcited by 106
- 2019Learning Counterfactual Representations for Estimating Individual Dose-Response Curvescited by 90
- 2018Molecular generative model based on conditional variational autoencoder for de novo molecular designcited by 73
- 2020Learning To Navigate The Synthetically Accessible Chemical Space Using Reinforcement Learningcited by 57
- 2018Perfect Match: A Simple Method for Learning Representations For Counterfactual Inference With Neural Networkscited by 56
- 2019ABCD-Strategy: Budgeted Experimental Design for Targeted Causal Structure Discoverycited by 52
- 2021Variational Causal Networks: Approximate Bayesian Inference over Causal Structurescited by 43
- 2021Learning Neural Causal Models with Active Interventionscited by 40
- 2017Budgeted Experiment Design for Causal Structure Learningcited by 38
- 2020Molecular Design in Synthetically Accessible Chemical Space via Deep Reinforcement Learningcited by 32
- 2021BayesIMP: Uncertainty Quantification for Causal Data Fusioncited by 21
- 2019Active Learning for Decision-Making from Imbalanced Observational Datacited by 16
- 2021NCoRE: Neural Counterfactual Representation Learning for Combinations of Treatmentscited by 14
- 2015Diffusion Component Analysis: Unraveling Functional Topology in Biological Networkscited by 3
Built on by
Citing papers per year: 2022: 7; 2023: 3; 2024: 3; 2025: 4; 2026: 1.
18 papers.
Sort:
By area:
- 2024BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experimentscited by 53
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 49
- 2022CausalBench: A Large-scale Benchmark for Network Inference from Single-cell Perturbation Datacited by 29
- 2024Active Learning for Neural PDE Solverscited by 22
- 2023DRCFS: Doubly Robust Causal Feature Selectioncited by 12
- 2023DiscoBAX: Discovery of Optimal Intervention Sets in Genomic Experiment Designcited by 12
- 2024Automated Discovery of Pairwise Interactions from Unstructured Datacited by 8
- 2022Neural Design for Genetic Perturbation Experimentscited by 6
- 2022Trust Your nabla: Gradient-based Intervention Targeting for Causal Discoverycited by 5
- 2025In-silico biological discovery with large perturbation modelscited by 4
- 2022Combinatorial and algebraic perspectives on the marginal independence structure of Bayesian networkscited by 3
- 2023Multi-omics Prediction from High-content Cellular Imaging with Deep Learningcited by 3
6 more
- 2022PyRelationAL: a python library for active learning research and developmentcited by 2
- 2025BioBO: Biology-informed Bayesian Optimization for Perturbation Designcited by 2
- 2022Experimental Design for Multi-Channel Imaging via Task-Driven Feature Selectioncited by 0
- 2025Deep Active Learning based Experimental Design to Uncover Synergistic Genetic Interactions for Host Targeted Therapeuticscited by 0
- 2025Efficient Data Selection for Training Genomic Perturbation Modelscited by 0
- 2026Many Needles in a Haystack: Active Hit Discovery for Perturbation Experimentscited by 0
- 2026Many Needles in a Haystack: Active Hit Discovery for Perturbation Experiments11 May 2026
- 2025BioBO: Biology-informed Bayesian Optimization for Perturbation Design24 Sep 2025
- 2025In-silico biological discovery with large perturbation models30 Mar 2025
- 2025Efficient Data Selection for Training Genomic Perturbation Models18 Mar 2025
- 2025Deep Active Learning based Experimental Design to Uncover Synergistic Genetic Interactions for Host Targeted Therapeutics3 Feb 2025
- 2024Automated Discovery of Pairwise Interactions from Unstructured Data11 Sep 2024
- 2024Active Learning for Neural PDE Solvers2 Aug 2024
- 2024BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments27 May 2024
- 2023DiscoBAX: Discovery of Optimal Intervention Sets in Genomic Experiment Design7 Dec 2023
- 2023Multi-omics Prediction from High-content Cellular Imaging with Deep Learning15 Jun 2023
- 2023DRCFS: Doubly Robust Causal Feature Selection12 Jun 2023
- 2022Trust Your nabla: Gradient-based Intervention Targeting for Causal Discovery24 Nov 2022
6 more
- 2022CausalBench: A Large-scale Benchmark for Network Inference from Single-cell Perturbation Data31 Oct 2022
- 2022Experimental Design for Multi-Channel Imaging via Task-Driven Feature Selection13 Oct 2022
- 2022Combinatorial and algebraic perspectives on the marginal independence structure of Bayesian networks3 Oct 2022
- 2022Neural Design for Genetic Perturbation Experiments26 Jul 2022
- 2022PyRelationAL: a python library for active learning research and development23 May 2022
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regression17 Mar 2022
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 49
- 2022CausalBench: A Large-scale Benchmark for Network Inference from Single-cell Perturbation Datacited by 29
- 2024Active Learning for Neural PDE Solverscited by 22
- 2023DRCFS: Doubly Robust Causal Feature Selectioncited by 12
- 2023DiscoBAX: Discovery of Optimal Intervention Sets in Genomic Experiment Designcited by 12
- 2024Automated Discovery of Pairwise Interactions from Unstructured Datacited by 8
- 2022Neural Design for Genetic Perturbation Experimentscited by 6
- 2022Trust Your nabla: Gradient-based Intervention Targeting for Causal Discoverycited by 5
- 2025In-silico biological discovery with large perturbation modelscited by 4
- 2022Combinatorial and algebraic perspectives on the marginal independence structure of Bayesian networkscited by 3
- 2023Multi-omics Prediction from High-content Cellular Imaging with Deep Learningcited by 3
- 2022PyRelationAL: a python library for active learning research and developmentcited by 2
12 most cited of 17 All 17 (JSON)
- 2026Many Needles in a Haystack: Active Hit Discovery for Perturbation Experiments11 May 2026
- 2025BioBO: Biology-informed Bayesian Optimization for Perturbation Design24 Sep 2025
- 2025In-silico biological discovery with large perturbation models30 Mar 2025
- 2025Efficient Data Selection for Training Genomic Perturbation Models18 Mar 2025
- 2025Deep Active Learning based Experimental Design to Uncover Synergistic Genetic Interactions for Host Targeted Therapeutics3 Feb 2025
- 2024Automated Discovery of Pairwise Interactions from Unstructured Data11 Sep 2024
- 2024Active Learning for Neural PDE Solvers2 Aug 2024
- 2023DiscoBAX: Discovery of Optimal Intervention Sets in Genomic Experiment Design7 Dec 2023
- 2023Multi-omics Prediction from High-content Cellular Imaging with Deep Learning15 Jun 2023
- 2023DRCFS: Doubly Robust Causal Feature Selection12 Jun 2023
- 2022Trust Your nabla: Gradient-based Intervention Targeting for Causal Discovery24 Nov 2022
- 2022CausalBench: A Large-scale Benchmark for Network Inference from Single-cell Perturbation Data31 Oct 2022
12 newest of 17 All 17 (JSON)