mlsanityData to 7 Oct 2026

GROOT: Effective Design of Biological Sequences with Limited Experimental Data

arXiv 2411.11265 ↗First posted 18 Nov 2024cs.LG q-bio.QMcited by 1

Not on the map. Why?

Abstract (arXiv)

Latent space optimization (LSO) is a powerful method for designing discrete, high-dimensional biological sequences that maximize expensive black-box functions, such as wet lab experiments. This is accomplished by learning a latent space from available data and using a surrogate model to guide optimization algorithms toward optimal outputs. However, existing methods struggle when labeled data is limited, as training the surrogate model with few labeled data points can lead to subpar outputs, offering no advantage over the training data itself. We address this challenge by introducing GROOT, a Graph-based Latent Smoothing for Biological Sequence Optimization. In particular, GROOT generates pseudo-labels for neighbors sampled around the training latent embeddings. These pseudo-labels are then refined and smoothed by Label Propagation. Additionally, we theoretically and empirically justify our approach, demonstrate GROOT's ability to extrapolate to regions beyond the training set while maintaining reliability within an upper bound of their expected distances from the training regions. We evaluate GROOT on various biological sequence design tasks, including protein optimization (GFP and AAV) and three tasks with exact oracles from Design-Bench. The results demonstrate that GROOT equalizes and surpasses existing methods without requiring access to black-box oracles or vast amounts of labeled data, highlighting its practicality and effectiveness. We release our code at https://anonymous.4open.science/r/GROOT-D554

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 41 references that are in the map. First posted on arXiv 18 Nov 2024.

Builds on

16 of 41 references.

References · 16

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  3. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
  4. 2020Combining Label Propagation and Simple Models Out-performs Graph Neural Networkscited by 199
  5. 2019Conditioning by adaptive sampling for robust designcited by 110
  6. 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
  7. 2021Conservative Objective Models for Effective Offline Model-Based Optimizationcited by 87
  8. 2019Model Inversion Networks for Model-Based Optimizationcited by 83
  9. 2020AdaLead: A simple and robust adaptive greedy search algorithm for sequence designcited by 63
  10. 2021Learning in High Dimension Always Amounts to Extrapolationcited by 62
  11. 2017The reparameterization trick for acquisition functionscited by 61
  12. 2023Protein Discovery with Discrete Walk-Jump Samplingcited by 38
4 more
  1. 2022Bidirectional Learning for Offline Infinite-width Model-based Optimizationcited by 35
  2. 2023ExPT: Synthetic Pretraining for Few-Shot Experimental Designcited by 22
  3. 2023Improving Protein Optimization with Smoothed Fitness Landscapescited by 20
  4. 2024Robust Optimization in Protein Fitness Landscapes Using Reinforcement Learning in Latent Spacecited by 13

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.