Improving Protein Optimization with Smoothed Fitness Landscapes
Not on the map. Why?
Abstract (arXiv)
The ability to engineer novel proteins with higher fitness for a desired property would be revolutionary for biotechnology and medicine. Modeling the combinatorially large space of sequences is infeasible; prior methods often constrain optimization to a small mutational radius, but this drastically limits the design space. Instead of heuristics, we propose smoothing the fitness landscape to facilitate protein optimization. First, we formulate protein fitness as a graph signal then use Tikunov regularization to smooth the fitness landscape. We find optimizing in this smoothed landscape leads to improved performance across multiple methods in the GFP and AAV benchmarks. Second, we achieve state-of-the-art results utilizing discrete energy-based models and MCMC in the smoothed landscape. Our method, called Gibbs sampling with Graph-based Smoothing (GGS), demonstrates a unique ability to achieve 2.5 fold fitness improvement (with in-silico evaluation) over its training set. GGS demonstrates potential to optimize proteins in the limited data regime. Code: https://github.com/kirjner/GGS
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 2 Jul 2023.
Builds on
17 of 38 references.
References · 17
- 2019Evaluating Protein Transfer Learning with TAPEcited by 229
- 2022Biological Sequence Design with GFlowNetscited by 172
- 2023Protein Design with Guided Discrete Diffusioncited by 154
- 2019Conditioning by adaptive sampling for robust designcited by 110
- 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
- 2022Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimizationcited by 96
- 2021Oops I Took A Gradient: Scalable Sampling for Discrete Distributionscited by 92
- 2021Conservative Objective Models for Effective Offline Model-Based Optimizationcited by 87
- 2022Local Latent Space Bayesian Optimization over Structured Inputscited by 78
- 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 78
- 2020AdaLead: A simple and robust adaptive greedy search algorithm for sequence designcited by 63
- 2017The reparameterization trick for acquisition functionscited by 61
5 more
- 2022Graph Filters for Signal Processing and Machine Learning on Graphscited by 53
- 2023Protein Discovery with Discrete Walk-Jump Samplingcited by 38
- 2022Plug & Play Directed Evolution of Proteins with Gradient-based Discrete MCMCcited by 17
- 2023Importance Weighted Expectation-Maximization for Protein Sequence Designcited by 12
- 2023Extrapolative Controlled Sequence Generation via Iterative Refinementcited by 7
Built on by
Citing papers per year: 2024: 7; 2025: 6; 2026: 7.
20 papers.
Sort:
By area:
- 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 124
- 2025Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modelingcited by 25
- 2025Offline Model-Based Optimization: Comprehensive Reviewcited by 14
- 2024Robust Optimization in Protein Fitness Landscapes Using Reinforcement Learning in Latent Spacecited by 13
- 2024Improved Off-policy Reinforcement Learning in Biological Sequence Designcited by 13
- 2025Steering Generative Models with Experimental Data for Protein Fitness Optimizationcited by 7
- 2025Steering Protein Language Modelscited by 7
- 2024Variational Search Distributionscited by 6
- 2026Revealing Domain-Spatiality Patterns for Configuration Tuning: Domain Knowledge Meets Fitness Landscapescited by 4
- 2024Rethinking Performance Analysis for Configurable Software Systems: A Case Study from a Fitness Landscape Perspectivecited by 3
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directionscited by 3
- 2025ProSpero: Active Learning for Robust Protein Design Beyond Wild-Type Neighborhoodscited by 3
8 more
- 2026Protein Circuit Tracing via Cross-layer Transcoderscited by 3
- 2026Speaking the Language of Science: Toward a General-Purpose Generative Foundation Model for the Natural Sciencescited by 2
- 2024GROOT: Effective Design of Biological Sequences with Limited Experimental Datacited by 1
- 2024One protein is all you needcited by 0
- 2026Efficient Protein Optimization via Structure-aware Hamiltonian Dynamicscited by 0
- 2026Repurposing Protein Language Models for Latent Flow-Based Fitness Optimizationcited by 0
- 2026Feedback-Calibrated Protein Optimization with Batch-Aligned Tail Arbitrationcited by 0
- 2026Structure-aware Reinforcement Learning for Protein Directed Evolutioncited by 0
- 2026Structure-aware Reinforcement Learning for Protein Directed Evolution30 Sep 2026
- 2026Feedback-Calibrated Protein Optimization with Batch-Aligned Tail Arbitration29 Sep 2026
- 2026Speaking the Language of Science: Toward a General-Purpose Generative Foundation Model for the Natural Sciences15 Jun 2026
- 2026Revealing Domain-Spatiality Patterns for Configuration Tuning: Domain Knowledge Meets Fitness Landscapes20 Mar 2026
- 2026Protein Circuit Tracing via Cross-layer Transcoders12 Feb 2026
- 2026Repurposing Protein Language Models for Latent Flow-Based Fitness Optimization2 Feb 2026
- 2026Efficient Protein Optimization via Structure-aware Hamiltonian Dynamics16 Jan 2026
- 2025Steering Protein Language Models1 Jul 2025
- 2025ProSpero: Active Learning for Robust Protein Design Beyond Wild-Type Neighborhoods28 May 2025
- 2025Steering Generative Models with Experimental Data for Protein Fitness Optimization21 May 2025
- 2025Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling14 Apr 2025
- 2025Offline Model-Based Optimization: Comprehensive Review21 Mar 2025
8 more
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directions20 Mar 2025
- 2024Rethinking Performance Analysis for Configurable Software Systems: A Case Study from a Fitness Landscape Perspective22 Dec 2024
- 2024GROOT: Effective Design of Biological Sequences with Limited Experimental Data18 Nov 2024
- 2024One protein is all you need4 Nov 2024
- 2024Improved Off-policy Reinforcement Learning in Biological Sequence Design6 Oct 2024
- 2024Variational Search Distributions10 Sep 2024
- 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Models3 Jun 2024
- 2024Robust Optimization in Protein Fitness Landscapes Using Reinforcement Learning in Latent Space29 May 2024
- 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 124
- 2025Offline Model-Based Optimization: Comprehensive Reviewcited by 14
- 2024Robust Optimization in Protein Fitness Landscapes Using Reinforcement Learning in Latent Spacecited by 13
- 2024Improved Off-policy Reinforcement Learning in Biological Sequence Designcited by 13
- 2025Steering Protein Language Modelscited by 7
- 2024Variational Search Distributionscited by 6
- 2026Revealing Domain-Spatiality Patterns for Configuration Tuning: Domain Knowledge Meets Fitness Landscapescited by 4
- 2024Rethinking Performance Analysis for Configurable Software Systems: A Case Study from a Fitness Landscape Perspectivecited by 3
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directionscited by 3
- 2025ProSpero: Active Learning for Robust Protein Design Beyond Wild-Type Neighborhoodscited by 3
- 2026Protein Circuit Tracing via Cross-layer Transcoderscited by 3
- 2026Speaking the Language of Science: Toward a General-Purpose Generative Foundation Model for the Natural Sciencescited by 2
12 most cited of 18 All 18 (JSON)
- 2026Structure-aware Reinforcement Learning for Protein Directed Evolution30 Sep 2026
- 2026Feedback-Calibrated Protein Optimization with Batch-Aligned Tail Arbitration29 Sep 2026
- 2026Speaking the Language of Science: Toward a General-Purpose Generative Foundation Model for the Natural Sciences15 Jun 2026
- 2026Revealing Domain-Spatiality Patterns for Configuration Tuning: Domain Knowledge Meets Fitness Landscapes20 Mar 2026
- 2026Protein Circuit Tracing via Cross-layer Transcoders12 Feb 2026
- 2026Repurposing Protein Language Models for Latent Flow-Based Fitness Optimization2 Feb 2026
- 2026Efficient Protein Optimization via Structure-aware Hamiltonian Dynamics16 Jan 2026
- 2025Steering Protein Language Models1 Jul 2025
- 2025ProSpero: Active Learning for Robust Protein Design Beyond Wild-Type Neighborhoods28 May 2025
- 2025Offline Model-Based Optimization: Comprehensive Review21 Mar 2025
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directions20 Mar 2025
- 2024Rethinking Performance Analysis for Configurable Software Systems: A Case Study from a Fitness Landscape Perspective22 Dec 2024
12 newest of 18 All 18 (JSON)