mlsanityData to 14 Oct 2026

Structure-aware Reinforcement Learning for Protein Directed Evolution

arXiv 2609.39048 ↗First posted 30 Sep 2026cs.LG cs.AIcited by 0

New in Deep reinforcement learning methods; no direction yet. Deep reinforcement learning methods

Abstract (arXiv)

Protein optimization remains a longstanding goal in life sciences. Existing machine learning-assisted directed evolution (MLDE) methods primarily rely on sequence-only features, overlooking the critical spatial constraints and co-evolutionary interactions encoded in protein structures. However, directly integrating structural information remains challenging due to the scarcity of reliable mutant structures. To address these issues, we propose StructEvo, a novel structure-aware reinforcement learning framework for protein directed evolution. StructEvo employs a delta-structure fusion encoder to approximate mutant structure features via feature differences, enabling dynamic incorporation of spatial knowledge. The vast mutation space is then decomposed into manageable subspaces through a structure-aligned hierarchical action network, while a geometric constraint further stabilizes delta feature learning. Our approach outperforms prior state-of-the-art methods by 9.2% and 16.3% on two challenging optimization benchmarks, and further identifies an experimentally validated epistasis pattern in GFP, highlighting the importance of structural guidance for effective protein directed evolution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 73 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

21 of 73 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  4. 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 392
  5. 2022Biological Sequence Design with GFlowNetscited by 174
  6. 2019Conditioning by adaptive sampling for robust designcited by 111
  7. 2018Lipschitz Continuity in Model-based Reinforcement Learningcited by 91
  8. 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
  9. 2020AdaLead: A simple and robust adaptive greedy search algorithm for sequence designcited by 65
  10. 2017The reparameterization trick for acquisition functionscited by 63
  11. 2023Protein Discovery with Discrete Walk-Jump Samplingcited by 38
  12. 2022Structure-aware Protein Self-supervised Learningcited by 33
9 more
  1. 2018Design by adaptive samplingcited by 32
  2. 2022Contrastive Representation Learning for 3D Protein Structurescited by 30
  3. 2023Improving Protein Optimization with Smoothed Fitness Landscapescited by 21
  4. 2024Robust Optimization in Protein Fitness Landscapes Using Reinforcement Learning in Latent Spacecited by 13
  5. 2024Improved Off-policy Reinforcement Learning in Biological Sequence Designcited by 13
  6. 2024Multi-Scale Representation Learning for Protein Fitness Predictioncited by 11
  7. 2024ScaleFold: Reducing AlphaFold Initial Training Time to 10 Hourscited by 8
  8. 2025A Variational Perspective on Generative Protein Fitness Optimizationcited by 4
  9. 2024MutaPLM: Protein Language Modeling for Mutation Explanation and Engineeringcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Model-based reinforcement learning for protein backbone design
  2. 2025Boosting In-Silicon Directed Evolution with Fine-Tuned Protein Language Model and Tree Search
  3. 2024MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Training
  4. 2026TriFit: Trimodal Fusion with Protein Dynamics for Mutation Fitness Prediction
  5. 2025Evolutionary Profiles for Protein Fitness Prediction
  6. 2026Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets
  7. 2024Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
  8. 2025From Supervision to Exploration: What Does Protein Language Model Learn During Reinforcement Learning?