Evolutionary Profiles for Protein Fitness Prediction
Not on the map. Why?
Abstract (arXiv)
Predicting the fitness impact of mutations is central to protein engineering but constrained by limited assays relative to the size of sequence space. Protein language models (pLMs) trained with masked language modeling (MLM) exhibit strong zero-shot fitness prediction; we provide a unifying view by interpreting natural evolution as implicit reward maximization and MLM as inverse reinforcement learning (IRL), in which extant sequences act as expert demonstrations and pLM log-odds serve as fitness estimates. Building on this perspective, we introduce EvoIF, a lightweight model that integrates two complementary sources of evolutionary signal: (i) within-family profiles from retrieved homologs and (ii) cross-family structural-evolutionary constraints distilled from inverse folding logits. EvoIF fuses sequence-structure representations with these profiles via a compact transition block, yielding calibrated probabilities for log-odds scoring. On ProteinGym (217 mutational assays; >2.5M mutants), EvoIF and its MSA-enabled variant achieve state-of-the-art or competitive performance while using only 0.15% of the training data and fewer parameters than recent large models. Ablations confirm that within-family and cross-family profiles are complementary, improving robustness across function types, MSA depths, taxa, and mutation depths. The codes will be made publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 55 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
11 of 55 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 313
- 2025Deep Think with Confidencecited by 205
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 159
- 2024Diffusion Language Models Are Versatile Protein Learnerscited by 98
- 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
- 2025The Majority is not always right: RL training for solution aggregationcited by 47
- 2025ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Computecited by 38
- 2024Multi-Scale Representation Learning for Protein Fitness Predictioncited by 11
- 2024Retrieval-Enhanced Mutation Mastery: Augmenting Zero-Shot Prediction of Protein Language Modelcited by 7
- 2025AMix-1: A Pathway to Test-Time Scalable Protein Foundation Modelcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Reinforcement Learning for Sequence Design Leveraging Protein Language Models
- 2026EvoFlows: Evolutionary Edit-Based Flow-Matching for Protein Engineering
- 2026Towards A Generative Protein Evolution Machine with DPLM-Evo
- 2026Repurposing Protein Language Models for Latent Flow-Based Fitness Optimization
- 2025Boosting In-Silicon Directed Evolution with Fine-Tuned Protein Language Model and Tree Search
- 2024Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
- 2025Sparse Autoencoders for Low-N Protein Function Prediction and Design
- 2026No Generation without Representation: Efficient Causal Protein Language Models Enable Zero-Shot Fitness Estimation