mlsanityData to 14 Oct 2026

Evolution-Aware MSA Reasoning for Subsampling via Factor Graphs

arXiv 2607.22314 ↗First posted 24 Jul 2026cs.LGcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Multiple Sequence Alignments (MSAs) provide protein language models with explicit evolutionary context, but their large depth makes subsampling unavoidable under limited token budgets. Existing strategies, including random selection, identity-based filtering, and diversity-driven sampling, are effective heuristics, yet provide limited control over the evolutionary signals retained in the subset. In this work, we recast MSA subsampling as an explicit optimization problem, where key evolutionary measures, including query identity and diversity, are treated as controllable objectives. Building on this view, we introduce AP-REASONER, an Affinity-Propagation-based factor-graph approach. With evolution-aware unary factors, exemplar-consistency factors, and two control knobs, AP-REASONER performs factor-graph reasoning through message passing to infer a fixed-budget MSA subset. Experiments on long-range contact prediction and conformational ensemble prediction show that AP-REASONER outperforms baseline subsamplers on structure-sensitive downstream tasks and enables controllable recovery of alternative protein conformations. These results highlight the value of modeling MSA subsampling as a controllable optimization problem, where factor-graph reasoning offers an effective alternative to heuristic selection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 5 of its 50 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

5 of 50 references.

References · 5

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 546
  3. 2019Evaluating Protein Transfer Learning with TAPEcited by 231
  4. 2020BERTology Meets Biology: Interpreting Attention in Protein Language Modelscited by 85
  5. 2023OpenProteinSet: Training data for structural biology at scalecited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Protein language models trained on multiple sequence alignments learn phylogenetic relationships
  2. 2024MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Training
  3. 2026RosettaSearch: Multi-Objective Inference-Time Search for Protein Sequence Design
  4. 2026Towards A Generative Protein Evolution Machine with DPLM-Evo
  5. 2023Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation
  6. 2025Evolutionary Profiles for Protein Fitness Prediction
  7. 2026Structure-aware Reinforcement Learning for Protein Directed Evolution
  8. 2022Generative power of a protein language model trained on multiple sequence alignments