mlsanityData to 14 Oct 2026

AMix-1: A Pathway to Test-Time Scalable Protein Foundation Model

arXiv 2507.08920 ↗First posted 11 Jul 2025q-bio.BM cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce AMix-1, a powerful protein foundation model built on Bayesian Flow Networks and empowered by a systematic training methodology, encompassing pretraining scaling laws, emergent capability analysis, in-context learning mechanism, and test-time scaling algorithm. To guarantee robust scalability, we establish a predictive scaling law and reveal the progressive emergence of structural understanding via loss perspective, culminating in a strong 1.7-billion model. Building on this foundation, we devise a multiple sequence alignment (MSA)-based in-context learning strategy to unify protein design into a general framework, where AMix-1 recognizes deep evolutionary signals among MSAs and consistently generates structurally and functionally coherent proteins. This framework enables the successful design of a dramatically improved AmeR variant with an up to 50× activity increase over its wild type. Pushing the boundaries of protein engineering, we further empower AMix-1 with an evolutionary test-time scaling algorithm for in silico directed evolution that delivers substantial, scalable performance gains as verification budgets are intensified, laying the groundwork for next-generation lab-in-the-loop protein design.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 59 references that are in the map. First posted on arXiv 11 Jul 2025.

Builds on

21 of 59 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  8. 2022Emergent Abilities of Large Language Modelscited by 2,512
  9. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  10. 2025s1: Simple test-time scalingcited by 1,341
  11. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  12. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
9 more
  1. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
  2. 2024Diffusion Language Models Are Versatile Protein Learnerscited by 98
  3. 2024Understanding Emergent Abilities of Language Models from the Loss Perspectivecited by 94
  4. 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
  5. 2023Bayesian Flow Networkscited by 63
  6. 2024MolCRAFT: Structure-Based Drug Design in Continuous Parameter Spacecited by 48
  7. 2024Scaling Laws For Diffusion Transformerscited by 44
  8. 2022HelixFold-Single: MSA-free Protein Structure Prediction by Using Protein Language Model as an Alternativecited by 15
  9. 2024Scaling Properties of Diffusion Models for Perceptual Taskscited by 15

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AMix-2: Establishing Protein as a Native Modality in Large Language Models
  2. 2025Boosting In-Silicon Directed Evolution with Fine-Tuned Protein Language Model and Tree Search
  3. 2026TriFit: Trimodal Fusion with Protein Dynamics for Mutation Fitness Prediction
  4. 2025Swarms of Large Language Model Agents for Protein Sequence Design with Experimental Validation
  5. 2026Scaling Atomistic Protein Binder Design with Generative Pretraining and Test-Time Compute
  6. 2024Sequence-Augmented SE(3)-Flow Matching For Conditional Protein Backbone Generation
  7. 2024Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
  8. 2026EvoFlows: Evolutionary Edit-Based Flow-Matching for Protein Engineering