AMix-2: Establishing Protein as a Native Modality in Large Language Models
Not on the map. Why?
Abstract (arXiv)
We present AMix-2, a protein-text foundation model that establishes protein as a native modality in large language models (LLMs), unifying protein understanding and sequence design within a single foundation model. AMix-2 is built upon two key ideas: (1) a unified protein-text formulation that embeds natural language and protein sequence in a shared token space, enabling one model to perform biological reasoning and conditional design instead of separate downstream task-specialized models; and (2) a block-wise diffusion language modeling backbone that combines causal generation across blocks with bidirectional context and iterative refinement within blocks. This scheme better matches the intrinsic nature of proteins than a strict left-to-right factorization. To evaluate protein foundation models under realistic generalization settings, we further introduce ProteinArena, a comprehensive benchmark with time-aware and homology-aware protocols across various understanding and design tasks, and with baselines covering classical bioinformatics tools, protein-specialized models and LLMs. On ProteinArena, AMix-2 outperforms frontier LLMs and demonstrates competitive performance to task-specific protein models. Controlled experiments further show that the diffusion-based paradigm generally surpasses its autoregressive counterpart, highlighting the advantage of flexible generation order for protein sequences. We release both AMix-2 and ProteinArena to facilitate open research in protein foundation models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 70 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
29 of 70 references.
References · 29
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025Large Language Diffusion Modelscited by 912
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
- 2019Evaluating Protein Transfer Learning with TAPEcited by 231
17 more
- 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 178
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 159
- 2020ProGen: Language Modeling for Protein Generationcited by 128
- 2024Diffusion Language Models Are Versatile Protein Learnerscited by 98
- 2022PEER: A Comprehensive and Multi-Task Benchmark for Protein Sequence Understandingcited by 77
- 2023A Text-guided Protein Design Frameworkcited by 64
- 2024DPLM-2: A Multimodal Diffusion Protein Language Modelcited by 64
- 2025BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Modelcited by 37
- 2025Nature Language Model: Deciphering the Language of Nature for Scientific Discoverycited by 36
- 2025Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Modelscited by 34
- 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 17
- 2025Elucidating the Design Space of Multimodal Protein Language Modelscited by 11
- 2025CFP-Gen: Combinatorial Functional Protein Generation via Diffusion Language Modelscited by 8
- 2024CARE: a Benchmark Suite for the Classification and Retrieval of Enzymescited by 7
- 2025Protein Design with Dynamic Protein Vocabularycited by 5
- 2025PDFBench: A Benchmark for De novo Protein Design from Functioncited by 5
- 2026Towards A Generative Protein Evolution Machine with DPLM-Evocited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024TourSynbio: A Multi-Modal Large Model and Agent Framework to Bridge Text and Protein Sequences for Protein Engineering
- 2026Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
- 2025ProtTeX: Structure-In-Context Reasoning and Editing of Proteins with Large Language Models
- 2023InstructProtein: Aligning Human and Protein Language via Knowledge Instruction
- 2025HD-Prot: A Protein Language Model for Joint Sequence-Structure Modeling with Continuous Structure Tokens
- 2025Rethinking Text-based Protein Understanding: Retrieval or LLM?
- 2025Interpreting and Steering Protein Language Models through Sparse Autoencoders
- 2024ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding