mlsanityData to 14 Oct 2026

Protenix-Mini+: efficient structure prediction model with scalable pairformer

arXiv 2510.12842 ↗First posted 13 Oct 2025q-bio.QM cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Lightweight inference is critical for biomolecular structure prediction and downstream tasks, enabling efficient real-world deployment and inference-time scaling for large-scale applications. While AF3 and its variants (e.g., Protenix, Chai-1) have advanced structure prediction results, they suffer from critical limitations: high inference latency and cubic time complexity with respect to token count, both of which restrict scalability for large biomolecular complexes. To address the core challenge of balancing model efficiency and prediction accuracy, we introduce three key innovations: (1) compressing non-scalable operations to mitigate cubic time complexity, (2) removing redundant blocks across modules to reduce unnecessary overhead, and (3) adopting a few-step sampler for the atom diffusion module to accelerate inference. Building on these design principles, we develop Protenix-Mini+, a highly lightweight and scalable variant of the Protenix model. Within an acceptable range of performance degradation, it substantially improves computational efficiency. For example, in the case of low-homology single-chain proteins, Protenix-Mini+ experiences an intra-protein LDDT drop of approximately 3% relative to the full Protenix model -- an acceptable performance trade-off given its substantially 90%+ improved computational efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 13 Oct 2025.

Builds on

20 of 38 references.

References · 20

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  4. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  5. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  7. 2023Consistency Modelscited by 1,822
  8. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  9. 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 738
  10. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
  11. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  12. 2018Efficient Attention: Attention with Linear Complexitiescited by 368
8 more
  1. 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
  2. 2023A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendationscited by 202
  3. 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generationcited by 150
  4. 2024The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicrycited by 120
  5. 2019Are All Layers Created Equal?cited by 94
  6. 2020Good Subnetworks Provably Exist: Pruning via Greedy Forward Selectioncited by 70
  7. 2019Pad'e Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networkscited by 67
  8. 2025Protenix-Mini: Efficient Structure Predictor via Compact Architecture, Few-Step Diffusion and Switchable pLMcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ProtTeX: Structure-In-Context Reasoning and Editing of Proteins with Large Language Models
  2. 2025Triangle Multiplication Is All You Need For Biomolecular Structure Representations
  3. 2025Unlocking hidden biomolecular conformational landscapes in diffusion models at inference time
  4. 2025LightNobel: Improving Sequence Length Limitation in Protein Structure Prediction Model via Adaptive Activation Quantization
  5. 2026ProtStructQA: A Denotation Threshold in Protein Structural Reasoning
  6. 2026Scaling Atomistic Protein Binder Design with Generative Pretraining and Test-Time Compute
  7. 2025Protein Structure Tokenization: Benchmarking and New Recipe
  8. 2025SimpleFold: Folding Proteins is Simpler than You Think