mlsanityData to 7 Oct 2026

Triangle Multiplication Is All You Need For Biomolecular Structure Representations

arXiv 2510.18870 ↗First posted 21 Oct 2025q-bio.QM cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

AlphaFold has transformed protein structure prediction, but emerging applications such as virtual ligand screening, proteome-wide folding, and de novo binder design demand predictions at a massive scale, where runtime and memory costs become prohibitive. A major bottleneck lies in the Pairformer backbone of AlphaFold3-style models, which relies on computationally expensive triangular primitives-especially triangle attention-for pairwise reasoning. We introduce Pairmixer, a streamlined alternative that eliminates triangle attention while preserving higher-order geometric reasoning capabilities that are critical for structure prediction. Pairmixer substantially improves computational efficiency, matching state-of-the-art structure predictors across folding and docking benchmarks, delivering up to 4x faster inference on long sequences while reducing training cost by 34%. Its efficiency alleviates the computational burden of downstream applications such as modeling large protein complexes, high-throughput ligand and binder screening, and hallucination-based design. Within BoltzDesign, for example, Pairmixer delivers over 2x faster sampling and scales to sequences ~30% longer than the memory limits of Pairformer. Code is available at https://github.com/genesistherapeutics/pairmixer.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 10 of its 54 references that are in the map. First posted on arXiv 21 Oct 2025.

Builds on

10 of 54 references.

References · 10

  1. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  2. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 388
  3. 2019Axial Attention in Multidimensional Transformerscited by 350
  4. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
  5. 2023Representational Strengths and Limitations of Transformerscited by 132
  6. 2021An Attention Free Transformercited by 111
  7. 2025Proteina: Scaling Flow-based Protein Structure Generative Modelscited by 63
  8. 2024Out of Many, One: Designing and Scaffolding Proteins at the Scale of the Structural Universe with Genie 2cited by 33
  9. 2025SimpleFold: Folding Proteins is Simpler than You Thinkcited by 16
  10. 2025Fast and Simplex: 2-Simplicial Attention in Tritoncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Protenix-Mini+: efficient structure prediction model with scalable pairformer
  2. 2026Scaling Atomistic Protein Binder Design with Generative Pretraining and Test-Time Compute
  3. 2025Protenix-Mini: Efficient Structure Predictor via Compact Architecture, Few-Step Diffusion and Switchable pLM
  4. 2025CONFIDE: Hallucination Assessment for Reliable Biomolecular Structure Prediction and Design
  5. 2026Rigidity-Aware Geometric Pretraining for Protein Design and Conformational Ensembles
  6. 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactions
  7. 2025Learning conformational ensembles of proteins based on backbone geometry
  8. 2026Does Learning Protein Folding Generalize to Broader Reasoning?