mlsanityData to 7 Oct 2026

Two Stages of Folding: Convergent Mechanisms in AI Protein Folding Trunks

arXiv 2602.06020 ↗First posted 5 Feb 2026cs.LG q-bio.BMcited by 2

Not on the map. Why?

Abstract (arXiv)

How do protein structure prediction models fold proteins? We investigate this question through causal interventions on the folding trunks of ESMFold, OpenFold, and Boltz-1. Across all three models, we find a shared two-stage computational structure. In the first stage, early blocks initialize pairwise biochemical signals: features like charge propagate from sequence into pairwise representations through architecture-specific pathways. In the second stage, late blocks develop pairwise spatial features: distance and contact information accumulate in the pairwise representation. We verify these mechanisms causally by showing that steering charge and distance features induces predictable structural changes. Furthermore, these representations are functionally interchangeable: pairwise states can be linearly aligned and substituted across models. Together, these results suggest that folding trunks with different architectures, inputs, and training procedures converge on a shared representational organization for mapping sequence chemistry into spatial geometry.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 11 of its 36 references that are in the map. First posted on arXiv 5 Feb 2026.

Builds on

11 of 36 references.

References · 11

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  2. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  3. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  4. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  5. 2024The Platonic Representation Hypothesiscited by 362
  6. 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 217
  7. 2024The Remarkable Robustness of LLMs: Stages of Inference?cited by 138
  8. 2024InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoderscited by 64
  9. 2025Interpreting and Steering Protein Language Models through Sparse Autoencoderscited by 16
  10. 2025SimpleFold: Folding Proteins is Simpler than You Thinkcited by 16
  11. 2021The signature and cusp geometry of hyperbolic knotscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.