mlsanityData to 7 Oct 2026

One Adapter Pair per Model: A Universal Activation Interface for Language Models

arXiv 2608.09521 ↗First posted 10 Aug 2026cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Activation-based tools are usually tied to one model's native hidden space, requiring probes, sparse autoencoders, and natural-language interpreters to be rebuilt or rediscovered for each new language model. We present a Universal Activation Bus, a framework that provides a common activation interface across compatible language models. Using a small set of source models, we learn a shared dense space together with one lightweight linear encoder--decoder adapter pair per model. After source training, the interface is frozen; a new model joins by fitting only its adapter pair on unlabeled matched text. The resulting interface allows activation-based tools to be shared across connected models, including common probes and SAE features as well as access to an NLA originally trained for a different model. Across five models, semantically related texts form consistent neighborhoods in the shared space, and an onboarded model reuses these tools effectively without retraining them. We further show that an intermediate activation from one model can be used by another model's frozen upper layers to produce predictions. These results establish a stable, model-wise activation contract for reusable tools across compatible language models.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

14 of 22 references.

References · 14

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  3. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  4. 2021Revisiting Model Stitching to Compare Neural Representationscited by 203
  5. 2022Relative representations enable zero-shot latent space communicationcited by 175
  6. 2015Optimal whitening and decorrelationcited by 93
  7. 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
  8. 2025Transferring Linear Features Across Language Models With Model Stitchingcited by 17
  9. 2025SPARC: Concept-Aligned Sparse Autoencoders for Cross-Model and Cross-Modal Interpretabilitycited by 7
  10. 2025Atlas-Alignment: Making Interpretability Transferable Across Language Modelscited by 3
  11. 2026Ventriloquist LLMs: Linear Alignment of Late-Stage Representationscited by 3
  12. 2026A Negative Result on Cross-Model Activation Transfer in a Pythia Multi-Hop Settingcited by 3
2 more
  1. 2026Universal Activation Verbalizer: A Unified Framework for Cross-Model Activation Explanationcited by 2
  2. 2026Cross-Family Universality of Behavioral Axes via Anchor-Projected Representationscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.