mlsanityData to 7 Oct 2026

Cross-Family Universality of Behavioral Axes via Anchor-Projected Representations

arXiv 2605.09875 ↗First posted 11 May 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models from different families use different hidden dimensions, tokenizers, and training procedures, making behavioral directions difficult to compare or transfer across models. We introduce an anchor-projection framework that maps hidden representations from each model into a shared anchor coordinate space (ACS). Behavioral directions extracted from source models are projected into ACS and averaged into a canonical direction. For a new model, the canonical direction is reconstructed into its native hidden space using only anchor activations, without fine-tuning or target-specific direction extraction. We evaluate five instruction-tuned model families and ten behavioral axes. We find that same-axis directions align tightly across the Llama-Qwen-Mistral-Phi (LQMP) cluster in ACS. This shared structure transfers to downstream tasks. For the aligned LQMP cluster, held-out targets achieve (0.83) ten-way detection accuracy and (0.95) mean binary AUROC, while canonical steering induces refusal-rate shifts of up to +0.46% under distribution shift. Sensitivity analyses show that two source models and small anchor pools already suffice to approximate transferable directions. Overall, ACS provides a novel perspective on cross-family interpretability, revealing that representation-level transfer remains robust across model families.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

22 of 34 references.

References · 22

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  4. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  5. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  6. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  7. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  8. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  9. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  10. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  11. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  12. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
10 more
  1. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  2. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  3. 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
  4. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  5. 2019Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classificationcited by 396
  6. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  7. 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 217
  8. 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Modelscited by 206
  9. 2021Revisiting Model Stitching to Compare Neural Representationscited by 203
  10. 2022TimeLMs: Diachronic Language Models from Twittercited by 129

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.