mlsanityData to 14 Oct 2026

Triangulation as an Acceptance Rule for Multilingual Mechanistic Interpretability

arXiv 2512.24842 ↗First posted 31 Dec 2025cs.CL stat.MLcited by 0

On the map: Mechanistic interpretability → Knowledge and representations inside LLMs

Abstract (arXiv)

Multilingual language models achieve strong aggregate performance yet often behave unpredictably across languages, scripts, and cultures. We argue that mechanistic explanations for such models should satisfy a causal standard: claims must survive causal interventions and must cross-reference across environments that perturb surface form while preserving meaning. We formalize reference families as predicate-preserving variants and introduce triangulation, an acceptance rule requiring necessity (ablating the circuit degrades the target behavior), sufficiency (patching activations transfers the behavior), and invariance (both effects remain directionally stable and of sufficient magnitude across the reference family). To supply candidate subgraphs, we adopt automatic circuit discovery and accept or reject those candidates by triangulation. We ground triangulation in causal abstraction by casting it as an approximate transformation score over a distribution of interchange interventions, connect it to the pragmatic interpretability agenda, and present a comparative experimental protocol across multiple model families, language pairs, and tasks. Triangulation provides a falsifiable standard for mechanistic claims that filters spurious circuits passing single-environment tests but failing cross-lingual invariance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge and representations inside LLMs, one of 13 directions in Mechanistic interpretability. Builds on 11 of its 22 references that are in the map. First posted on arXiv 31 Dec 2025.

Builds on

11 of 22 references.

References · 11

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  2. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  3. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  4. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 536
  5. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
  6. 2024Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanismscited by 149
  7. 2022Lifting the Curse of Multilinguality by Pre-training Modular Transformerscited by 146
  8. 2022Interventional Causal Representation Learningcited by 142
  9. 2025Position-aware Automatic Circuit Discoverycited by 14
  10. 2025Mind the Inclusivity Gap: Multilingual Gender-Neutral Translation Evaluation with mGeNTEcited by 12
  11. 2025FairTranslate: An English-French Dataset for Gender Bias Evaluation in Machine Translation by Overcoming Gender Binaritycited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causality is Key for Interpretability Claims to Generalise
  2. 2026Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models
  3. 2026When Attribution Patching Lies: Diagnosis and a Second-Order Correction
  4. 2023Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses
  5. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methods
  6. 2025CLEAR-3K: Assessing Causal Explanatory Capabilities in Language Models
  7. 2025Mechanistic Indicators of Understanding in Large Language Models
  8. 2026Causal Interventions Reveal Typologically Organized Syntactic Mechanisms in Multilingual Language Models