mlsanityData to 14 Oct 2026

PLOT: Progressive Localization via Optimal Transport in Neural Causal Abstraction

arXiv 2605.06979 ↗First posted 7 May 2026cs.LG cs.AI stat.MLcited by 0

On the map: Mechanistic interpretability → Circuits and mechanistic analysis

Abstract (arXiv)

Causal abstraction offers a principled framework for mechanistic interpretability, aligning a high-level causal model with low-level neural computation through interchange intervention analysis. Finding such an alignment, however, often requires fitting and evaluating separate learned mappings across many candidate neural locations. We introduce PLOT, a gradient-free approach for joint correspondence discovery via a global matching of intervention effects. PLOT represents abstract and neural interventions by geometric signatures of their effects on the shared task output and fits an optimal transport coupling between the two collections. The coupling can be calibrated directly into an executable intervention handle or used progressively to select coarse parent sites for finer localization, reducing the cost of searching broad collections of neural sites. Experiments on hierarchical equality, binary addition, and multiple-choice question answering (MCQA) demonstrate fast and accurate direct handles without learning intervention rotations and show that progressive localization can improve accuracy under intervention-size constraints while reducing computational cost. PLOT can also guide gradient-based subspace learning, with PLOT-guided distributed alignment search (DAS) attaining accuracy comparable to full DAS at approximately 3.6× and 20× lower serial runtime on binary addition and MCQA, respectively. PLOT thus separates the search for candidate correspondences from optional subspace learning and provides a common framework for constructing and testing neural intervention handles for a given causal model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Circuits and mechanistic analysis, one of 13 directions in Mechanistic interpretability. Builds on 22 of its 34 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

22 of 34 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025MIB: A Mechanistic Interpretability Benchmark17 Apr
  2. 2025HyperDAS: Towards Automating Mechanistic Interpretability with Hypernetworks13 Mar
  3. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability11 Jan

Other references · 19

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  2. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  3. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  4. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  5. 2018Computational Optimal Transportcited by 780
  6. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  7. 2021Causal Abstractions of Neural Networkscited by 422
  8. 2023Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representationscited by 209
  9. 2023Linear Representations of Sentiment in Large Language Modelscited by 163
  10. 2017Causal Consistency of Structural Equation Modelscited by 118
  11. 2021Inducing Causal Structure for Interpretable Neural Networkscited by 110
  12. 2018Abstracting Causal Modelscited by 107
7 more
  1. 2023Interpretability at Scale: Identifying Causal Mechanisms in Alpacacited by 103
  2. 2016Scaling Algorithms for Unbalanced Transport Problemscited by 36
  3. 2024Evaluating Open-Source Sparse Autoencoders on Disentangling Factual Knowledge in GPT-2 Smallcited by 34
  4. 2023Causal Optimal Transport of Abstractionscited by 13
  5. 2016Causal optimal transport and its links to enlargement of filtrations and continuous-time stochastic optimizationcited by 11
  6. 2023Optimal transport and Wasserstein distances for causal modelscited by 9
  7. 2025Neural Estimation for Scaling Entropic Multimarginal Optimal Transportcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Predictive Memory Localization: Forecasting Selective Intervention Paths from Internal Signals
  2. 2026How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning
  3. 2025Representational Alignment Across Model Layers and Brain Regions with Multi-Level Optimal Transport
  4. 2026Faithful Bi-Directional Model Steering via Distribution Matching and Distributed Interchange Interventions
  5. 2025The Non-Linear Representation Dilemma: Is Causal Abstraction Enough for Mechanistic Interpretability?
  6. 2026MARCO: Navigating the Unseen Space of Semantic Correspondence
  7. 2026Interaction Locality in Hierarchical Recursive Reasoning
  8. 2025Evaluating Contrast Localizer for Identifying Causal Units in Social & Mathematical Tasks in Language Models