mlsanityData to 7 Oct 2026

Located but Not Releasable: Silent Gate Inversion and Bounded Linear Release

arXiv 2608.11822 ↗First posted 12 Aug 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

A growing body of work reports that language models represent task-relevant latent structure that they fail to use. Whether such structure, once located, can be converted into behavior is a separate question that is rarely tested end to end. We submit the complete pipeline -- detect, localize, and release -- to a fully preregistered stress test on a 25.7M transformer trained on causal-evidence discrimination, where a known suppression phenomenon (latent causal structure present but behaviorally unused) has previously been documented. Every threshold, claim template, and decision-tree branch was hashed and archived before any corresponding data existed. Three findings. (i) Localization succeeds: interventions at observation-evidence channels of mid layers restore target behavior on otherwise-suppressed worlds (paired release advantages 0.563 and 0.854, 97.5% CIs excluding zero; best-site release rate 0.889). (ii) Gating fails out of distribution: a detector calibrated to trigger on zero out-of-distribution calibration worlds triggers on 6.9-7.3% of held-out in-distribution generations and on zero of the 2,400 held-out generations that actually need it -- a complete inversion that silently reduces the gated pipeline to its base model. (iii) Linear release is capped: removing the gate and injecting a per-instance linear direction unconditionally yields a monotone dose-response that plateaus far below the preregistered release margin (intercept 0.382 → 0.311 → 0.264 vs. threshold ≤ 0.08); per-instance adaptivity adds less than ± 0.03. The failure is doubly located: the detector is OOD-inverted, and the entire family of linear release directions at this site and resolution is bounded away from sufficiency. The two failures are dissociable, and neither overturns localization. Every number traces to a hashed artifact in the released audit chain.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 24 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

14 of 24 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  4. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  5. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  6. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  7. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  8. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  9. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
  10. 2019Designing and Interpreting Probes with Control Taskscited by 608
  11. 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 217
  12. 2024Analyzing the Generalization and Reliability of Steering Vectorscited by 130
2 more
  1. 2021Inducing Causal Structure for Interpretable Neural Networkscited by 107
  2. 2023CLadder: Assessing Causal Reasoning in Language Modelscited by 102

Built on by

Not cited yet.