mlsanityData to 14 Oct 2026

Interpretability as Alignment: Making Internal Understanding a Design Principle

arXiv 2509.08592 ↗First posted 10 Sep 2025cs.LG cs.AI cs.ETcited by 3

Not on the map. Why?

Abstract (arXiv)

Frontier AI systems require governance mechanisms that can verify internal alignment, not just behavioral compliance. Private governance mechanisms audits, certification, insurance, and procurement are emerging to complement public regulation, but they require technical substrates that generate verifiable causal evidence about model behavior. This paper argues that mechanistic interpretability provides this substrate. We frame interpretability not as post-hoc explanation but as a design constraint embedding auditability, provenance, and bounded transparency within model architectures. Integrating causal abstraction theory and empirical benchmarks such as MIB and LoBOX, we outline how interpretability-first models can underpin private assurance pipelines and role-calibrated transparency frameworks. This reframing situates interpretability as infrastructure for private AI governance bridging the gap between technical reliability and institutional accountability.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 55 references that are in the map. First posted on arXiv 10 Sep 2025.

Builds on

32 of 55 references.

References · 32

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  3. 2016Concrete Problems in AI Safetycited by 1,642
  4. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  5. 2018Sanity Checks for Saliency Mapscited by 1,156
  6. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
  7. 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
  8. 2016The Mythos of Model Interpretabilitycited by 721
  9. 2018Scalable agent alignment via reward modeling: a research directioncited by 447
  10. 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
  11. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
  12. 2017Neural-Symbolic Learning and Reasoning: A Survey and Interpretationcited by 196
20 more
  1. 2020Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Biascited by 191
  2. 2022Is Power-Seeking AI an Existential Risk?cited by 105
  3. 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcutscited by 63
  4. 2025MIB: A Mechanistic Interpretability Benchmarkcited by 56
  5. 2023Understanding accountability in algorithmic supply chainscited by 40
  6. 2025The Non-Linear Representation Dilemma: Is Causal Abstraction Enough for Mechanistic Interpretability?cited by 37
  7. 2025Everything, Everywhere, All at Once: Is Mechanistic Interpretability Identifiable?cited by 34
  8. 2023Circuit Breaking: Removing Model Behaviors with Targeted Ablationcited by 27
  9. 2025Position: Mechanistic Interpretability Should Prioritize Feature Consistency in SAEscited by 14
  10. 2025Neural ODE Transformers: Analyzing Internal Dynamics and Adaptive Fine-tuningcited by 13
  11. 2025Bridging the Gap in XAI-Why Reliable Metrics Matter for Explainability and Compliancecited by 7
  12. 2025Mechanistic Interpretability Needs Philosophycited by 6
  13. 2024Challenges in Mechanistically Interpreting Model Representationscited by 4
  14. 2020Rethinking the Role of Gradient-Based Attribution Methods for Model Interpretabilitycited by 3
  15. 2024Who Should Run Advanced AI Evaluations -- AISIs?cited by 3
  16. 2025xai_evals : A Framework for Evaluating Post-Hoc Local Explanation Methodscited by 3
  17. 2025A Framework for the Private Governance of Frontier Artificial Intelligencecited by 3
  18. 2025Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMscited by 3
  19. 2025Opacity as a Feature, Not a Flaw: The LoBOX Governance Ethic for Role-Sensitive Explainability and Institutional Trust in AIcited by 2
  20. 2025Calibrating Lightweight Sparse Autoencoder Feature Steeringcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Missing Layer: Specification Infrastructure for AI Oversight ↗
  2. 2026Radical AI Interpretability
  3. 2026AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environments
  4. 2026Governed Auditable Decisioning Under Uncertainty: Synthesis and Agentic Extension
  5. 2026Making Agent-Mediated Contributions Governable: A Project-Level Governance Manifest for Open-Source AI Collaboration
  6. 2026Governing Agentic AI in FinTech
  7. 2026Institutional AI: A Governance Framework for Distributional AGI Safety
  8. 2026Who Audits Whom, on What Substrate, with What Evidence? An Independence-Graded Audit Protocol for Agentic AI