The Standard Interpretable Model: A general theory of interpretable machine learning to deductively design interpretable methods using Lagrangian mechanics
Not on the map. Why?
Abstract (arXiv)
As Artificial Intelligence models grow in complexity, interpretability has become an indispensable tool for understanding, debugging, and controlling their computations. However, interpretability lacks general theories to deductively design interpretable methods. This gap between theories and methods results in a fragmented literature and inconsistent evaluation protocols. To fill this gap, we introduce the Standard Interpretable Model (SIM), a general theory grounded in Lagrangian mechanics that enables the deductive design of interpretable methods. Specifically, the SIM summarises, in a set of premises, what interpretability is for a target user. From these premises, the SIM systematically derives interpretability symmetries and corresponding constraints, which shape the landscape of a Lagrangian whose minima correspond to optimal interpretable models. To reach the minima, one can either update the parameter values of an opaque model to make it more interpretable or compile constraints into an interpretable architecture. We empirically show that the SIM identifies and solves limitations of existing methods (including traditional, concept-based, and mechanistic interpretability), highlights underexplored research directions, and informs the design of core programming interfaces. Beyond being a research method, the deductive nature of the SIM offers pedagogical grounding for interpretability curricula and may shift the scientific community's perspective of a discipline that has long been fragmented.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 133 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
23 of 133 references.
References · 23
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 373
- 2017The (Un)reliability of saliency methodscited by 333
- 2025AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoderscited by 218
- 2013k-Sparse Autoencoderscited by 215
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 98
- 2023A Closer Look at the Intervention Procedure of Concept Bottleneck Modelscited by 64
- 2024Stochastic Concept Bottleneck Modelscited by 51
11 more
- 2017Imposing Hard Constraints on Deep Networks: Promises and Limitationscited by 43
- 2024HardNet: Hard-Constrained Neural Networks with Universal Approximation Guaranteescited by 31
- 2024Causal Concept Graph Models: Beyond Causal Opacity in Deep Learningcited by 29
- 2024Towards Compositional Interpretability for XAIcited by 12
- 2019Towards Automatic Concept-based Explanationscited by 11
- 2025There Was Never a Bottleneck in Concept Bottleneck Modelscited by 8
- 2026Interpretability Can Be Actionablecited by 7
- 2025Foundations of Interpretable Modelscited by 4
- 2025Physics of Learning: A Lagrangian perspective to different learning paradigmscited by 3
- 2026Don't Lose Focus: Activation Steering via Key-Orthogonal Projectionscited by 3
- 2026Prototype-Grounded Concept Models for Verifiable Concept Alignmentcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Graphical Design of Interpretable Architecturescited by 0
- 2026Graphical Design of Interpretable Architectures19 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Unboxing the Black Box: Mechanistic Interpretability for Algorithmic Understanding of Neural Networks
- 2025Explainable artificial intelligence (XAI): from inherent explainability to large language models
- 2025Mechanistic Interpretability Needs Philosophy
- 2025Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii
- 2025A Mathematical Philosophy of Explanations in Mechanistic Interpretability -- The Strange Science Part I.i
- 2025Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability
- 2024Towards Unifying Interpretability and Control: Evaluation via Intervention
- 2026Tracking Equivalent Mechanistic Interpretations Across Neural Networks