Multi-Resolution Attribution from Adaptive Routing State
Not on the map. Why?
Abstract (arXiv)
Adaptive hierarchical systems accumulate routing state as they learn which components to select. We show that this state already defines a coherent attribution over the hierarchy. A leaf receives the product of the local routing weights on its path, while an internal node receives the corresponding prefix product. The same learned state can therefore be read consistently at group and component levels, and every finer readout sums exactly to its coarser counterpart. This attribution describes the preferences learned by the deployed router rather than an intrinsic or counterfactual value of a component. Across LLM, Census, agentic, and telecom-network hierarchies, the learned state contains meaningful structure at several levels, and the clearest organisation need not occur at the leaves. In the telecom study, Site- or Region-level readouts usually reveal clearer structure than Cell-level readouts. Comparison with Shapley attribution can then show whether the preferences learned in deployment match capabilities revealed by counterfactual coalitions. The result is a hierarchical explanation that requires no separate attribution model: the same routing state supports consistent explanations at several levels of the system.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
17 of 27 references.
References · 17
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2019Attention is not Explanationcited by 929
5 more
- 2019Attention is not not Explanationcited by 636
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 337
- 2022Algorithms to estimate Shapley value feature attributionscited by 115
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Evidence for Shared Routing Geometry and Dynamics in Sparse Mixture-of-Experts
- 2026Map Users and Mapmakers: The Scope of Cognitive Attribution from Acquired Representations
- 2026From Sampled Outcomes to Capability Distributions: Rethinking Supervision for LLM Routing
- 2026Router Prior Bias: Preserving Base Routing Structure in MoE Post-Training
- 2026A Persistent State for Auditable Mixture-of-Experts Routing
- 2026Playing the network backward: A Game Theoretic Attribution Framework
- 2026Detecting an Effect Is Not Learning to Act on It: A Reward-SNR Floor for LLM Acquisition Agents
- 2026Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web Agents