mlsanityData to 14 Oct 2026

The Attribution Impossibility: No Feature Ranking Is Faithful, Stable, and Complete Under Collinearity

arXiv 2605.21492 ↗First posted 8 Apr 2026cs.LG cs.AI cs.LOcited by 0

Not on the map. Why?

Abstract (arXiv)

No feature ranking can be simultaneously faithful, stable, and complete when features are collinear. For collinear pairs, ranking reduces to a coin flip. We prove this impossibility, quantify it for four model classes, resolve it via ensemble averaging (DASH), and machine-verify it with 305 Lean 4 theorems. We characterize the complete attribution design space: exactly two families of methods exist -- faithful-complete methods (unstable, with rankings that flip up to 50% of the time) and ensemble methods like DASH (stable, reporting ties for symmetric features) -- and no method lies outside this dichotomy. The impossibility is quantitative: the attribution ratio diverges as 1/(1-rho^2) for gradient boosting, is infinite for Lasso, and converges for random forests. DASH (Diversified Aggregation of SHAP) is provably Pareto-optimal among unbiased aggregations, achieving the Cramer-Rao variance bound with a tight ensemble size formula. In a survey of 77 public datasets, 68% exhibit attribution instability. Switching to conditional SHAP does not escape the impossibility when features have equal causal effects. The framework includes practical diagnostics -- a Z-test workflow and single-model screening tool -- and has direct consequences for fairness auditing: SHAP-based proxy discrimination audits are provably unreliable under collinearity. The design space theorem, diagnostics, and impossibility are mechanically verified in Lean 4 (305 theorems from 16 axioms, 0 sorry) -- to our knowledge, the first formally verified impossibility in explainable AI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 32 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

3 of 32 references.

References · 3

  1. 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 159
  2. 2026AI4SLT: Empirical Processes in Lean 4 for Formal Statistical Learning Theorycited by 5
  3. 2025The Limits of AI Explainability: An Algorithmic Information Theory Approachcited by 3

Built on by

Not cited yet.