mlsanityData to 14 Oct 2026

NObSP: Functional Decomposition of Neural Networks via Oblique Subspace Projections

arXiv 2609.17825 ↗First posted 15 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding how deep neural networks make decisions remains a fundamental challenge. We present NObSP (Nonlinear Oblique Subspace Projections), a framework that decomposes predictions into explicit per feature contribution functions and an interaction residual. NObSP exploits the linear final layer of a trained network and uses oblique projections in sample space to reduce double counting when learned feature subspaces overlap, thereby supporting both local explanations and global functional analysis. We establish connections to functional ANOVA and the Kolmogorov-Arnold representation theorem and derive an efficient partial regression algorithm for out of sample evaluation. For convolutional networks, NObSP-CAM produces class activation maps without backward passes after a one time calibration. Experiments on tabular and vision benchmarks show faithfulness comparable to established attribution methods. On a synthetic benchmark with known component functions, NObSP obtains a Function Reproduction Score of 0.989, compared with 0.966 for KernelSHAP and 0.922 for Integrated Gradients. On TinyImageNet, contribution vector embeddings improve mean nearest neighbor class purity from 0.654 for raw activations to 0.713 and reduce mean neighbor distance by more than half. These results indicate that NObSP complements scalar attribution methods by recovering functional contribution profiles with separable positive and negative evidence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

25 of 40 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  7. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  8. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  9. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  10. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  11. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  12. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
13 more
  1. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  2. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  3. 2022Toy Models of Superpositioncited by 971
  4. 2020Designing Network Design Spacescited by 960
  5. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
  6. 2016The Mythos of Model Interpretabilitycited by 721
  7. 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
  8. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
  9. 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 344
  10. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
  11. 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 213
  12. 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 189
  13. 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171

Built on by

Not cited yet.