mlsanityData to 14 Oct 2026

Feature-Function Curvature Analysis: A Geometric Framework for Explaining Differentiable Models

arXiv 2510.27207 ↗First posted 31 Oct 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Explainable AI (XAI) is critical for building trust in complex machine learning models, yet mainstream attribution methods often provide an incomplete, static picture of a model's final state. By collapsing a feature's role into a single score, they are confounded by non-linearity and interactions. To address this, we introduce Feature-Function Curvature Analysis (FFCA), a novel framework that analyzes the geometry of a model's learned function. FFCA produces a 4-dimensional signature for each feature, quantifying its: (1) Impact, (2) Volatility, (3) Non-linearity, and (4) Interaction. Crucially, we extend this framework into Dynamic Archetype Analysis, which tracks the evolution of these signatures throughout the training process. This temporal view moves beyond explaining what a model learned to revealing how it learns. We provide the first direct, empirical evidence of hierarchical learning, showing that models consistently learn simple linear effects before complex interactions. Furthermore, this dynamic analysis provides novel, practical diagnostics for identifying insufficient model capacity and predicting the onset of overfitting. Our comprehensive experiments demonstrate that FFCA, through its static and dynamic components, provides the essential geometric context that transforms model explanation from simple quantification to a nuanced, trustworthy analysis of the entire learning process.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

10 of 19 references.

References · 10

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  4. 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
  5. 2019Explaining individual predictions when features are dependent: More accurate approximations to Shapley valuescited by 208
  6. 2020Problems with Shapley-value-based explanations as feature importance measurescited by 200
  7. 2020Explaining Explanations: Axiomatic Feature Interactions for Deep Networkscited by 103
  8. 2020Feature Interaction Interpretability: A Case for Explaining Ad-Recommendation Systems via Neural Interaction Detectioncited by 32
  9. 2020Explaining Local, Global, And Higher-Order Interactions In Deep Learningcited by 8
  10. 2023SmoothHess: ReLU Network Feature Interactions via Stein's Lemmacited by 5

Built on by

Not cited yet.