# Feature Gradient Flow for Interpreting Deep Neural Networks in Head and Neck Cancer Prediction

arXiv: https://arxiv.org/abs/2307.13061 · HTML: https://mlsanity.com/paper/2307.13061/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 6 of its 10 references that are in the map.
- First posted on arXiv 24 Jul 2023.

## Builds on (most cited first, 6 of 6)

- [Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization](https://mlsanity.com/paper/1610.02391/) (2016)
- ["Why Should I Trust You?": Explaining the Predictions of Any Classifier](https://mlsanity.com/paper/1602.04938/) (2016)
- [Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)](https://mlsanity.com/paper/1711.11279/) (2017)
- [Explaining Explanations: An Overview of Interpretability of Machine Learning](https://mlsanity.com/paper/1806.00069/) (2018)
- [Interpreting CNNs via Decision Trees](https://mlsanity.com/paper/1802.00121/) (2018)
- [Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer](https://mlsanity.com/paper/1703.08516/) (2017)

## Built on by (most cited first, 1 of 1)

- [Measuring Feature Dependency of Neural Networks by Collapsing Feature Dimensions in the Data Manifold](https://mlsanity.com/paper/2404.12341/) (2024)

## Abstract (arXiv)

This paper introduces feature gradient flow, a new technique for interpreting deep learning models in terms of features that are understandable to humans. The gradient flow of a model locally defines nonlinear coordinates in the input data space representing the information the model is using to make its decisions. Our idea is to measure the agreement of interpretable features with the gradient flow of a model. To then evaluate the importance of a particular feature to the model, we compare that feature's gradient flow measure versus that of a baseline noise feature. We then develop a technique for training neural networks to be more interpretable by adding a regularization term to the loss function that encourages the model gradients to align with those of chosen interpretable features. We test our method in a convolutional neural network prediction of distant metastasis of head and neck cancer from a computed tomography dataset from the Cancer Imaging Archive.