Enhancing Interpretability of Vertebrae Fracture Grading using Human-interpretable Prototypes
Not on the map. Why?
Abstract (arXiv)
Vertebral fracture grading classifies the severity of vertebral fractures, which is a challenging task in medical imaging and has recently attracted Deep Learning (DL) models. Only a few works attempted to make such models human-interpretable despite the need for transparency and trustworthiness in critical use cases like DL-assisted medical diagnosis. Moreover, such models either rely on post-hoc methods or additional annotations. In this work, we propose a novel interpretable-by-design method, ProtoVerse, to find relevant sub-parts of vertebral fractures (prototypes) that reliably explain the model's decision in a human-understandable way. Specifically, we introduce a novel diversity-promoting loss to mitigate prototype repetitions in small datasets with intricate semantics. We have experimented with the VerSe'19 dataset and outperformed the existing prototype-based method. Further, our model provides superior interpretability against the post-hoc method. Importantly, expert radiologists validated the visual interpretability of our results, showing clinical applicability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 3 Apr 2024.
Builds on
37 of 57 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2020Concept Bottleneck Modelscited by 1,022
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 731
- 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
- 2020Neural Prototype Trees for Interpretable Fine-grained Image Recognitioncited by 213
- 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
25 more
- 2018Net2Vec: Quantifying and Explaining how Concepts are Encoded by Filters in Deep Neural Networkscited by 128
- 2021Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypescited by 120
- 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
- 2019Towards Explainable Artificial Intelligencecited by 106
- 2021XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanationscited by 72
- 2019Understanding Neural Networks via Feature Visualization: A surveycited by 65
- 2021This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networkscited by 65
- 2020Now You See Me (CME): Concept-based Model Extractioncited by 51
- 2021This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagationcited by 43
- 2023Learning Support and Trivial Prototypes for Interpretable Image Classificationcited by 38
- 2022Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networkscited by 37
- 2022Concept Embedding Analysis: A Reviewcited by 20
- 2023Pixel-Grounded Prototypical Part Networkscited by 18
- 2023Right for the Wrong Reason: Can Interpretable ML Techniques Detect Spurious Correlations?cited by 16
- 2023MProtoNet: A Case-Based Interpretable Model for Brain Tumor Classification with 3D Multi-parametric Magnetic Resonance Imagingcited by 11
- 2019Detection of vertebral fractures in CT using 3D Convolutional Neural Networkscited by 9
- 2020Keypoints Localization for Joint Vertebra Detection and Fracture Severity Quantificationcited by 8
- 2020Grading Loss: A Fracture Grade-based Metric Loss for Vertebral Fracture Detectioncited by 8
- 2022Interpretable Vertebral Fracture Quantification via Anchor-Free Landmarks Localizationcited by 8
- 2017Compression Fractures Detection on CTcited by 5
- 20203D Convolutional Sequence to Sequence Model for Vertebral Compression Fractures Identification in CTcited by 5
- 2022Interpretable Vertebral Fracture Diagnosiscited by 4
- 2022Towards Human-Interpretable Prototypes for Visual Assessment of Image Classification Modelscited by 4
- 2020Two-Stream Compare and Contrast Network for Vertebral Compression Fracture Diagnosiscited by 3
- 2023Semantic Latent Space Regression of Diffusion Autoencoders for Vertebral Fracture Gradingcited by 2
Built on by
Not cited yet.