Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models
Not on the map. Why?
Abstract (arXiv)
State-of-the-art machine learning models often learn spurious correlations embedded in the training data. This poses risks when deploying these models for high-stake decision-making, such as in medical applications like skin cancer detection. To tackle this problem, we propose Reveal to Revise (R2R), a framework entailing the entire eXplainable Artificial Intelligence (XAI) life cycle, enabling practitioners to iteratively identify, mitigate, and (re-)evaluate spurious model behavior with a minimal amount of human interaction. In the first step (1), R2R reveals model weaknesses by finding outliers in attributions or through inspection of latent concepts learned by the model. Secondly (2), the responsible artifacts are detected and spatially localized in the input data, which is then leveraged to (3) revise the model behavior. Concretely, we apply the methods of RRR, CDEP and ClArC for model correction, and (4) (re-)evaluate the model's performance and remaining sensitivity towards the artifact. Using two medical benchmark datasets for Melanoma detection and bone age estimation, we apply our R2R framework to VGG, ResNet and EfficientNet architectures and thereby reveal and correct real dataset-intrinsic artifacts, as well as synthetic variants in a controlled setting. Completing the XAI life cycle, we demonstrate multiple R2R iterations to mitigate different biases. Code is available on https://github.com/maxdreyer/Reveal2Revise.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 22 Mar 2023.
Builds on
12 of 24 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 293
- 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
- 2019Interpretations are useful: penalizing explanations to align neural networks with prior knowledgecited by 144
- 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 141
- 2018Beyond Word Importance: Contextual Decomposition to Extract Interactions from LSTMscited by 67
- 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
Built on by
Citing papers per year: 2023: 4; 2024: 3; 2025: 8; 2026: 2.
17 papers.
Sort:
By area:
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 42
- 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generationcited by 41
- 2025Mechanistic understanding and validation of large AI models with SemanticLenscited by 29
- 2023Interpreting and Correcting Medical Image Classification with PIP-Netcited by 11
- 2024Controllable Continual Test-Time Adaptationcited by 6
- 2024Reactive Model Correction: Mitigating Harm to Task-Relevant Features via Conditional Bias Suppressioncited by 5
- 2023Neglected Free Lunch -- Learning Image Classifiers Using Annotation Byproductscited by 4
- 2025Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMscited by 3
- 2024The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysiscited by 2
- 2025Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Datacited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
5 more
- 2025Post-Hoc Concept Disentanglement: From Correlated to Isolated Concept Representationscited by 1
- 2025Towards Facilitated Fairness Assessment of AI-based Skin Lesion Classifiers Through GenAI-based Image Synthesiscited by 0
- 2025Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learningcited by 0
- 2026ICON Decomposition: Auditing deep neural networks for shortcuts by decomposing layer-wise representations using conceptscited by 0
- 2026MedDiME: Efficient Latent Diffusion with Adaptive Masking for Medical Counterfactual Generationcited by 0
- 2026MedDiME: Efficient Latent Diffusion with Adaptive Masking for Medical Counterfactual Generation14 Sep 2026
- 2026ICON Decomposition: Auditing deep neural networks for shortcuts by decomposing layer-wise representations using concepts26 Aug 2026
- 2025Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learning14 Oct 2025
- 2025Towards Facilitated Fairness Assessment of AI-based Skin Lesion Classifiers Through GenAI-based Image Synthesis23 Jul 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMs16 Jun 2025
- 2025LLMs for Explainable AI: A Comprehensive Survey31 Mar 2025
- 2025Post-Hoc Concept Disentanglement: From Correlated to Isolated Concept Representations7 Mar 2025
- 2025Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Data23 Jan 2025
- 2025Mechanistic understanding and validation of large AI models with SemanticLens9 Jan 2025
- 2024The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysis22 Jul 2024
- 2024Controllable Continual Test-Time Adaptation23 May 2024
5 more
- 2024Reactive Model Correction: Mitigating Harm to Task-Relevant Features via Conditional Bias Suppression15 Apr 2024
- 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generation21 Dec 2023
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions30 Oct 2023
- 2023Interpreting and Correcting Medical Image Classification with PIP-Net19 Jul 2023
- 2023Neglected Free Lunch -- Learning Image Classifiers Using Annotation Byproducts30 Mar 2023
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 42
- 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generationcited by 41
- 2025Mechanistic understanding and validation of large AI models with SemanticLenscited by 29
- 2023Interpreting and Correcting Medical Image Classification with PIP-Netcited by 11
- 2024Controllable Continual Test-Time Adaptationcited by 6
- 2024Reactive Model Correction: Mitigating Harm to Task-Relevant Features via Conditional Bias Suppressioncited by 5
- 2023Neglected Free Lunch -- Learning Image Classifiers Using Annotation Byproductscited by 4
- 2025Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMscited by 3
- 2024The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysiscited by 2
- 2025Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Datacited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
12 most cited of 16 All 16 (JSON)
- 2026ICON Decomposition: Auditing deep neural networks for shortcuts by decomposing layer-wise representations using concepts26 Aug 2026
- 2025Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learning14 Oct 2025
- 2025Towards Facilitated Fairness Assessment of AI-based Skin Lesion Classifiers Through GenAI-based Image Synthesis23 Jul 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMs16 Jun 2025
- 2025LLMs for Explainable AI: A Comprehensive Survey31 Mar 2025
- 2025Post-Hoc Concept Disentanglement: From Correlated to Isolated Concept Representations7 Mar 2025
- 2025Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Data23 Jan 2025
- 2025Mechanistic understanding and validation of large AI models with SemanticLens9 Jan 2025
- 2024The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysis22 Jul 2024
- 2024Controllable Continual Test-Time Adaptation23 May 2024
- 2024Reactive Model Correction: Mitigating Harm to Task-Relevant Features via Conditional Bias Suppression15 Apr 2024
12 newest of 16 All 16 (JSON)