mlsanityData to 7 Oct 2026

Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models

arXiv 2303.12641 ↗First posted 22 Mar 2023cs.CV cs.AIcited by 17

Not on the map. Why?

Abstract (arXiv)

State-of-the-art machine learning models often learn spurious correlations embedded in the training data. This poses risks when deploying these models for high-stake decision-making, such as in medical applications like skin cancer detection. To tackle this problem, we propose Reveal to Revise (R2R), a framework entailing the entire eXplainable Artificial Intelligence (XAI) life cycle, enabling practitioners to iteratively identify, mitigate, and (re-)evaluate spurious model behavior with a minimal amount of human interaction. In the first step (1), R2R reveals model weaknesses by finding outliers in attributions or through inspection of latent concepts learned by the model. Secondly (2), the responsible artifacts are detected and spatially localized in the input data, which is then leveraged to (3) revise the model behavior. Concretely, we apply the methods of RRR, CDEP and ClArC for model correction, and (4) (re-)evaluate the model's performance and remaining sensitivity towards the artifact. Using two medical benchmark datasets for Melanoma detection and bone age estimation, we apply our R2R framework to VGG, ResNet and EfficientNet architectures and thereby reveal and correct real dataset-intrinsic artifacts, as well as synthetic variants in a controlled setting. Completing the XAI life cycle, we demonstrate multiple R2R iterations to mitigate different biases. Code is available on https://github.com/maxdreyer/Reveal2Revise.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 22 Mar 2023.

Builds on

12 of 24 references.

References · 12

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  4. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  5. 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
  6. 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
  7. 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 293
  8. 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
  9. 2019Interpretations are useful: penalizing explanations to align neural networks with prior knowledgecited by 144
  10. 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 141
  11. 2018Beyond Word Importance: Contextual Decomposition to Extract Interactions from LSTMscited by 67
  12. 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 3; 2025: 8; 2026: 2.

17 papers.

Sort:

By area:

  1. 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
  2. 2025LLMs for Explainable AI: A Comprehensive Surveycited by 42
  3. 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generationcited by 41
  4. 2025Mechanistic understanding and validation of large AI models with SemanticLenscited by 29
  5. 2023Interpreting and Correcting Medical Image Classification with PIP-Netcited by 11
  6. 2024Controllable Continual Test-Time Adaptationcited by 6
  7. 2024Reactive Model Correction: Mitigating Harm to Task-Relevant Features via Conditional Bias Suppressioncited by 5
  8. 2023Neglected Free Lunch -- Learning Image Classifiers Using Annotation Byproductscited by 4
  9. 2025Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMscited by 3
  10. 2024The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysiscited by 2
  11. 2025Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Datacited by 2
  12. 2025A Survey on Interpretability in Visual Recognitioncited by 2
5 more
  1. 2025Post-Hoc Concept Disentanglement: From Correlated to Isolated Concept Representationscited by 1
  2. 2025Towards Facilitated Fairness Assessment of AI-based Skin Lesion Classifiers Through GenAI-based Image Synthesiscited by 0
  3. 2025Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learningcited by 0
  4. 2026ICON Decomposition: Auditing deep neural networks for shortcuts by decomposing layer-wise representations using conceptscited by 0
  5. 2026MedDiME: Efficient Latent Diffusion with Adaptive Masking for Medical Counterfactual Generationcited by 0