SCE-LITE-HQ: Smooth visual counterfactual explanations with generative foundation models
Not on the map. Why?
Abstract (arXiv)
Modern neural networks achieve strong performance but remain difficult to interpret in high-dimensional visual domains. Counterfactual explanations (CFEs) provide a principled approach to interpreting black-box predictions by identifying minimal input changes that alter model outputs. However, existing CFE methods often rely on dataset-specific generative models and incur substantial computational cost, limiting their scalability to high-resolution data. We propose SCE-LITE-HQ, a scalable framework for counterfactual generation that leverages pretrained generative foundation models without task-specific retraining. The method operates in the latent space of the generator, incorporates smoothed gradients to improve optimization stability, and applies mask-based diversification to promote realistic and structurally diverse counterfactuals. We evaluate SCE-LITE-HQ on natural and medical datasets using a desiderata-driven evaluation protocol. Results show that SCE-LITE-HQ produces valid, realistic, and diverse counterfactuals competitive with or outperforming existing baselines, while avoiding the overhead of training dedicated generative models.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
31 of 44 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022Generative Adversarial Networkscited by 5,603
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
19 more
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2020Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Reviewcited by 174
- 2017The Shattered Gradients Problem: If resnets are the answer, then what is the question?cited by 156
- 2022Diffusion Models for Counterfactual Explanationscited by 79
- 2021Beyond Trivial Counterfactual Explanations with Diverse Valuable Explanationscited by 56
- 2023PathLDM: Text conditioned Latent Diffusion Model for Histopathologycited by 51
- 2023Adversarial Counterfactual Visual Explanationscited by 47
- 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generationcited by 41
- 2022Diffeomorphic Counterfactuals with Generative Modelscited by 29
- 2023Text-to-Image Models for Counterfactual Explanations: a Black-Box Approachcited by 28
- 2023Towards Fixing Clever-Hans Predictors with Counterfactual Knowledge Distillationcited by 14
- 2025Towards Desiderata-Driven Design of Visual Counterfactual Explainerscited by 7
- 2025Mitigating Clever Hans Strategies in Image Classifiers through Generating Counterexamplescited by 6
- 2025Diffusion Counterfactuals for Image Regressorscited by 5
- 2025Graph Diffusion Counterfactual Explanationcited by 4
- 2026Visual Disentangled Diffusion Autoencoders: Scalable Counterfactual Generation for Foundation Modelscited by 4
- 2026Protein Counterfactuals via Diffusion-Guided Latent Optimizationcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.