DEXTER: Diffusion-Guided EXplanations with TExtual Reasoning for Vision Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Understanding and explaining the behavior of machine learning models is essential for building transparent and trustworthy AI systems. We introduce DEXTER, a data-free framework that employs diffusion models and large language models to generate global, textual explanations of visual classifiers. DEXTER operates by optimizing text prompts to synthesize class-conditional images that strongly activate a target classifier. These synthetic samples are then used to elicit detailed natural language reports that describe class-specific decision patterns and biases. Unlike prior work, DEXTER enables natural language explanation about a classifier's decision process without access to training data or ground-truth labels. We demonstrate DEXTER's flexibility across three tasks-activation maximization, slice discovery and debiasing, and bias explanation-each illustrating its ability to uncover the internal mechanisms of visual classifiers. Quantitative and qualitative evaluations, including a user study, show that DEXTER produces accurate, interpretable outputs. Experiments on ImageNet, Waterbirds, CelebA, and FairFaces confirm that DEXTER outperforms existing approaches in global model explanation and class-level bias reporting. Code is available at https://github.com/perceivelab/dexter.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 49 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
11 of 49 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2022Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlationscited by 171
- 2021e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Taskscited by 84
- 2019Distributionally Robust Optimization: A Reviewcited by 75
- 2022NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Taskscited by 60
- 2023Uni-NLX: Unifying Textual Explanations for Vision and Vision-Language Taskscited by 12
- 2024LADDER: Language-Driven Slice Discovery and Error Rectification in Vision Classifierscited by 7
- 2024Diffexplainer: Towards Cross-modal Global Explanations with Diffusion Modelscited by 5
- 2016Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Spacecited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026A Distributional View for Visual Mechanistic Interpretability: KL-Minimal Soft-Constraint Principlecited by 1
- 2026UNBOX: Unveiling Black-box visual models with Natural-languagecited by 0
- 2026LINE: LLM-based Iterative Neuron Explanations for Vision Modelscited by 0
- 2026DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptationcited by 0
- 2026DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptation30 Jun 2026
- 2026A Distributional View for Visual Mechanistic Interpretability: KL-Minimal Soft-Constraint Principle17 May 2026
- 2026LINE: LLM-based Iterative Neuron Explanations for Vision Models9 Apr 2026
- 2026UNBOX: Unveiling Black-box visual models with Natural-language9 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024GIFT: A Framework Towards Global Interpretable Faithful Textual Explanations of Vision Classifiers
- 2024Explaining in Diffusion: Explaining a Classifier Through Hierarchical Semantics with Text-to-Image Diffusion Models
- 2025TextCAM: Explaining Class Activation Map with Text
- 2025Zero-Shot Textual Explanations via Translating Decision-Critical Features
- 2026DEX-AR: A Dynamic Explainability Method for Autoregressive Vision-Language Models
- 2022REX: Reasoning-aware and Grounded Explanation
- 2026Right Predictions, Misleading Explanations: On the Vulnerability of Vision-Language Model Explanations
- 2024VALE: A Multimodal Visual and Language Explanation Framework for Image Classifiers using eXplainable AI and Language Models