DiffEx: Explaining a Classifier with Diffusion Models to Identify Microscopic Cellular Variations
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
In recent years, deep learning models have been extensively applied to biological data across various modalities. Discriminative deep learning models have excelled at classifying images into categories (e.g., healthy versus diseased, treated versus untreated). However, these models are often perceived as black boxes due to their complexity and lack of interpretability, limiting their application in real-world biological contexts. In biological research, explainability is essential: understanding classifier decisions and identifying subtle differences between conditions are critical for elucidating the effects of treatments, disease progression, and biological processes. To address this challenge, we propose DiffEx, a method for generating visually interpretable attributes to explain classifiers and identify microscopic cellular variations between different conditions. We demonstrate the effectiveness of DiffEx in explaining classifiers trained on natural and biological images. Furthermore, we use DiffEx to uncover phenotypic differences within microscopy datasets. By offering insights into cellular variations through classifier explanations, DiffEx has the potential to advance the understanding of diseases and aid drug discovery by identifying novel biomarkers.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 39 of its 51 references that are in the map. First posted on arXiv 12 Feb 2025.
Builds on
39 of 51 references.
Closest ancestors · 1
Same direction, newest first
Other references · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
26 more
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2022A ConvNet for the 2020scited by 3,545
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2018Demystifying MMD GANscited by 1,268
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
- 2020Understanding the Behaviour of Contrastive Losscited by 397
- 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
- 2022Diffusion Models already have a Semantic Latent Spacecited by 324
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
- 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
- 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2022Diffusion Visual Counterfactual Explanationscited by 96
- 2019Explanation by Progressive Exaggerationcited by 76
- 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfercited by 59
- 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46
- 2023Text-to-Image Models for Counterfactual Explanations: a Black-Box Approachcited by 28
- 2023Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Actioncited by 15
- 2024Global Counterfactual Directionscited by 15
- 2023Unpaired Image-to-Image Translation with Limited Data to Reveal Subtle Phenotypescited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models
- 2024Explaining in Diffusion: Explaining a Classifier Through Hierarchical Semantics with Text-to-Image Diffusion Models
- 2026Explainable Pathomics Feature Visualization via Correlation-aware Conditional Feature Editing
- 2021Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddings
- 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discovery
- 2023Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
- 2024Diffexplainer: Towards Cross-modal Global Explanations with Diffusion Models
- 2026CellDX AI Autopilot: Agent-Guided Training and Deployment of Pathology Classifiers