mlsanityData to 7 Oct 2026

DiffEx: Explaining a Classifier with Diffusion Models to Identify Microscopic Cellular Variations

arXiv 2502.09663 ↗First posted 12 Feb 2025cs.CV cs.AI cs.LGcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

In recent years, deep learning models have been extensively applied to biological data across various modalities. Discriminative deep learning models have excelled at classifying images into categories (e.g., healthy versus diseased, treated versus untreated). However, these models are often perceived as black boxes due to their complexity and lack of interpretability, limiting their application in real-world biological contexts. In biological research, explainability is essential: understanding classifier decisions and identifying subtle differences between conditions are critical for elucidating the effects of treatments, disease progression, and biological processes. To address this challenge, we propose DiffEx, a method for generating visually interpretable attributes to explain classifiers and identify microscopic cellular variations between different conditions. We demonstrate the effectiveness of DiffEx in explaining classifiers trained on natural and biological images. Furthermore, we use DiffEx to uncover phenotypic differences within microscopy datasets. By offering insights into cellular variations through classifier explanations, DiffEx has the potential to advance the understanding of diseases and aid drug discovery by identifying novel biomarkers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 39 of its 51 references that are in the map. First posted on arXiv 12 Feb 2025.

Builds on

39 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023PhenDiff: Revealing Subtle Phenotypes with Diffusion Models in Real Images13 Dec

Other references · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  10. 2016Densely Connected Convolutional Networkscited by 6,691
  11. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  12. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
26 more
  1. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2022A ConvNet for the 2020scited by 3,545
  5. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  7. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  8. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  9. 2018Demystifying MMD GANscited by 1,268
  10. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  11. 2020Understanding the Behaviour of Contrastive Losscited by 397
  12. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  13. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  14. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
  15. 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
  16. 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
  17. 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
  18. 2022Diffusion Visual Counterfactual Explanationscited by 96
  19. 2019Explanation by Progressive Exaggerationcited by 76
  20. 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfercited by 59
  21. 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
  22. 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46
  23. 2023Text-to-Image Models for Counterfactual Explanations: a Black-Box Approachcited by 28
  24. 2023Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Actioncited by 15
  25. 2024Global Counterfactual Directionscited by 15
  26. 2023Unpaired Image-to-Image Translation with Limited Data to Reveal Subtle Phenotypescited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models
  2. 2024Explaining in Diffusion: Explaining a Classifier Through Hierarchical Semantics with Text-to-Image Diffusion Models
  3. 2026Explainable Pathomics Feature Visualization via Correlation-aware Conditional Feature Editing
  4. 2021Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddings
  5. 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discovery
  6. 2023Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
  7. 2024Diffexplainer: Towards Cross-modal Global Explanations with Diffusion Models
  8. 2026CellDX AI Autopilot: Agent-Guided Training and Deployment of Pathology Classifiers