mlsanityData to 7 Oct 2026

Teaching Humans Subtle Differences with DIFFusion

arXiv 2504.08046 ↗First posted 10 Apr 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Scientific expertise often requires recognizing subtle visual differences that remain challenging to articulate even for domain experts. We present a system that leverages generative models to automatically discover and visualize minimal discriminative features between categories while preserving instance identity. Our method generates counterfactual visualizations with subtle, targeted transformations between classes, performing well even in domains where data is sparse, examples are unpaired, and category boundaries resist verbal description. Experiments across six domains, including black hole simulations, butterfly taxonomy, and medical imaging, demonstrate accurate transitions with limited training data, highlighting both established discriminative features and novel subtle distinctions that measurably improved category differentiation. User studies confirm our generated counterfactuals significantly outperform traditional approaches in teaching humans to correctly differentiate between fine-grained classes, showing the potential of generative models to advance visual learning and scientific research.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 52 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

32 of 52 references.

References · 32

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  8. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  12. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
20 more
  1. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  2. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  3. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  4. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  5. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
  6. 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Modelscited by 148
  7. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  8. 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
  9. 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
  10. 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
  11. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Modelscited by 64
  12. 2021Beyond Trivial Counterfactual Explanations with Diverse Valuable Explanationscited by 56
  13. 2018Learning-based Video Motion Magnificationcited by 43
  14. 2023Spawrious: A Benchmark for Fine Control of Spurious Correlation Biasescited by 41
  15. 2023Text-to-Image Models for Counterfactual Explanations: a Black-Box Approachcited by 28
  16. 2024Evolving Interpretable Visual Classifiers with Large Language Modelscited by 18
  17. 2023Latent Diffusion Counterfactual Explanationscited by 17
  18. 2024VibeCheck: Discover and Quantify Qualitative Differences in Large Language Modelscited by 15
  19. 2023Kiki or Bouba? Sound Symbolism in Vision-and-Language Modelscited by 14
  20. 2025DiSciPLE: Learning Interpretable Programs for Scientific Visual Discoverycited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.