mlsanityData to 7 Oct 2026

DreamReader: An Interpretability Toolkit for Text-to-Image Models

arXiv 2603.13299 ↗First posted 2 Mar 2026cs.LG cs.AIcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Despite the rapid adoption of text-to-image (T2I) diffusion models, causal and representation-level analysis remains fragmented and largely limited to isolated probing techniques. To address this gap, we introduce DreamReader: a unified framework that formalizes diffusion interpretability as composable representation operators spanning activation extraction, causal patching, structured ablations, and activation steering across modules and timesteps. DreamReader provides a model-agnostic abstraction layer enabling systematic analysis and intervention across diffusion architectures. Beyond consolidating existing methods, DreamReader introduces three novel intervention primitives for diffusion models: (1) representation fine-tuning (LoReFT) for subspace-constrained internal adaptation; (2) classifier-guided gradient steering using MLP probes trained on activations; and (3) component-level cross-model mapping for systematic study of transferability of representations across modalities. These mechanisms allows us to do lightweight white-box interventions on T2I models by drawing inspiration from interpretability techniques on LLMs. We demonstrate DreamReader through controlled experiments that (i) perform activation stitching between two models, and (ii) apply LoReFT to steer multiple activation units, reliably injecting a target concept into the generated images. Experiments are specified declaratively and executed in controlled batched pipelines to enable reproducible large-scale analysis. Across multiple case studies, we show that techniques adapted from language model interpretability yield promising and controllable interventions in diffusion models. DreamReader is released as an open source toolkit for advancing research on T2I interpretability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 23 of its 36 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

23 of 36 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Unveiling Concept Attribution in Diffusion Models3 Dec
  2. 2024Rethinking Training for De-biasing Text-to-Image Generation: Unlocking the Potential of Stable Diffusion22 Aug
  3. 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editing6 Mar
  4. 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
  5. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attention10 Oct

Other references · 18

  1. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  2. 2024The Platonic Representation Hypothesiscited by 362
  3. 2014Understanding image representations by measuring their equivariance and equivalencecited by 240
  4. 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 225
  5. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
  6. 2024ReFT: Representation Finetuning for Language Modelscited by 186
  7. 2024Improving Dictionary Learning with Gated Sparse Autoencoderscited by 171
  8. 2025Learning Multi-Level Features with Matryoshka Sparse Autoencoderscited by 136
  9. 2023Hyperparameters in Reinforcement Learning and How To Tune Themcited by 58
  10. 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 51
  11. 2024NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internalscited by 43
  12. 2025Shared Global and Local Geometry of Language Model Embeddingscited by 34
6 more
  1. 2024One-Step is Enough: Sparse Autoencoders for Text-to-Image Diffusion Modelscited by 30
  2. 2024On Mechanistic Knowledge Localization in Text-to-Image Generative Modelscited by 27
  3. 2025Beyond Linear Steering: Unified Multi-Attribute Control for Language Modelscited by 23
  4. 2025Distilling Diversity and Control in Diffusion Modelscited by 21
  5. 2025Prisma: An Open Source Toolkit for Mechanistic Interpretability in Vision and Videocited by 20
  6. 2025Linear Representation Transferability Hypothesis: Leveraging Small Models to Steer Large Modelscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Emergence and Evolution of Interpretable Concepts in Diffusion Models
  2. 2023The Hidden Language of Diffusion Models
  3. 2025Patronus: Interpretable Diffusion Models with Prototypes
  4. 2023Semantic Guidance Tuning for Text-To-Image Diffusion Models
  5. 2026i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models
  6. 2024textitRevelio: Interpreting and leveraging semantic information in diffusion models
  7. 2026ELROND: Exploring and decomposing intrinsic capabilities of diffusion models
  8. 2026Look But Don't Touch with Sparse Autoencoders for Unlearning in Diffusion Models