mlsanityData to 7 Oct 2026

Denoising Models Develop Human-Like Perceptual Illusion Representations Across Architectures

arXiv 2607.17138 ↗First posted 19 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep neural networks trained on natural images are shown to produce outputs consistent with human observers for brightness illusions. While this phenomenon has been documented across architectures, all evidence, to date, is measured at the output level: restored pixels, decoded trajectories, or classification decisions. Whether these models actually represent illusions internally, and if so where and how, remains unknown. We show that denoising models develop illusion-sensitive representations at specific internal layers, across varied architectures. Specifically, we identify the layers and channels that discriminate illusory from physically matched control regions. We show that the denoising objective is a more important driver of the effect than the architecture. On domain-appropriate stimuli, these activations track a validated psychophysical model of human brightness perception (FLODOG; Spearman ρ ≥ 0.70) and scale monotonically with parametric illusion strength. Leveraging these findings, we provide causal evidence via channel ablation showing that illusion-sensitive channels specifically and substantially affect the internal signal. Yet injecting these representations into the generation pipeline produces no measurable pixel shift across all tested architectures; we term such representations perceptual phantoms: active in internal processing yet invisible to any output-based evaluation. While related internal-output dissociations have been characterized in language models, this is the first such characterization for perceptual representations in denoising vision models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 19 Jul 2026.

Builds on

19 of 31 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  9. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  10. 2019Designing and Interpreting Probes with Control Taskscited by 608
  11. 2021Causal Abstractions of Neural Networkscited by 401
  12. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 328
7 more
  1. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  2. 2023Is This the Subspace You Are Looking for? An Interpretability Illusion for Subspace Activation Patchingcited by 75
  3. 2023Intriguing properties of generative classifierscited by 52
  4. 2023Localizing and Editing Knowledge in Text-to-Image Generative Modelscited by 52
  5. 2023Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?cited by 32
  6. 2021Predictive coding feedback results in perceived illusory contours in a recurrent neural networkcited by 10
  7. 2024The Art of Deception: Color Visual Illusions and Diffusion Modelscited by 9

Built on by

Not cited yet.