Diffusion-CAM: Faithful Visual Explanations for dMLLMs
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
While diffusion Multimodal Large Language Models (dMLLMs) have recently achieved remarkable strides in multimodal generation, the development of interpretability mechanisms has lagged behind their architectural evolution. Unlike traditional autoregressive models that produce sequential activations, diffusion-based architectures generate tokens via parallel denoising, resulting in smooth, distributed activation patterns across the entire sequence. Consequently, existing Class Activation Mapping (CAM) methods, which are tailored for local, sequential dependencies, are ill-suited for interpreting these non-autoregressive behaviors. To bridge this gap, we propose Diffusion-CAM, the first interpretability method specifically tailored for dMLLMs. We derive raw activation maps by differentiably probing intermediate representations in the transformer backbone, accordingly capturing both latent features and their class-specific gradients. To address the inherent stochasticity of these raw signals, we incorporate four key modules to resolve spatial ambiguity and mitigate intra-image confounders and redundant token correlations. Extensive experiments demonstrate that Diffusion-CAM significantly outperforms SoTA methods in both localization accuracy and visual fidelity, establishing a new standard for understanding the parallel generation process of diffusion multimodal systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 53 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
41 of 53 references.
Closest ancestors · 1
Same direction, newest first
Other references · 40
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
28 more
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2022In-context Learning and Induction Headscited by 930
- 2020Quantifying Attention Flow in Transformerscited by 759
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
- 2022Multimodal Learning with Transformers: A Surveycited by 399
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 233
- 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
- 2024Information Flow Routes: Automatically Interpreting Language Models at Scalecited by 92
- 2021Revisiting the Uniform Information Density Hypothesiscited by 63
- 2024From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Taskscited by 37
- 2025Token Activation Map to Visually Explain Multimodal LLMscited by 30
- 2024DOPRA: Decoding Over-accumulation Penalization and Re-allocation in Specific Weighting Layercited by 27
- 2024From Insights to Actions: The Impact of Interpretability and Analysis Research on NLPcited by 20
- 2024Decomposing and Interpreting Image Representations via Text in ViTs Beyond CLIPcited by 19
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
- 2025Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformerscited by 16
- 2025Finer-CAM: Spotting the Difference Reveals Finer Details for Visual Explanationcited by 14
- 2024Dissecting Query-Key Interaction in Vision Transformerscited by 12
- 2024Exploring Forgetting in Large Language Model Pre-Trainingcited by 9
- 2026Hallucination Begins Where Saliency Dropscited by 8
- 2026Context Tokens are Anchors: Understanding the Repetition Curse in dMLLMs from an Information Flow Perspectivecited by 6
- 2024CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretationcited by 4
- 2025Uniform Information Density and Syntactic Reduction: Revisiting textitthat-Mentioning in English Complement Clausescited by 1
- 2025Revisiting the Uniform Information Density Hypothesis in LLM Reasoningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models
- 2024Dual Diffusion for Unified Image Generation and Understanding
- 2025Discrete Diffusion in Large Language and Multimodal Models: A Survey
- 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion
- 2025D3ToM: Decider-Guided Dynamic Token Merging for Accelerating Diffusion MLLMs
- 2025dMLLM-TTS: Self-Verified and Efficient Test-Time Scaling for Diffusion Multi-Modal Large Language Models
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model
- 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models