DreaMR: Diffusion-driven Counterfactual Explanation for Functional MRI
Not on the map. Why?
Abstract (arXiv)
Deep learning analyses have offered sensitivity leaps in detection of cognitive states from functional MRI (fMRI) measurements across the brain. Yet, as deep models perform hierarchical nonlinear transformations on their input, interpreting the association between brain responses and cognitive states is challenging. Among common explanation approaches for deep fMRI classifiers, attribution methods show poor specificity and perturbation methods show limited plausibility. While counterfactual generation promises to address these limitations, previous methods use variational or adversarial priors that yield suboptimal sample fidelity. Here, we introduce the first diffusion-driven counterfactual method, DreaMR, to enable fMRI interpretation with high specificity, plausibility and fidelity. DreaMR performs diffusion-based resampling of an input fMRI sample to alter the decision of a downstream classifier, and then computes the minimal difference between the original and counterfactual samples for explanation. Unlike conventional diffusion methods, DreaMR leverages a novel fractional multi-phase-distilled diffusion prior to improve sampling efficiency without compromising fidelity, and it employs a transformer architecture to account for long-range spatiotemporal context in fMRI scans. Comprehensive experiments on neuroimaging datasets demonstrate the superior specificity, fidelity and efficiency of DreaMR in sample generation over state-of-the-art counterfactual methods for fMRI interpretation.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 44 of its 99 references that are in the map. First posted on arXiv 18 Jul 2023.
Builds on
44 of 99 references.
References · 44
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2023Consistency Modelscited by 1,822
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
- 2022Diffusion Models for Medical Anomaly Detectioncited by 232
32 more
- 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 211
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 192
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
- 2020Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and Domain Adaptation: ABIDE Resultscited by 122
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 118
- 2018Disease Prediction using Graph Convolutional Networks: Application to Autism Spectrum Disorder and Alzheimer's Diseasecited by 99
- 2022Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Modelscited by 97
- 2022Diffusion Visual Counterfactual Explanationscited by 96
- 2021Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attentioncited by 87
- 2022Diffusion Causal Models for Counterfactual Estimationcited by 87
- 2022Diffusion Models for Counterfactual Explanationscited by 79
- 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 77
- 2021Beyond Trivial Counterfactual Explanations with Diverse Valuable Explanationscited by 56
- 2022What is Healthy? Generative Counterfactual Diffusion for Lesion Localizationcited by 52
- 2023Mask, Stitch, and Re-Sample: Enhancing Robustness and Generalizability in Anomaly Detection through Automatic Diffusion Modelscited by 50
- 2022CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoisingcited by 46
- 2023A Comprehensive Survey on Knowledge Distillation of Diffusion Modelscited by 45
- 2018Reconstructing Faces from fMRI Patterns using Deep Generative Neural Networkscited by 43
- 2020Understanding Graph Isomorphism Network for rs-fMRI Functional Connectivity Analysiscited by 41
- 2022Federated Learning of Generative Image Priors for MRI Reconstructioncited by 33
- 2022D'ARTAGNAN: Counterfactual Video Generationcited by 28
- 2022CheXplaining in Style: Counterfactual Explanations for Chest X-rays using StyleGANcited by 25
- 2022BolT: Fused Window Transformers for fMRI Time Series Analysiscited by 23
- 2018Graph Saliency Maps through Spectral Convolutional Networks: Application to Sex Classification with Brain Connectivitycited by 21
- 2021Self-Supervised Transformers for fMRI representationcited by 17
- 2022Deep Learning in fNIRS: A reviewcited by 12
- 2022Disentangling Spatial-Temporal Functional Brain Networks via Twin-Transformerscited by 6
- 2021Counterfactual Explanation of Brain Activity Classifiers using Image-to-Image Transfer by Generative Adversarial Networkcited by 5
- 2022A Transformer-based Neural Language Model that Synthesizes Brain Activation Maps from Free-Form Text Queriescited by 3
- 2023A plug-in graph neural network to boost temporal sensitivity in fMRI analysiscited by 2
- 2023Meta-Learning Enabled Score-Based Generative Model for 1.5T-Like Image Reconstruction from 0.5T MRIcited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 8; 2025: 2; 2026: 1.
14 papers.
Sort:
By area:
- 2023BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeyscited by 29
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
- 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Modelcited by 23
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 14
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencodercited by 10
- 2025Conditional Diffusion Models are Medical Image Classifiers that Provide Explainability and Uncertainty for Freecited by 9
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlasescited by 8
- 2024Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion Modelscited by 7
- 2024Back-in-Time Diffusion: Unsupervised Detection of Medical Deepfakescited by 5
- 2024Learning from the few: Fine-grained approach to pediatric wrist pathology recognition on a limited datasetcited by 1
- 2026An Interpretable Local Editing Model for Counterfactual Medical Image Generationcited by 1
- 2026An Interpretable Local Editing Model for Counterfactual Medical Image Generation28 Feb 2026
- 2025Synthesizing Images on Perceptual Boundaries of ANNs for Uncovering Human Perceptual Variability on Facial Expressions19 Jul 2025
- 2025Conditional Diffusion Models are Medical Image Classifiers that Provide Explainability and Uncertainty for Free6 Feb 2025
- 2024Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimaging15 Nov 2024
- 2024Learning from the few: Fine-grained approach to pediatric wrist pathology recognition on a limited dataset24 Aug 2024
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder2 Aug 2024
- 2024Back-in-Time Diffusion: Unsupervised Detection of Medical Deepfakes21 Jul 2024
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling22 May 2024
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translation10 May 2024
- 2024Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion Models19 Apr 2024
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlases25 Mar 2024
- 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model19 Oct 2023
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
- 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Modelcited by 23
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 14
- 2025Conditional Diffusion Models are Medical Image Classifiers that Provide Explainability and Uncertainty for Freecited by 9
- 2024Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion Modelscited by 7
- 2024Back-in-Time Diffusion: Unsupervised Detection of Medical Deepfakescited by 5
- 2025Conditional Diffusion Models are Medical Image Classifiers that Provide Explainability and Uncertainty for Free6 Feb 2025
- 2024Back-in-Time Diffusion: Unsupervised Detection of Medical Deepfakes21 Jul 2024
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translation10 May 2024
- 2024Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion Models19 Apr 2024
- 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model19 Oct 2023
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstruction2 Aug 2023
- 2023BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeyscited by 29
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencodercited by 10
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlasescited by 8
- 2024Learning from the few: Fine-grained approach to pediatric wrist pathology recognition on a limited datasetcited by 1
- 2026An Interpretable Local Editing Model for Counterfactual Medical Image Generationcited by 1
- 2024Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimagingcited by 0
- 2025Synthesizing Images on Perceptual Boundaries of ANNs for Uncovering Human Perceptual Variability on Facial Expressionscited by 0
- 2026An Interpretable Local Editing Model for Counterfactual Medical Image Generation28 Feb 2026
- 2025Synthesizing Images on Perceptual Boundaries of ANNs for Uncovering Human Perceptual Variability on Facial Expressions19 Jul 2025
- 2024Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimaging15 Nov 2024
- 2024Learning from the few: Fine-grained approach to pediatric wrist pathology recognition on a limited dataset24 Aug 2024
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder2 Aug 2024
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlases25 Mar 2024
- 2023BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys16 Oct 2023
Similar, not cited
Close in wording, no citation either way
- 2026Flow Matching with In-Context Priors for Out-of-Distribution Brain Dynamics
- 2026Brain-DiT: A Universal Multi-state fMRI Foundation Model with Metadata-Conditioned Pretraining
- 2023Decoding Realistic Images from Brain Activity with Contrastive Self-supervision and Latent Diffusion
- 2022Semantic Brain Decoding: from fMRI to conceptually similar image reconstruction of visual stimuli
- 2025Diffusion Counterfactuals for Image Regressors
- 2026Seeing the imagined: latent functional alignment in visual imagery decoding from fMRI data
- 2026DreamReader: An Interpretability Toolkit for Text-to-Image Models
- 2024NeuralDiffuser: Neuroscience-inspired Diffusion Guidance for fMRI Visual Reconstruction