HexMIL: Hierarchical Attention MIL for Ante-Hoc Explainable Detection of AI-Manipulated CT Volumes
Not on the map. Why?
Abstract (arXiv)
The emergence of medical deepfakes, i.e., medical images manipulated by deep generative models, poses a significant threat to clinical workflows. However, existing detectors suffer from two critical limitations: poor generalization to unseen generative architectures for manipulation detection and lack of interpretability. In this context, we present HexMIL (Hierarchical EXplainable Multiple Instance Learning), a mask-free medical deepfake detector that simultaneously addresses both limitations using only binary volume-level supervision. HexMIL decomposes each CT volume into a two-level hierarchy of patches and slices, aggregated via independent Gated Attention modules whose weights are directly combined into a full-resolution 3D attention volume that localizes the manipulated sub-region without any pixel-level annotation. Unlike post-hoc methods such as Grad-CAM, HexMIL's attention weights constitute the exact forward computation driving the classification decision, providing ante-hoc and structurally faithful spatial attribution. We evaluate HexMIL on M3DSynth and CT-GAN datasets under a rigorous cross-generator generalization protocol, training on a single generative architecture and testing on unseen ones. HexMIL outperforms all baselines by +9.1 AUC and +9.4 F1 in out-of-domain classification, and achieves the best average IoU and Pointing Game score in localization. Project page: opontorno.github.io/hexmil.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 48 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
31 of 48 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
19 more
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 256
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
- 2019CT-GAN: Malicious Tampering of 3D Medical Imagery using Deep Learningcited by 32
- 2023M3Dsynth: A dataset of medical 3D images with AI-generated local manipulationscited by 11
- 2024On the Exploitation of DCT-Traces in the Generative-AI Domaincited by 9
- 2025Toward Medical Deepfake Detection: A Comprehensive Dataset and Novel Methodcited by 6
- 2021Machine Learning based Medical Image Deepfake Detection: A Comparative Studycited by 5
- 2024Back-in-Time Diffusion: Unsupervised Detection of Medical Deepfakescited by 5
Built on by
Not cited yet.