mlsanityData to 13 Oct 2026

Multi-AD: Cross-Domain Unsupervised Anomaly Detection for Medical and Industrial Applications

arXiv 2602.05426 ↗First posted 5 Feb 2026cs.CVcited by 1

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

Traditional deep learning models often lack annotated data, especially in cross-domain applications such as anomaly detection, which is critical for early disease diagnosis in medicine and defect detection in industry. To address this challenge, we propose Multi-AD, a convolutional neural network (CNN) model for robust unsupervised anomaly detection across medical and industrial images. Our approach employs the squeeze-and-excitation (SE) block to enhance feature extraction via channel-wise attention, enabling the model to focus on the most relevant features and detect subtle anomalies. Knowledge distillation (KD) transfers informative features from the teacher to the student model, enabling effective learning of the differences between normal and anomalous data. Then, the discriminator network further enhances the model's capacity to distinguish between normal and anomalous data. At the inference stage, by integrating multi-scale features, the student model can detect anomalies of varying sizes. The teacher-student (T-S) architecture ensures consistent representation of high-dimensional features while adapting them to enhance anomaly detection. Multi-AD was evaluated on several medical datasets, including brain MRI, liver CT, and retina OCT, as well as industrial datasets, such as MVTec AD, demonstrating strong generalization across multiple domains. Experimental results demonstrated that our approach consistently outperformed state-of-the-art models, achieving the best average AUROC for both image-level (81.4% for medical and 99.6% for industrial) and pixel-level (97.0% for medical and 98.4% for industrial) tasks, making it effective for real-world applications.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 20 of its 46 references that are in the map. First posted on arXiv 5 Feb 2026.

Builds on

20 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Anomaly Detection via Reverse Distillation from One-Class Embedding26 Jan

Other references · 19

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,180
  2. 2016Wide Residual Networkscited by 3,063
  3. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,183
  4. 2021Towards Total Recall in Industrial Anomaly Detectioncited by 774
  5. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 593
  6. 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 507
  7. 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
  8. 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
  9. 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 226
  10. 2021Student-Teacher Feature Pyramid Matching for Anomaly Detectioncited by 146
  11. 2023IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturingcited by 64
  12. 2023Collaborative Discrepancy Optimization for Reliable Image Anomaly Localizationcited by 56
7 more
  1. 2020MADGAN: unsupervised Medical Anomaly Detection GAN using multiple adjacent brain MRI slice reconstructioncited by 50
  2. 2021Efficient Medical Image Segmentation Based on Knowledge Distillationcited by 43
  3. 2022Self-Supervised Masked Convolutional Transformer Block for Anomaly Detectioncited by 34
  4. 2020Anomaly Detection in Medical Imaging with Deep Perceptual Autoencoderscited by 30
  5. 2024Prior Normality Prompt Transformer for Multi-class Industrial Image Anomaly Detectioncited by 19
  6. 2024Variational Autoencoder for Anomaly Detection: A Comparative Studycited by 6
  7. 2023A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labelscited by 3

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.