mlsanityData to 14 Oct 2026

Adversarial Masked Image Inpainting for Robust Detection of Mpox and Non-Mpox

arXiv 2310.06318 ↗First posted 10 Oct 2023eess.IV cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Due to the lack of efficient mpox diagnostic technology, mpox cases continue to increase. Recently, the great potential of deep learning models in detecting mpox and non-mpox has been proven. However, existing models learn image representations via image classification, which results in they may be easily susceptible to interference from real-world noise, require diverse non-mpox images, and fail to detect abnormal input. These drawbacks make classification models inapplicable in real-world settings. To address these challenges, we propose "Mask, Inpainting, and Measure" (MIM). In MIM's pipeline, a generative adversarial network only learns mpox image representations by inpainting the masked mpox images. Then, MIM determines whether the input belongs to mpox by measuring the similarity between the inpainted image and the original image. The underlying intuition is that since MIM solely models mpox images, it struggles to accurately inpaint non-mpox images in real-world settings. Without utilizing any non-mpox images, MIM cleverly detects mpox and non-mpox and can handle abnormal inputs. We used the recognized mpox dataset (MSLD) and images of eighteen non-mpox skin diseases to verify the effectiveness and robustness of MIM. Experimental results show that the average AUROC of MIM achieves 0.8237. In addition, we demonstrated the drawbacks of classification models and buttressed the potential of MIM through clinical validation. Finally, we developed an online smartphone app to provide free testing to the public in affected areas. This work first employs generative models to improve mpox detection and provides new insights into binary decision-making tasks in medical images.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 54 references that are in the map. First posted on arXiv 10 Oct 2023.

Builds on

18 of 54 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2013Auto-Encoding Variational Bayescited by 4,053
  5. 2019Searching for MobileNetV3cited by 1,994
  6. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
  7. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  8. 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
  9. 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
  10. 2015Adversarial Autoencoderscited by 364
  11. 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
  12. 2018Generative Probabilistic Novelty Detection with Adversarial Autoencoderscited by 99
6 more
  1. 2023Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Needcited by 46
  2. 2022Monkeypox Skin Lesion Detection Using Deep Learning Models: A Feasibility Studycited by 20
  3. 2023A Web-based Mpox Skin Lesion Detection System Using State-of-the-art Deep Learning Models Considering Racial Diversitycited by 17
  4. 2021OLED: One-Class Learned Encoder-Decoder Network with Adversarial Context Masking for Novelty Detectioncited by 14
  5. 2022Monkeypox virus detection using pre-trained deep learning-based approachescited by 14
  6. 2023Ultrafast-and-Ultralight ConvNet-Based Intelligent Monitoring System for Diagnosing Early-Stage Mpox Anytime and Anywherecited by 2

Built on by

Not cited yet.