Additive Class Distinction Maps using Branched-GANs
Not on the map. Why?
Abstract (arXiv)
We present a new model, training procedure and architecture to create precise maps of distinction between two classes of images. The objective is to comprehend, in pixel-wise resolution, the unique characteristics of a class. These maps can facilitate self-supervised segmentation and objectdetection in addition to new capabilities in explainable AI (XAI). Our proposed architecture is based on image decomposition, where the output is the sum of multiple generative networks (branched-GANs). The distinction between classes is isolated in a dedicated branch. This approach allows clear, precise and interpretable visualization of the unique characteristics of each class. We show how our generic method can be used in several modalities for various tasks, such as MRI brain tumor extraction, isolating cars in aerial photography and obtaining feminine and masculine face features. This is a preliminary report of our initial findings and results.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 36 references that are in the map. First posted on arXiv 4 May 2023.
Builds on
24 of 36 references.
References · 24
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2020A Survey on Visual Transformercited by 653
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2019Object Detection in 20 Years: A Surveycited by 528
- 2019Deep Learning for Anomaly Detection: A Surveycited by 357
- 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2016Grad-CAM: Why did you say that?cited by 159
12 more
- 2022A Review of Sparse Expert Models in Deep Learningcited by 147
- 2018Adversarially Learned Anomaly Detectioncited by 115
- 2018CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)cited by 81
- 2019Towards Best Practice in Explaining Neural Network Decisions with LRPcited by 70
- 2022Towards Understanding Mixture of Experts in Deep Learningcited by 52
- 2020MADGAN: unsupervised Medical Anomaly Detection GAN using multiple adjacent brain MRI slice reconstructioncited by 50
- 2020Deep Interpretable Classification and Weakly-Supervised Segmentation of Histology Images via Max-Min Uncertaintycited by 26
- 2020GAN Ensemble for Anomaly Detectioncited by 22
- 2020High Tissue Contrast MRI Synthesis Using Multi-Stage Attention-GAN for Glioma Segmentationcited by 10
- 2021Unsupervised Detection of Cancerous Regions in Histology Imagery using Image-to-Image Translationcited by 4
- 2022Weakly-supervised segmentation using inherently-explainable classification models and their application to brain tumour classificationcited by 3
- 2022Analysis of Branch Specialization and its Application in Image Decompositioncited by 2
Built on by
Not cited yet.