Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce a conceptually simple network for generating discriminative tissue-level segmentation masks for the purpose of breast cancer diagnosis. Our method efficiently segments different types of tissues in breast biopsy images while simultaneously predicting a discriminative map for identifying important areas in an image. Our network, Y-Net, extends and generalizes U-Net by adding a parallel branch for discriminative map generation and by supporting convolutional block modularity, which allows the user to adjust network efficiency without altering the network topology. Y-Net delivers state-of-the-art segmentation accuracy while learning 6.6x fewer parameters than its closest competitors. The addition of descriptive power from Y-Net's discriminative segmentation masks improve diagnostic classification accuracy by 7% over state-of-the-art methods for diagnostic classification. Source code is available at: https://sacmehta.github.io/YNet.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 10; 2023: 7; 2024: 6; 2025: 4.
42 papers.
Sort:
By area:
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
- 2022UNeXt: MLP-based Rapid Medical Image Segmentation Networkcited by 185
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 176
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2022Q-Net: Query-Informed Few-Shot Medical Image Segmentationcited by 24
- 2021Pyramid Medical Transformer for Medical Image Segmentationcited by 20
- 2021BSDA-Net: A Boundary Shape and Distance Aware Joint Learning Framework for Segmenting and Classifying OCTA Imagescited by 17
- 2021FetalNet: Multi-task Deep Learning Framework for Fetal Ultrasound Biometric Measurementscited by 13
- 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentationcited by 12
- 2021MCUa: Multi-level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classificationcited by 12
- 2021DeepMTS: Deep Multi-task Learning for Survival Prediction in Patients with Advanced Nasopharyngeal Carcinoma using Pretreatment PET/CTcited by 11
30 more
- 2023Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directionscited by 10
- 2021MT-TransUNet: Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classificationcited by 7
- 2023Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentationcited by 7
- 2021U-GAT: Multimodal Graph Attention Network for COVID-19 Outcome Predictioncited by 4
- 2021Generalized Multi-Task Learning from Substantially Unlabeled Multi-Source Medical Image Datacited by 4
- 2025Unified Supervision For Vision-Language Modeling in 3D Computed Tomographycited by 4
- 2022Deep Learning Fetal Ultrasound Video Model Match Human Observers in Biometric Measurementscited by 3
- 2022Hybrid Skip: A Biologically Inspired Skip Connection for the UNet Architecturecited by 3
- 2022Valuing Vicinity: Memory attention framework for context-based semantic segmentation in histopathologycited by 3
- 2022DRG-Net: Interactive Joint Learning of Multi-lesion Segmentation and Classification for Diabetic Retinopathy Gradingcited by 3
- 2023HALOS: Hallucination-free Organ Segmentation after Organ Resection Surgerycited by 3
- 2023Boosting Convolution with Efficient MLP-Permutation for Volumetric Medical Image Segmentationcited by 3
- 2022CM-MLP: Cascade Multi-scale MLP with Axial Context Relation Encoder for Edge Segmentation of Medical Imagecited by 2
- 2022FAS-UNet: A Novel FAS-driven Unet to Learn Variational Image Segmentationcited by 2
- 2023Enhancing Medical Image Segmentation: Optimizing Cross-Entropy Weights and Post-Processing with Autoencoderscited by 2
- 2021Multi-task UNet architecture for end-to-end autonomous drivingcited by 1
- 2021Tips and Tricks to Improve CNN-based Chest X-ray Diagnosis: A Surveycited by 0
- 2021Reconstructing Images of Two Adjacent Objects through Scattering Medium Using Generative Adversarial Networkcited by 0
- 2021Interpretable and Interactive Deep Multiple Instance Learning for Dental Caries Classification in Bitewing X-rayscited by 0
- 2022A State-of-the-art Survey of U-Net in Microscopic Image Analysis: from Simple Usage to Structure Mortificationcited by 0
- 2022An Object Aware Hybrid U-Net for Breast Tumour Annotationcited by 0
- 2023Multi-task learning for joint weakly-supervised segmentation and aortic arch anomaly classification in fetal cardiac MRIcited by 0
- 2024Few-Shot Medical Image Segmentation with High-Fidelity Prototypescited by 0
- 20243D-LSPTM: An Automatic Framework with 3D-Large-Scale Pretrained Model for Laryngeal Cancer Detection Using Laryngoscopic Videoscited by 0
- 2024Y-MAP-Net: Real-time depth, normals, segmentation, multi-label captioning and 2D human pose in RGB imagescited by 0
- 2024S3TU-Net: Structured Convolution and Superpixel Transformer for Lung Nodule Segmentationcited by 0
- 2024Prototypical Few-Shot Medical Image Semantic Segmentation with Background Fusioncited by 0
- 2025FaRMamba: Frequency-based learning and Reconstruction aided Mamba for Medical Segmentationcited by 0
- 2025A Novel Recurrent Neural Network Framework for Prediction and Treatment of Oncogenic Mutation Progressioncited by 0
- 2025A Tool Bottleneck Framework for Clinically-Informed and Interpretable Medical Image Understandingcited by 0
- 2025A Tool Bottleneck Framework for Clinically-Informed and Interpretable Medical Image Understanding24 Dec 2025
- 2025A Novel Recurrent Neural Network Framework for Prediction and Treatment of Oncogenic Mutation Progression16 Sep 2025
- 2025Unified Supervision For Vision-Language Modeling in 3D Computed Tomography1 Sep 2025
- 2025FaRMamba: Frequency-based learning and Reconstruction aided Mamba for Medical Segmentation26 Jul 2025
- 2024Prototypical Few-Shot Medical Image Semantic Segmentation with Background Fusion4 Dec 2024
- 2024S3TU-Net: Structured Convolution and Superpixel Transformer for Lung Nodule Segmentation19 Nov 2024
- 2024Y-MAP-Net: Real-time depth, normals, segmentation, multi-label captioning and 2D human pose in RGB images15 Nov 2024
- 20243D-LSPTM: An Automatic Framework with 3D-Large-Scale Pretrained Model for Laryngeal Cancer Detection Using Laryngoscopic Videos2 Sep 2024
- 2024Few-Shot Medical Image Segmentation with High-Fidelity Prototypes26 Jun 2024
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation5 Jun 2024
- 2023CLIP in Medical Imaging: A Survey12 Dec 2023
- 2023Multi-task learning for joint weakly-supervised segmentation and aortic arch anomaly classification in fetal cardiac MRI13 Nov 2023
30 more
- 2023Enhancing Medical Image Segmentation: Optimizing Cross-Entropy Weights and Post-Processing with Autoencoders21 Aug 2023
- 2023Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions13 Apr 2023
- 2023Boosting Convolution with Efficient MLP-Permutation for Volumetric Medical Image Segmentation23 Mar 2023
- 2023Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentation17 Mar 2023
- 2023HALOS: Hallucination-free Organ Segmentation after Organ Resection Surgery14 Mar 2023
- 2022DRG-Net: Interactive Joint Learning of Multi-lesion Segmentation and Classification for Diabetic Retinopathy Grading30 Dec 2022
- 2022FAS-UNet: A Novel FAS-driven Unet to Learn Variational Image Segmentation27 Oct 2022
- 2022Valuing Vicinity: Memory attention framework for context-based semantic segmentation in histopathology21 Oct 2022
- 2022Q-Net: Query-Informed Few-Shot Medical Image Segmentation24 Aug 2022
- 2022CM-MLP: Cascade Multi-scale MLP with Axial Context Relation Encoder for Edge Segmentation of Medical Image23 Aug 2022
- 2022Hybrid Skip: A Biologically Inspired Skip Connection for the UNet Architecture11 Jul 2022
- 2022Deep Learning Fetal Ultrasound Video Model Match Human Observers in Biometric Measurements27 May 2022
- 2022UNeXt: MLP-based Rapid Medical Image Segmentation Network9 Mar 2022
- 2022An Object Aware Hybrid U-Net for Breast Tumour Annotation22 Feb 2022
- 2022A State-of-the-art Survey of U-Net in Microscopic Image Analysis: from Simple Usage to Structure Mortification14 Feb 2022
- 2021Interpretable and Interactive Deep Multiple Instance Learning for Dental Caries Classification in Bitewing X-rays17 Dec 2021
- 2021Multi-task UNet architecture for end-to-end autonomous driving16 Dec 2021
- 2021MT-TransUNet: Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classification3 Dec 2021
- 2021Generalized Multi-Task Learning from Substantially Unlabeled Multi-Source Medical Image Data25 Oct 2021
- 2021DeepMTS: Deep Multi-task Learning for Survival Prediction in Patients with Advanced Nasopharyngeal Carcinoma using Pretreatment PET/CT16 Sep 2021
- 2021MCUa: Multi-level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classification24 Aug 2021
- 2021U-GAT: Multimodal Graph Attention Network for COVID-19 Outcome Prediction29 Jul 2021
- 2021Reconstructing Images of Two Adjacent Objects through Scattering Medium Using Generative Adversarial Network24 Jul 2021
- 2021FetalNet: Multi-task Deep Learning Framework for Fetal Ultrasound Biometric Measurements14 Jul 2021
- 2021BSDA-Net: A Boundary Shape and Distance Aware Joint Learning Framework for Segmenting and Classifying OCTA Images10 Jul 2021
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathology1 Jul 2021
- 2021Tips and Tricks to Improve CNN-based Chest X-ray Diagnosis: A Survey2 Jun 2021
- 2021Pyramid Medical Transformer for Medical Image Segmentation29 Apr 2021
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentation21 Feb 2021
- 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentation22 Jan 2021
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
- 2022UNeXt: MLP-based Rapid Medical Image Segmentation Networkcited by 185
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 176
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2022Q-Net: Query-Informed Few-Shot Medical Image Segmentationcited by 24
- 2021Pyramid Medical Transformer for Medical Image Segmentationcited by 20
- 2021BSDA-Net: A Boundary Shape and Distance Aware Joint Learning Framework for Segmenting and Classifying OCTA Imagescited by 17
- 2021FetalNet: Multi-task Deep Learning Framework for Fetal Ultrasound Biometric Measurementscited by 13
- 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentationcited by 12
- 2021MCUa: Multi-level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classificationcited by 12
- 2021DeepMTS: Deep Multi-task Learning for Survival Prediction in Patients with Advanced Nasopharyngeal Carcinoma using Pretreatment PET/CTcited by 11
12 most cited of 38 All 38 (JSON)
- 2025A Novel Recurrent Neural Network Framework for Prediction and Treatment of Oncogenic Mutation Progression16 Sep 2025
- 2024Prototypical Few-Shot Medical Image Semantic Segmentation with Background Fusion4 Dec 2024
- 2024S3TU-Net: Structured Convolution and Superpixel Transformer for Lung Nodule Segmentation19 Nov 2024
- 2024Y-MAP-Net: Real-time depth, normals, segmentation, multi-label captioning and 2D human pose in RGB images15 Nov 2024
- 20243D-LSPTM: An Automatic Framework with 3D-Large-Scale Pretrained Model for Laryngeal Cancer Detection Using Laryngoscopic Videos2 Sep 2024
- 2024Few-Shot Medical Image Segmentation with High-Fidelity Prototypes26 Jun 2024
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation5 Jun 2024
- 2023CLIP in Medical Imaging: A Survey12 Dec 2023
- 2023Multi-task learning for joint weakly-supervised segmentation and aortic arch anomaly classification in fetal cardiac MRI13 Nov 2023
- 2023Enhancing Medical Image Segmentation: Optimizing Cross-Entropy Weights and Post-Processing with Autoencoders21 Aug 2023
- 2023Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions13 Apr 2023
- 2023Boosting Convolution with Efficient MLP-Permutation for Volumetric Medical Image Segmentation23 Mar 2023
12 newest of 38 All 38 (JSON)