mlsanityData to 7 Oct 2026

JOINEDTrans: Prior Guided Multi-task Transformer for Joint Optic Disc/Cup Segmentation and Fovea Detection

arXiv 2305.11504 ↗First posted 19 May 2023eess.IV cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning-based image segmentation and detection models have largely improved the efficiency of analyzing retinal landmarks such as optic disc (OD), optic cup (OC), and fovea. However, factors including ophthalmic disease-related lesions and low image quality issues may severely complicate automatic OD/OC segmentation and fovea detection. Most existing works treat the identification of each landmark as a single task, and take into account no prior information. To address these issues, we propose a prior guided multi-task transformer framework for joint OD/OC segmentation and fovea detection, named JOINEDTrans. JOINEDTrans effectively combines various spatial features of the fundus images, relieving the structural distortions induced by lesions and other imaging issues. It contains a segmentation branch and a detection branch. To be noted, we employ an encoder pretrained in a vessel segmentation task to effectively exploit the positional relationship among vessel, OD/OC, and fovea, successfully incorporating spatial prior into the proposed JOINEDTrans framework. There are a coarse stage and a fine stage in JOINEDTrans. In the coarse stage, OD/OC coarse segmentation and fovea heatmap localization are obtained through a joint segmentation and detection module. In the fine stage, we crop regions of interest for subsequent refinement and use predictions obtained in the coarse stage to provide additional information for better performance and faster convergence. Experimental results demonstrate that JOINEDTrans outperforms existing state-of-the-art methods on the publicly available GAMMA, REFUGE, and PALM fundus image datasets. We make our code available at https://github.com/HuaqingHe/JOINEDTrans

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 61 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

29 of 61 references.

References · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  5. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  6. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  7. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  8. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  9. 2019REFUGE Challenge: A Unified Framework for Evaluating Automated Methods for Glaucoma Assessment from Fundus Photographscited by 226
  10. 2019Topology-Preserving Deep Image Segmentationcited by 198
  11. 2018Joint Optic Disc and Cup Segmentation Based on Multi-label Deep Network and Polar Transformationcited by 73
  12. 2021Medical Image Segmentation Using Squeeze-and-Expansion Transformerscited by 56
17 more
  1. 2022GAMMA Challenge:Glaucoma grAding from Multi-Modality imAgescited by 45
  2. 2022Task Adaptive Parameter Sharing for Multi-Task Learningcited by 42
  3. 2019Unsupervised Learning of Landmarks by Descriptor Vector Exchangecited by 39
  4. 2018Towards a glaucoma risk index based on simulated hemodynamics from fundus imagescited by 31
  5. 2020Deep Convolutional Neural Networks with Spatial Regularization, Volume and Star-shape Priori for Image Segmentationcited by 31
  6. 2020High-level Prior-based Loss Functions for Medical Image Segmentation: A Surveycited by 28
  7. 2022Controllable Dynamic Multi-Task Architecturescited by 21
  8. 2022AADG: Automatic Augmentation for Domain Generalization on Retinal Image Segmentationcited by 18
  9. 2021BSDA-Net: A Boundary Shape and Distance Aware Joint Learning Framework for Segmenting and Classifying OCTA Imagescited by 17
  10. 2020Convex Shape Prior for Deep Neural Convolution Network based Eye Fundus Images Segmentationcited by 10
  11. 2022COROLLA: An Efficient Multi-Modality Fusion Framework with Supervised Contrastive Learning for Glaucoma Gradingcited by 10
  12. 2019Transfer Learning based Detection of Diabetic Retinopathy from Small Datasetcited by 7
  13. 2021MT-TransUNet: Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classificationcited by 7
  14. 2017Segmentation of optic disc, fovea and retinal vasculature using a single convolutional neural networkcited by 5
  15. 2021Bilateral-ViT for Robust Fovea Localizationcited by 3
  16. 2020Convex Shape Representation with Binary Labels for Image Segmentation: Models and Fast Algorithmscited by 2
  17. 2021U-Net with Hierarchical Bottleneck Attention for Landmark Detection in Fundus Images of the Degenerated Retinacited by 1

Built on by

Not cited yet.