mlsanityData to 7 Oct 2026

Efficient Pyramid Channel Attention Network for Pathological Myopia Recognition

arXiv 2309.09196 ↗First posted 17 Sep 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Pathological myopia (PM) is the leading ocular disease for impaired vision worldwide. Clinically, the characteristic of pathology distribution in PM is global-local on the fundus image, which plays a significant role in assisting clinicians in diagnosing PM. However, most existing deep neural networks focused on designing complex architectures but rarely explored the pathology distribution prior of PM. To tackle this issue, we propose an efficient pyramid channel attention (EPCA) module, which fully leverages the potential of the clinical pathology prior of PM with pyramid pooling and multi-scale context fusion. Then, we construct EPCA-Net for automatic PM recognition based on fundus images by stacking a sequence of EPCA modules. Moreover, motivated by the recent pretraining-and-finetuning paradigm, we attempt to adapt pre-trained natural image models for PM recognition by freezing them and treating the EPCA and other attention modules as adapters. In addition, we construct a PM recognition benchmark termed PM-fundus by collecting fundus images of PM from publicly available datasets. The comprehensive experiments demonstrate the superiority of our EPCA-Net over state-of-the-art methods in the PM recognition task. The results also show that our method based on the pretraining-and-finetuning paradigm achieves competitive performance through comparisons to part of previous methods based on traditional fine-tuning paradigm with fewer tunable parameters, which has the potential to leverage more natural image foundation models to address the PM recognition task in limited medical data regime.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 64 references that are in the map. First posted on arXiv 17 Sep 2023.

Builds on

25 of 64 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2017Squeeze-and-Excitation Networkscited by 4,763
  6. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  9. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  10. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
  11. 2021Florence: A New Foundation Model for Computer Visioncited by 802
  12. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
13 more
  1. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  2. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
  3. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  4. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
  5. 2021Coordinate Attention for Efficient Mobile Network Designcited by 239
  6. 2022Frozen CLIP Models are Efficient Video Learnerscited by 181
  7. 2021SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioningcited by 161
  8. 2023AIM: Adapting Image Models for Efficient Video Action Recognitioncited by 145
  9. 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
  10. 2022Visual Prompt Tuning for Test-time Domain Adaptationcited by 97
  11. 2019SRM : A Style-based Recalibration Module for Convolutional Neural Networkscited by 65
  12. 2020A Benchmark for Studying Diabetic Retinopathy: Segmentation, Grading, and Transferabilitycited by 48
  13. 2020Dense Residual Network for Retinal Vessel Segmentationcited by 4

Built on by

Not cited yet.