Imitating Radiological Scrolling: A Global-Local Attention Model for 3D Chest CT Volumes Multi-Label Anomaly Classification
Not on the map. Why?
Abstract (arXiv)
The rapid increase in the number of Computed Tomography (CT) scan examinations has created an urgent need for automated tools, such as organ segmentation, anomaly classification, and report generation, to assist radiologists with their growing workload. Multi-label classification of Three-Dimensional (3D) CT scans is a challenging task due to the volumetric nature of the data and the variety of anomalies to be detected. Existing deep learning methods based on Convolutional Neural Networks (CNNs) struggle to capture long-range dependencies effectively, while Vision Transformers require extensive pre-training, posing challenges for practical use. Additionally, these existing methods do not explicitly model the radiologist's navigational behavior while scrolling through CT scan slices, which requires both global context understanding and local detail awareness. In this study, we present CT-Scroll, a novel global-local attention model specifically designed to emulate the scrolling behavior of radiologists during the analysis of 3D CT scans. Our approach is evaluated on two public datasets, demonstrating its efficacy through comprehensive experiments and an ablation study that highlights the contribution of each model component.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 26 Mar 2025.
Builds on
25 of 41 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016Layer Normalizationcited by 5,579
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2020GLU Variants Improve Transformercited by 1,724
- 2021ViViT: A Video Vision Transformercited by 1,610
13 more
- 2019Generating Long Sequences with Sparse Transformerscited by 1,523
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
- 2021ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registrationcited by 87
- 20203D Deep Learning on Medical Images: A Reviewcited by 76
- 2020Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumescited by 66
- 2023GenerateCT: Text-Conditional Generation of 3D Chest CT Volumescited by 64
- 2024A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentationcited by 14
- 2022ConvFormer: Combining CNN and Transformer for Medical Image Segmentationcited by 10
Built on by
Citing papers per year: 2025: 2.
2 papers.