CathAction: A Benchmark for Endovascular Intervention Understanding
Not on the map. Why?
Abstract (arXiv)
Real-time visual feedback from catheterization analysis is crucial for enhancing surgical safety and efficiency during endovascular interventions. However, existing datasets are often limited to specific tasks, small scale, and lack the comprehensive annotations necessary for broader endovascular intervention understanding. To tackle these limitations, we introduce CathAction, a large-scale dataset for catheterization understanding. Our CathAction dataset encompasses approximately 500,000 annotated frames for catheterization action understanding and collision detection, and 25,000 ground truth masks for catheter and guidewire segmentation. For each task, we benchmark recent related works in the field. We further discuss the challenges of endovascular intentions compared to traditional computer vision tasks and point out open research questions. We hope that CathAction will facilitate the development of endovascular intervention understanding methods that can be applied to real-world applications. The dataset is available at https://airvlab.github.io/cathaction/.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 42 of its 89 references that are in the map. First posted on arXiv 23 Aug 2024.
Builds on
42 of 89 references.
References · 42
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
- 2022Vision Transformer with Deformable Attentioncited by 295
- 2020A Brief Review of Domain Adaptationcited by 288
- 2021Dynamic Head: Unifying Object Detection Heads with Attentionscited by 187
- 2020TDN: Temporal Difference Networks for Efficient Action Recognitioncited by 183
- 2021BEVT: BERT Pretraining of Video Transformerscited by 169
30 more
- 2017Domain Adaptation for Visual Applications: A Comprehensive Surveycited by 128
- 2020Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularizationcited by 123
- 2018When will you do what? - Anticipating Temporal Occurrences of Activitiescited by 107
- 2022SegViT: Semantic Segmentation with Plain Vision Transformerscited by 106
- 2019What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attentioncited by 105
- 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2019You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localizationcited by 59
- 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
- 2019STEP: Spatio-Temporal Progressive Learning for Video Action Detectioncited by 51
- 2020Effective Fusion Factor in FPN for Tiny Object Detectioncited by 44
- 2022Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipationcited by 41
- 2022Holistic Interaction Transformer Network for Action Detectioncited by 28
- 2022Source-Free Progressive Graph Learning for Open-Set Domain Adaptationcited by 25
- 2020End-to-End Real-time Catheter Segmentation with Optical Flow-Guided Warping during Endovascular Interventioncited by 20
- 2022Self-Supervised Depth Estimation in Laparoscopic Image using 3D Geometric Consistencycited by 19
- 2022YOLOV: Making Still Image Object Detectors Great at Video Object Detectioncited by 18
- 2023Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performancescited by 16
- 2017Fully Automatic and Real-Time Catheter Segmentation in X-Ray Fluoroscopycited by 13
- 2023Discriminative Co-Saliency and Background Mining Transformer for Co-Salient Object Detectioncited by 12
- 2022CathSim: An Open-source Simulator for Endovascular Interventioncited by 11
- 2018Deep Segmentation and Registration in X-Ray Angiography Videocited by 9
- 2018Automatic catheter detection in pediatric X-ray images using a scale-recurrent network and synthetic datacited by 7
- 2018Medical Technologies and Challenges of Robot Assisted Minimally Invasive Intervention and Diagnosticscited by 6
- 2017Model-based Catheter Segmentation in MRI-imagescited by 4
- 2023Shape-Sensitive Loss for Catheter and Guidewire Segmentationcited by 4
- 2024Autonomous Catheterization with Open-source Simulator and Expert Trajectorycited by 4
- 2017HACS: Human Action Clips and Segments Dataset for Recognition and Temporal Localizationcited by 3
- 2022YOWO-Plus: An Incremental Improvementcited by 2
- 2021Inertial Sensor Data To Image Encoding For Human Action Recognitioncited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 3.
6 papers.
- 2024SurgicalGS: Dynamic 3D Gaussian Splatting for Accurate Robotic-Assisted Surgical Scene Reconstructioncited by 14
- 2025FedEFM: Federated Endovascular Foundation Model with Unseen Datacited by 2
- 2025Advancing Embodied Intelligence in Robotic-Assisted Endovascular Procedures: A Systematic Review of AI Solutionscited by 2
- 2026Towards Real-Time Autonomous Navigation: Transformer-Based Catheter Tip Tracking in Fluoroscopycited by 1
- 2026Dual-Part Multi-Lateral Branched Network for Multi-Class Segmentation in Cardiovascular Catheterization Angiogramscited by 0
- 2026Novel Methods for Catheter and Guidewire Segmentation in X-ray Fluoroscopy under a Federated Learning Settingcited by 0
- 2026Novel Methods for Catheter and Guidewire Segmentation in X-ray Fluoroscopy under a Federated Learning Setting6 Sep 2026
- 2026Dual-Part Multi-Lateral Branched Network for Multi-Class Segmentation in Cardiovascular Catheterization Angiograms4 Sep 2026
- 2026Towards Real-Time Autonomous Navigation: Transformer-Based Catheter Tip Tracking in Fluoroscopy14 May 2026
- 2025Advancing Embodied Intelligence in Robotic-Assisted Endovascular Procedures: A Systematic Review of AI Solutions21 Apr 2025
- 2025FedEFM: Federated Endovascular Foundation Model with Unseen Data28 Jan 2025
- 2024SurgicalGS: Dynamic 3D Gaussian Splatting for Accurate Robotic-Assisted Surgical Scene Reconstruction11 Oct 2024