CataractSAM-2: A Domain-Adapted Model for Anterior Segment Surgery Segmentation and Scalable Ground-Truth Annotation
Not on the map. Why?
Abstract (arXiv)
We present CataractSAM-2, a domain-adapted extension of Meta's Segment Anything Model 2, designed for real-time semantic segmentation of cataract ophthalmic surgery videos with high accuracy. Positioned at the intersection of computer vision and medical robotics, CataractSAM-2 enables precise intraoperative perception crucial for robotic-assisted and computer-guided surgical systems. Furthermore, to alleviate the burden of manual labeling, we introduce an interactive annotation framework that combines sparse prompts with video-based mask propagation. This tool significantly reduces annotation time and facilitates the scalable creation of high-quality ground-truth masks, accelerating dataset development for ocular anterior segment surgeries. We also demonstrate the model's strong zero-shot generalization to glaucoma trabeculectomy procedures, confirming its cross-procedural utility and potential for broader surgical applications. The trained model and annotation toolkit are released as open-source resources, establishing CataractSAM-2 as a foundation for expanding anterior ophthalmic surgical datasets and advancing real-time AI-driven solutions in medical robotics, as well as surgical video understanding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 41 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
15 of 41 references.
References · 15
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2023Track Anything: Segment Anything Meets Videoscited by 234
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 195
- 2025MedSAM2: Segment Anything in 3D Medical Images and Videoscited by 96
- 2018DeepPhase: Surgical Phase Recognition in CATARACTS Videoscited by 47
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 27
- 2023Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the artcited by 18
- 2022Rethinking Surgical Instrument Segmentation: A Background Image Can Be All You Needcited by 16
- 2021ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videoscited by 8
- 2023Correlation-aware active learning for surgery video segmentationcited by 4
3 more
Built on by
Not cited yet.