CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80
Not on the map. Why?
Abstract (arXiv)
Computer-assisted surgery has been developed to enhance surgery correctness and safety. However, researchers and engineers suffer from limited annotated data to develop and train better algorithms. Consequently, the development of fundamental algorithms such as Simultaneous Localization and Mapping (SLAM) is limited. This article elaborates on the efforts of preparing the dataset for semantic segmentation, which is the foundation of many computer-assisted surgery mechanisms. Based on the Cholec80 dataset [3], we extracted 8,080 laparoscopic cholecystectomy image frames from 17 video clips in Cholec80 and annotated the images. The dataset is named CholecSeg8K and its total size is 3GB. Each of these images is annotated at pixel-level for thirteen classes, which are commonly founded in laparoscopic cholecystectomy surgery. CholecSeg8k is released under the license CC BY- NC-SA 4.0.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 17; 2024: 25; 2025: 36; 2026: 24.
104 papers.
Sort:
By area:
- 2023Advancing Surgical VQA with Scene Graph Knowledgecited by 41
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2023AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentationcited by 37
- 2023Follow Anything: Open-set detection, tracking, and following in real-timecited by 28
- 2023Text Promptable Surgical Instrument Segmentation with Vision-Language Modelscited by 27
- 2024General surgery vision transformer: A video pre-trained foundation model for general surgerycited by 25
- 2025Scaling up self-supervised learning for improved surgical foundation modelscited by 25
- 2026Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentationcited by 23
- 2023CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detectioncited by 22
- 2023The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmarkcited by 21
- 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settingscited by 19
- 2023Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the artcited by 18
38 more
- 2023A spatio-temporal network for video semantic segmentation in surgical videoscited by 17
- 2024CholecInstanceSeg: A Tool Instance Segmentation Dataset for Laparoscopic Surgerycited by 16
- 2024General-purpose foundation models for increased autonomy in robot-assisted surgerycited by 15
- 2023Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven Reasoningcited by 14
- 2023Metrics Matter in Surgical Phase Recognitioncited by 13
- 2024Surgical-LLaVA: Toward Surgical Scenario Understanding via Large Language and Vision Modelscited by 13
- 2024S-SAM: SVD-based Fine-Tuning of Segment Anything Model for Medical Image Segmentationcited by 11
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Surveycited by 11
- 2023Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applicationscited by 9
- 2024A Systematic Review of Generalization Research in Medical Image Classificationcited by 8
- 2024Instrument-tissue Interaction Detection Framework for Surgical Video Understandingcited by 8
- 2024Interactive Generation of Laparoscopic Videos with Diffusion Modelscited by 8
- 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Modelscited by 8
- 2023Uncertainty Estimation for Safety-critical Scene Segmentation via Fine-grained Reward Maximizationcited by 7
- 2023Navigating the Synthetic Realm: Harnessing Diffusion-based Models for Laparoscopic Text-to-Image Generationcited by 7
- 2024Augmenting Efficient Real-time Surgical Instrument Segmentation in Video with Point Tracking and Segment Anythingcited by 7
- 2024Exploring the Effect of Dataset Diversity in Self-Supervised Learning for Surgical Computer Visioncited by 7
- 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generationcited by 7
- 2025SurgTPGS: Semantic 3D Surgical Scene Understanding with Text Promptable Gaussian Splattingcited by 7
- 2021Temporally Constrained Neural Networks (TCNN): A framework for semi-supervised video semantic segmentationcited by 6
- 2026SUREON: A Benchmark and Vision-Language-Model for Surgical Reasoningcited by 6
- 2024Multitask Learning in Minimally Invasive Surgical Vision: A Reviewcited by 5
- 2024Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical videocited by 5
- 2024Systematic Evaluation and Guidelines for Segment Anything Model in Surgical Video Analysiscited by 5
- 2023A Foundation Model for General Moving Object Segmentation in Medical Imagescited by 4
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Modelscited by 4
- 2025Slot-BERT: Self-supervised Object Discovery in Surgical Videocited by 4
- 2025SASVi -- Segment Any Surgical Videocited by 4
- 2025OctreeNCA: Single-Pass 184 MP Segmentation on Consumer Hardwarecited by 4
- 2023Automated Assessment of Critical View of Safety in Laparoscopic Cholecystectomycited by 3
- 2024DDA: Dimensionality Driven Augmentation Search for Contrastive Learning in Laparoscopic Surgerycited by 3
- 2024CycleSAM: Few-Shot Surgical Scene Segmentation with Cycle- and Scene-Consistent Feature Matchingcited by 3
- 2024Revisiting Surgical Instrument Segmentation Without Human Intervention: A Graph Partitioning Viewcited by 3
- 2024AMNCutter: Affinity-Attention-Guided Multi-View Normalized Cutter for Unsupervised Surgical Instrument Segmentationcited by 3
- 2025EgoSurgery-HTS: A Dataset for Egocentric Hand-Tool Segmentation in Open Surgery Videoscited by 3
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collectionscited by 3
- 2025Is Visual in-Context Learning for Compositional Medical Tasks within Reach?cited by 3
- 2025EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgerycited by 3
50 most cited of 104 All 104 (JSON)
- 2026Surgical Kinematics from Monocular Video with Learned Articulated Motion Constraints23 Sep 2026
- 2026DART: Depth-as-Target Pretraining for Surgical Vision Foundation Models3 Sep 2026
- 2026Beyond Uncertainty: Generalizable Failure Monitoring for Surgical Segmentation under Acquisition Degradation17 Aug 2026
- 2026Sterilizable Scene Graph Generation for Operating Rooms17 Aug 2026
- 2026Leveraging Transfer Learning with Class-Specific Decoders for Laparoscopic Segmentation31 Jul 2026
- 2026Parameter-Efficient Adaptation of SAM3 for Prompt-Driven Surgical Concept Segmentation26 Jul 2026
- 2026Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstruction16 Jul 2026
- 2026Attribute Retrieving for Open-Vocabulary Endoscopic Compositional Referring Segmentation9 Jul 2026
- 2026DeGenseGS: Geometrically and Semantically Decoupled Surgical Scene Understanding in 4D Gaussian Splatting6 Jul 2026
- 2026Dense Structural Priors for Sparse Functional Landmark Localization in Surgical Videos30 Jun 2026
- 2026SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery24 Jun 2026
- 2026Surgical Anatomy Recognition with Context Learning using Foundation Representations20 Jun 2026
38 more
- 2026OR-Action: Multi-Role Video Understanding with Fine-Grained Actions11 Jun 2026
- 2026Learning Emergent Modular Representations in Multi-modality Medical Vision Foundation Models21 May 2026
- 2026EndoGSim: Physics-Aware 4D Dynamic Endoscopic Scene Simulations via MLLM-Guided Gaussian Splatting15 May 2026
- 2026DenseTRF: Texture-Aware Unsupervised Representation Adaptation for Surgical Scene Dense Prediction11 May 2026
- 2026SurgCoT: Advancing Spatiotemporal Reasoning in Surgical Videos through a Chain-of-Thought Benchmark22 Apr 2026
- 2026Unlocking Positive Transfer in Incrementally Learning Surgical Instruments: A Self-reflection Hierarchical Prompt Framework3 Apr 2026
- 2026SCISSR: Scribble-Conditioned Interactive Surgical Segmentation and Refinement19 Mar 2026
- 2026Training-free Temporal Object Tracking in Surgical Videos8 Mar 2026
- 2026SUREON: A Benchmark and Vision-Language-Model for Surgical Reasoning6 Mar 2026
- 2026GroundedSurg: A Multi-Procedure Benchmark for Language-Conditioned Surgical Tool Segmentation1 Mar 2026
- 2026Where It Moves, It Matters: Referring Surgical Instrument Segmentation via Motion18 Jan 2026
- 2026Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentation15 Jan 2026
- 2025ReMeDI: Refined Memory for Disambiguation of Identities with SAM3 in Surgical Segmentation18 Dec 2025
- 2025LapFM: A Laparoscopic Segmentation Foundation Model via Hierarchical Concept Evolving Pre-training9 Dec 2025
- 2025See in Depth: Training-Free Surgical Scene Segmentation with Monocular Depth Priors5 Dec 2025
- 2025RobustSurg: Tackling domain generalisation for out-of-distribution surgical scene segmentation1 Dec 2025
- 2025Comparing SAM 2 and SAM 3 for Zero-Shot Segmentation of 3D Medical Data26 Nov 2025
- 2025SurgSLOT: Segment Anything in Surgical Videos via Semantic Long-term Tracking20 Nov 2025
- 2025Graph Neural Networks for Surgical Scene Segmentation20 Nov 2025
- 2025SurgiATM: A Physics-Guided Plug-and-Play Model for Deep Learning-Based Smoke Removal in Laparoscopic Surgery7 Nov 2025
- 2025Learning from Single Timestamps: Complexity Estimation in Laparoscopic Cholecystectomy6 Nov 2025
- 2025Grounding Surgical Action Triplets with Instrument Instance Segmentation: A Dataset and Target-Aware Fusion Approach1 Nov 2025
- 2025When Tracking Fails: Analyzing Failure Modes of SAM2 for Point-Based Tracking in Surgical Videos2 Oct 2025
- 2025Token Merging via Spatiotemporal Information Mining for Surgical Video Understanding28 Sep 2025
- 2025Zero-shot Monocular Metric Depth for Endoscopic Images23 Sep 2025
- 2025EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgery19 Sep 2025
- 2025ROBUST-MIPS: A Combined Skeletal Pose and Instance Segmentation Dataset for Laparoscopic Surgical Instruments27 Aug 2025
- 2025OctreeNCA: Single-Pass 184 MP Segmentation on Consumer Hardware9 Aug 2025
- 2025Robust Noisy Pseudo-label Learning for Semi-supervised Medical Image Segmentation Using Diffusion Model22 Jul 2025
- 2025Future Slot Prediction for Unsupervised Object Discovery in Surgical Video2 Jul 2025
- 2025Is Visual in-Context Learning for Compositional Medical Tasks within Reach?1 Jul 2025
- 2025SurgTPGS: Semantic 3D Surgical Scene Understanding with Text Promptable Gaussian Splatting29 Jun 2025
- 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generation26 Jun 2025
- 2025Surgical Foundation Model Leveraging Compression and Entropy Maximization for Image-Guided Surgical Assistance16 May 2025
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Survey4 May 2025
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections23 Apr 2025
- 2025Parsimonious Dataset Construction for Laparoscopic Cholecystectomy Structure Segmentation17 Apr 2025
- 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settings25 Mar 2025
50 newest of 104 All 104 (JSON)
- 2024Interactive Generation of Laparoscopic Videos with Diffusion Modelscited by 8
- 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Modelscited by 8
- 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generationcited by 7
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Modelscited by 4
- 2025GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentationcited by 1
- 2025CoSimGen: Controllable Diffusion Model for Simultaneous Image and Mask Generationcited by 1
- 2025Robust Noisy Pseudo-label Learning for Semi-supervised Medical Image Segmentation Using Diffusion Modelcited by 0
- 2026Training-free Temporal Object Tracking in Surgical Videoscited by 0
- 2026Training-free Temporal Object Tracking in Surgical Videos8 Mar 2026
- 2025Robust Noisy Pseudo-label Learning for Semi-supervised Medical Image Segmentation Using Diffusion Model22 Jul 2025
- 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generation26 Jun 2025
- 2025CoSimGen: Controllable Diffusion Model for Simultaneous Image and Mask Generation25 Mar 2025
- 2025GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation18 Jan 2025
- 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Models10 Oct 2024
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models19 Aug 2024
- 2024Interactive Generation of Laparoscopic Videos with Diffusion Models23 Apr 2024
- 2026SUREON: A Benchmark and Vision-Language-Model for Surgical Reasoningcited by 6
- 2025EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgerycited by 3
- 2026SurgCoT: Advancing Spatiotemporal Reasoning in Surgical Videos through a Chain-of-Thought Benchmarkcited by 0
- 2026SurgCoT: Advancing Spatiotemporal Reasoning in Surgical Videos through a Chain-of-Thought Benchmark22 Apr 2026
- 2026SUREON: A Benchmark and Vision-Language-Model for Surgical Reasoning6 Mar 2026
- 2025EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgery19 Sep 2025
- 2023Advancing Surgical VQA with Scene Graph Knowledgecited by 41
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2023AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentationcited by 37
- 2023Follow Anything: Open-set detection, tracking, and following in real-timecited by 28
- 2024General surgery vision transformer: A video pre-trained foundation model for general surgerycited by 25
- 2025Scaling up self-supervised learning for improved surgical foundation modelscited by 25
- 2026Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentationcited by 23
- 2023CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detectioncited by 22
- 2023The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmarkcited by 21
- 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settingscited by 19
- 2023Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the artcited by 18
- 2023A spatio-temporal network for video semantic segmentation in surgical videoscited by 17
12 most cited of 91 All 91 (JSON)
- 2026Surgical Kinematics from Monocular Video with Learned Articulated Motion Constraints23 Sep 2026
- 2026DART: Depth-as-Target Pretraining for Surgical Vision Foundation Models3 Sep 2026
- 2026Beyond Uncertainty: Generalizable Failure Monitoring for Surgical Segmentation under Acquisition Degradation17 Aug 2026
- 2026Sterilizable Scene Graph Generation for Operating Rooms17 Aug 2026
- 2026Leveraging Transfer Learning with Class-Specific Decoders for Laparoscopic Segmentation31 Jul 2026
- 2026Parameter-Efficient Adaptation of SAM3 for Prompt-Driven Surgical Concept Segmentation26 Jul 2026
- 2026Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstruction16 Jul 2026
- 2026Attribute Retrieving for Open-Vocabulary Endoscopic Compositional Referring Segmentation9 Jul 2026
- 2026DeGenseGS: Geometrically and Semantically Decoupled Surgical Scene Understanding in 4D Gaussian Splatting6 Jul 2026
- 2026Dense Structural Priors for Sparse Functional Landmark Localization in Surgical Videos30 Jun 2026
- 2026SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery24 Jun 2026
- 2026Surgical Anatomy Recognition with Context Learning using Foundation Representations20 Jun 2026
12 newest of 91 All 91 (JSON)