The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmark
Not on the map. Why?
Abstract (arXiv)
This technical report provides a detailed overview of Endoscapes, a dataset of laparoscopic cholecystectomy (LC) videos with highly intricate annotations targeted at automated assessment of the Critical View of Safety (CVS). Endoscapes comprises 201 LC videos with frames annotated sparsely but regularly with segmentation masks, bounding boxes, and CVS assessment by three different clinical experts. Altogether, there are 11090 frames annotated with CVS and 1933 frames annotated with tool and anatomy bounding boxes from the 201 videos, as well as an additional 422 frames from 50 of the 201 videos annotated with tool and anatomy segmentation masks. In this report, we provide detailed dataset statistics (size, class distribution, dataset splits, etc.) and a comprehensive performance benchmark for instance segmentation, object detection, and CVS prediction. The dataset and model checkpoints are publically available at https://github.com/CAMMA-public/Endoscapes.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 19 Dec 2023.
Builds on
14 of 34 references.
References · 14
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 367
- 2018Videos as Space-Time Region Graphscited by 221
- 2017Surgical Data Science: Enabling Next-Generation Surgerycited by 126
- 2020CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80cited by 106
- 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
- 2018DeepPhase: Surgical Phase Recognition in CATARACTS Videoscited by 47
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2022Data Splits and Metrics for Method Benchmarking on Surgical Action Triplet Datasetscited by 23
- 2023Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven Reasoningcited by 14
- 2022Concept Graph Neural Networks for Surgical Video Understandingcited by 13
Built on by
Citing papers per year: 2024: 4; 2025: 7; 2026: 10.
21 papers.
Sort:
By area:
- 2025The SAGES Critical View of Safety Challenge: A Global Benchmark for AI-Assisted Surgical Quality Assessmentcited by 6
- 2024Multitask Learning in Minimally Invasive Surgical Vision: A Reviewcited by 5
- 2024Systematic Evaluation and Guidelines for Segment Anything Model in Surgical Video Analysiscited by 5
- 2025Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligencecited by 5
- 2024Artificial Intelligence for Biomedical Video Generationcited by 2
- 2025Multi-modal Representations for Fine-grained Multi-label Critical View of Safety Recognitioncited by 2
- 2026SurgSigma: A Spectrum of Large-Scale Multimodal Data and Foundation Models for Surgical Intelligencecited by 2
- 2026SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgerycited by 2
- 2024Optimizing Latent Graph Representations of Surgical Scenes for Zero-Shot Domain Transfercited by 1
- 2025Temporal Propagation of Asymmetric Feature Pyramid for Surgical Scene Segmentationcited by 1
- 2025LapFM: A Laparoscopic Segmentation Foundation Model via Hierarchical Concept Evolving Pre-trainingcited by 1
- 2026Scaling Video Pretraining for Surgical Foundation Modelscited by 1
9 more
- 2026Surgical Anatomy Recognition with Context Learning using Foundation Representationscited by 1
- 2025Robust Noisy Pseudo-label Learning for Semi-supervised Medical Image Segmentation Using Diffusion Modelcited by 0
- 2025Graph Neural Networks for Surgical Scene Segmentationcited by 0
- 2026Sum-of-Checks: Structured Reasoning for Surgical Safety with Large Vision-Language Modelscited by 0
- 2026AI for Quality Assurance in the Operating Roomcited by 0
- 2026Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstructioncited by 0
- 2026SetPlanner: A Lightweight Plug-in Point-Set Planner for Frozen SAMcited by 0
- 2026CasCVS-Net: A Staged Multi-Task Cascade for Critical View of Safety Assessmentcited by 0
- 2026Structured Reasoning Agentic Framework for Interpretable Critical View of Safety Assessmentcited by 0
- 2026Structured Reasoning Agentic Framework for Interpretable Critical View of Safety Assessment25 Sep 2026
- 2026CasCVS-Net: A Staged Multi-Task Cascade for Critical View of Safety Assessment23 Sep 2026
- 2026SetPlanner: A Lightweight Plug-in Point-Set Planner for Frozen SAM16 Sep 2026
- 2026Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstruction16 Jul 2026
- 2026SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery24 Jun 2026
- 2026Surgical Anatomy Recognition with Context Learning using Foundation Representations20 Jun 2026
- 2026AI for Quality Assurance in the Operating Room16 Jun 2026
- 2026Sum-of-Checks: Structured Reasoning for Surgical Safety with Large Vision-Language Models24 Apr 2026
- 2026Scaling Video Pretraining for Surgical Foundation Models31 Mar 2026
- 2026SurgSigma: A Spectrum of Large-Scale Multimodal Data and Foundation Models for Surgical Intelligence17 Mar 2026
- 2025LapFM: A Laparoscopic Segmentation Foundation Model via Hierarchical Concept Evolving Pre-training9 Dec 2025
- 2025Graph Neural Networks for Surgical Scene Segmentation20 Nov 2025
9 more
- 2025The SAGES Critical View of Safety Challenge: A Global Benchmark for AI-Assisted Surgical Quality Assessment21 Sep 2025
- 2025Robust Noisy Pseudo-label Learning for Semi-supervised Medical Image Segmentation Using Diffusion Model22 Jul 2025
- 2025Multi-modal Representations for Fine-grained Multi-label Critical View of Safety Recognition7 Jul 2025
- 2025Temporal Propagation of Asymmetric Feature Pyramid for Surgical Scene Segmentation18 Apr 2025
- 2025Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence3 Apr 2025
- 2024Systematic Evaluation and Guidelines for Segment Anything Model in Surgical Video Analysis31 Dec 2024
- 2024Artificial Intelligence for Biomedical Video Generation12 Nov 2024
- 2024Optimizing Latent Graph Representations of Surgical Scenes for Zero-Shot Domain Transfer11 Mar 2024
- 2024Multitask Learning in Minimally Invasive Surgical Vision: A Review16 Jan 2024
- 2025The SAGES Critical View of Safety Challenge: A Global Benchmark for AI-Assisted Surgical Quality Assessmentcited by 6
- 2024Multitask Learning in Minimally Invasive Surgical Vision: A Reviewcited by 5
- 2024Systematic Evaluation and Guidelines for Segment Anything Model in Surgical Video Analysiscited by 5
- 2024Artificial Intelligence for Biomedical Video Generationcited by 2
- 2025Multi-modal Representations for Fine-grained Multi-label Critical View of Safety Recognitioncited by 2
- 2026SurgSigma: A Spectrum of Large-Scale Multimodal Data and Foundation Models for Surgical Intelligencecited by 2
- 2026SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgerycited by 2
- 2024Optimizing Latent Graph Representations of Surgical Scenes for Zero-Shot Domain Transfercited by 1
- 2025Temporal Propagation of Asymmetric Feature Pyramid for Surgical Scene Segmentationcited by 1
- 2025LapFM: A Laparoscopic Segmentation Foundation Model via Hierarchical Concept Evolving Pre-trainingcited by 1
- 2026Scaling Video Pretraining for Surgical Foundation Modelscited by 1
- 2026Surgical Anatomy Recognition with Context Learning using Foundation Representationscited by 1
12 most cited of 17 All 17 (JSON)
- 2026CasCVS-Net: A Staged Multi-Task Cascade for Critical View of Safety Assessment23 Sep 2026
- 2026SetPlanner: A Lightweight Plug-in Point-Set Planner for Frozen SAM16 Sep 2026
- 2026Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstruction16 Jul 2026
- 2026SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery24 Jun 2026
- 2026Surgical Anatomy Recognition with Context Learning using Foundation Representations20 Jun 2026
- 2026AI for Quality Assurance in the Operating Room16 Jun 2026
- 2026Scaling Video Pretraining for Surgical Foundation Models31 Mar 2026
- 2026SurgSigma: A Spectrum of Large-Scale Multimodal Data and Foundation Models for Surgical Intelligence17 Mar 2026
- 2025LapFM: A Laparoscopic Segmentation Foundation Model via Hierarchical Concept Evolving Pre-training9 Dec 2025
- 2025Graph Neural Networks for Surgical Scene Segmentation20 Nov 2025
- 2025The SAGES Critical View of Safety Challenge: A Global Benchmark for AI-Assisted Surgical Quality Assessment21 Sep 2025
- 2025Multi-modal Representations for Fine-grained Multi-label Critical View of Safety Recognition7 Jul 2025
12 newest of 17 All 17 (JSON)