Surgical Data Science: Enabling Next-Generation Surgery
Not on the map. Why?
Abstract (arXiv)
This paper introduces Surgical Data Science as an emerging scientific discipline. Key perspectives are based on discussions during an intensive two-day international interactive workshop that brought together leading researchers working in the related field of computer and robot assisted interventions. Our consensus opinion is that increasing access to large amounts of complex data, at scale, throughout the patient care process, complemented by advances in data science and machine learning techniques, has set the stage for a new generation of analytics that will support decision-making and quality improvement in interventional medicine. In this article, we provide a consensus definition for Surgical Data Science, identify associated challenges and opportunities and provide a roadmap for advancing the field.
Key facts. Cited by 126 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Jan 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 23; 2023: 15; 2024: 20; 2025: 26; 2026: 25.
126 papers.
Sort:
By area:
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 141
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 94
- 2022AutoLaparo: A New Dataset of Integrated Multi-tasks for Image-guided Surgical Automation in Laparoscopic Hysterectomycited by 85
- 2023Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lecturescited by 68
- 2021Temporal Memory Relation Network for Workflow Recognition from Surgical Videocited by 66
- 2021Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmarkcited by 60
- 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
- 2024Pixel-Wise Recognition for Holistic Surgical Scene Understandingcited by 49
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
- 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognitioncited by 44
- 2021Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedurescited by 42
- 2024Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentationcited by 39
38 more
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directionscited by 35
- 2022Towards Holistic Surgical Scene Understandingcited by 33
- 2025MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environmentscited by 28
- 2022Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentationcited by 27
- 2022Rendezvous in Time: An Attention-based Temporal Fusion approach for Surgical Triplet Recognitioncited by 27
- 2021Gesture Recognition in Robotic Surgery: a Reviewcited by 23
- 2021Image Compositing for Segmentation of Surgical Tools without Manual Annotationscited by 23
- 2021Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videoscited by 23
- 2023Surgical Action Triplet Detection by Mixed Supervised Learning of Instrument-Tissue Interactionscited by 23
- 2021Long-Term Temporally Consistent Unpaired Video Translation from Simulated Surgical 3D Datacited by 21
- 2023LABRAD-OR: Lightweight Memory Scene Graphs for Accurate Bimodal Reasoning in Dynamic Operating Roomscited by 21
- 2023The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmarkcited by 21
- 2022On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysiscited by 19
- 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challengecited by 19
- 2022Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phasescited by 18
- 2023CholecTrack20: A Multi-Perspective Tracking Dataset for Surgical Toolscited by 17
- 2024Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Modelcited by 15
- 2021Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challengecited by 14
- 2023Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven Reasoningcited by 14
- 2024ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modelingcited by 14
- 2022Less is More: Surgical Phase Recognition from Timestamp Supervisioncited by 13
- 2024VidLPRO: A underlineVideo-underlineLanguage underlinePre-training Framework for underlineRobotic and Laparoscopic Surgerycited by 12
- 2021A Kinematic Bottleneck Approach For Pose Regression of Flexible Surgical Instruments directly from Imagescited by 11
- 2024VISAGE: Video Synthesis using Action Graphs for Surgerycited by 11
- 2025EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity Understandingcited by 11
- 2025Large-scale Self-supervised Video Foundation Model for Intelligent Surgerycited by 10
- 2021FetReg: Placental Vessel Segmentation and Registration in Fetoscopy Challenge Datasetcited by 9
- 2023Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applicationscited by 9
- 2024Creating a Digital Twin of Spinal Surgery: A Proof of Conceptcited by 9
- 2021Co-Generation and Segmentation for Generalized Surgical Instrument Segmentation on Unlabelled Datacited by 8
- 2021Surgical data science for safe cholecystectomy: a protocol for segmentation of hepatocystic anatomy and assessment of the critical view of safetycited by 8
- 2023Whether and When does Endoscopy Domain Pretraining Make Sense?cited by 8
- 2023Jumpstarting Surgical Computer Visioncited by 8
- 2024Instrument-tissue Interaction Detection Framework for Surgical Video Understandingcited by 8
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2024OSSAR: Towards Open-Set Surgical Activity Recognition in Robot-assisted Surgerycited by 7
- 2021Multimodal Semantic Scene Graphs for Holistic Modeling of Surgical Procedurescited by 6
50 most cited of 126 All 126 (JSON)
- 2026A Surgical Foundation Model Reveals Task-Dependent Label Efficiency25 Sep 2026
- 2026Structured Reasoning Agentic Framework for Interpretable Critical View of Safety Assessment25 Sep 2026
- 2026A Hierarchy-Aware Video-Language Model Evaluation and Hyperbolic Baseline for Surgery22 Sep 2026
- 2026MedVLA: A Hierarchical Vision-Language-Action Framework for Closed-Loop Precision Medical Robot Manipulation22 Sep 2026
- 2026OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality11 Sep 2026
- 2026ReGround-Surg: Reliability-Guided Anchor Grounding for Referring Surgical Video Segmentation25 Aug 2026
- 2026SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding5 Aug 2026
- 2026TRCoRSurg: Temporal-Relational Co-Reasoning for Surgical Video Triplet Recognition5 Aug 2026
- 2026SPIRIT: Spatio-temporal Pairwise Relational Modeling of Instrument-Tissue Interactions for Surgical Action Triplet Recognition3 Aug 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 2026X-GuideAR: An Augmented Reality Framework to Mitigate Radiation Exposure during Fluoroscopic Guidance12 Jul 2026
- 2026AI for Quality Assurance in the Operating Room16 Jun 2026
38 more
- 2026OR-Action: Multi-Role Video Understanding with Fine-Grained Actions11 Jun 2026
- 2026SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition14 May 2026
- 2026Hi-GaTA: Hierarchical Gated Temporal Aggregation Adapter for Surgical Video Report Generation11 May 2026
- 2026Benchmarking CNN- and Transformer-Based Models for Surgical Instrument Segmentation in Robotic-Assisted Surgery10 Apr 2026
- 2026An Approach to Enriching Surgical Video Datasets for Fine-Grained Spatial-Temporal Understanding of Vision-Language Models1 Apr 2026
- 2026CliPPER: Contextual Video-Language Pretraining on Long-form Intraoperative Surgical Procedures for Event Recognition25 Mar 2026
- 2026PanORama: Multiview Consistent Panoptic Segmentation in Operating Rooms20 Mar 2026
- 2026SutureFormer: Learning Surgical Trajectories via Goal-conditioned Offline RL in Pixel Space19 Mar 2026
- 2026TopoOR: A Unified Topological Scene Representation for the Operating Room10 Mar 2026
- 2026GroundedSurg: A Multi-Procedure Benchmark for Language-Conditioned Surgical Tool Segmentation1 Mar 2026
- 2026Strategy-Supervised Autonomous Laparoscopic Camera Control via Event-Driven Graph Mining24 Feb 2026
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motions19 Feb 2026
- 2026Supervised Mixture-of-Experts for Surgical Grasping and Retraction29 Jan 2026
- 2025Self-Supervised Contrastive Embedding Adaptation for Endoscopic Image Matching11 Dec 2025
- 2025Distilling Expert Surgical Knowledge: How to train local surgical VLMs for anatomy explanation in Complete Mesocolic Excision5 Dec 2025
- 2025SurgiATM: A Physics-Guided Plug-and-Play Model for Deep Learning-Based Smoke Removal in Laparoscopic Surgery7 Nov 2025
- 2025Sound Source Localization for Spatial Mapping of Surgical Actions in Dynamic Scenes28 Oct 2025
- 2025State-Change Learning for Prediction of Future Events in Endoscopic Videos14 Oct 2025
- 2025Mitigating Surgical Data Imbalance with Dual-Prediction Video Diffusion Model7 Oct 2025
- 2025Federated Learning for Surgical Vision in Appendicitis Classification: Results of the FedSurg EndoVis 2024 Challenge6 Oct 2025
- 2025Decoding the Surgical Scene: A Scoping Review of Scene Graphs in Surgery25 Sep 2025
- 2025Towards Application Aligned Synthetic Surgical Image Synthesis23 Sep 2025
- 2025Exploring Pre-training Across Domains for Few-Shot Surgical Skill Assessment11 Sep 2025
- 2025CARES: Collaborative Agentic Reasoning for Error Detection in Surgery12 Aug 2025
- 2025StepAL: Step-aware Active Learning for Cataract Surgical Videos29 Jul 2025
- 2025CPKD: Clinical Prior Knowledge-Constrained Diffusion Models for Surgical Phase Recognition in Endoscopic Submucosal Dissection4 Jul 2025
- 2025Recognizing Surgical Phases Anywhere: Few-Shot Test-time Adaptation and Task-graph Guided Refinement25 Jun 2025
- 2025orGAN: A Synthetic Data Augmentation Pipeline for Simultaneous Generation of Surgical Images and Ground Truth Labels17 Jun 2025
- 2025Surgeons Awareness, Expectations, and Involvement with Artificial Intelligence: a Survey Pre and Post the GPT Era9 Jun 2025
- 2025Learning dissection trajectories from expert surgical videos via imitation learning with equivariant diffusion5 Jun 2025
- 2025Large-scale Self-supervised Video Foundation Model for Intelligent Surgery3 Jun 2025
- 2025EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity Understanding30 May 2025
- 2025Specialized Foundation Models for Intelligent Operating Rooms19 May 2025
- 2025Enhancing Surgical Documentation through Multimodal Visual-Temporal Transformers and Generative AI28 Apr 2025
- 2025Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections23 Apr 2025
- 2025Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence3 Apr 2025
- 2025CoStoDet-DDPM: Collaborative Training of Stochastic and Deterministic Models Improves Surgical Workflow Anticipation and Recognition13 Mar 2025
- 2025MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environments4 Mar 2025
50 newest of 126 All 126 (JSON)
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Modelscited by 4
- 2025Learning dissection trajectories from expert surgical videos via imitation learning with equivariant diffusioncited by 2
- 2025Mitigating Surgical Data Imbalance with Dual-Prediction Video Diffusion Modelcited by 1
- 2025CoStoDet-DDPM: Collaborative Training of Stochastic and Deterministic Models Improves Surgical Workflow Anticipation and Recognitioncited by 0
- 2025CPKD: Clinical Prior Knowledge-Constrained Diffusion Models for Surgical Phase Recognition in Endoscopic Submucosal Dissectioncited by 0
- 2025Towards Application Aligned Synthetic Surgical Image Synthesiscited by 0
- 2025Mitigating Surgical Data Imbalance with Dual-Prediction Video Diffusion Model7 Oct 2025
- 2025Towards Application Aligned Synthetic Surgical Image Synthesis23 Sep 2025
- 2025CPKD: Clinical Prior Knowledge-Constrained Diffusion Models for Surgical Phase Recognition in Endoscopic Submucosal Dissection4 Jul 2025
- 2025Learning dissection trajectories from expert surgical videos via imitation learning with equivariant diffusion5 Jun 2025
- 2025CoStoDet-DDPM: Collaborative Training of Stochastic and Deterministic Models Improves Surgical Workflow Anticipation and Recognition13 Mar 2025
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models19 Aug 2024
- 2024Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Modelcited by 15
- 2024ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modelingcited by 14
- 2025Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligencecited by 5
- 2026An Approach to Enriching Surgical Video Datasets for Fine-Grained Spatial-Temporal Understanding of Vision-Language Modelscited by 1
- 2026An Approach to Enriching Surgical Video Datasets for Fine-Grained Spatial-Temporal Understanding of Vision-Language Models1 Apr 2026
- 2025Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence3 Apr 2025
- 2024Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model19 Nov 2024
- 2024ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modeling10 Apr 2024
- 2023Self-Knowledge Distillation for Surgical Phase Recognition15 Jun 2023
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 141
- 2021Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformercited by 94
- 2022AutoLaparo: A New Dataset of Integrated Multi-tasks for Image-guided Surgical Automation in Laparoscopic Hysterectomycited by 85
- 2023Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lecturescited by 68
- 2021Temporal Memory Relation Network for Workflow Recognition from Surgical Videocited by 66
- 2021Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmarkcited by 60
- 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
- 2024Pixel-Wise Recognition for Holistic Surgical Scene Understandingcited by 49
- 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
- 2022CholecTriplet2021: A benchmark challenge for surgical action triplet recognitioncited by 44
- 2021Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedurescited by 42
- 2024Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentationcited by 39
12 most cited of 107 All 107 (JSON)
- 2026A Surgical Foundation Model Reveals Task-Dependent Label Efficiency25 Sep 2026
- 2026A Hierarchy-Aware Video-Language Model Evaluation and Hyperbolic Baseline for Surgery22 Sep 2026
- 2026OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality11 Sep 2026
- 2026ReGround-Surg: Reliability-Guided Anchor Grounding for Referring Surgical Video Segmentation25 Aug 2026
- 2026SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding5 Aug 2026
- 2026TRCoRSurg: Temporal-Relational Co-Reasoning for Surgical Video Triplet Recognition5 Aug 2026
- 2026SPIRIT: Spatio-temporal Pairwise Relational Modeling of Instrument-Tissue Interactions for Surgical Action Triplet Recognition3 Aug 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 2026X-GuideAR: An Augmented Reality Framework to Mitigate Radiation Exposure during Fluoroscopic Guidance12 Jul 2026
- 2026AI for Quality Assurance in the Operating Room16 Jun 2026
- 2026OR-Action: Multi-Role Video Understanding with Fine-Grained Actions11 Jun 2026
- 2026SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition14 May 2026
12 newest of 107 All 107 (JSON)