mlsanityData to 7 Oct 2026

Surgical Data Science -- from Concepts toward Clinical Translation

arXiv 2011.02284 ↗First posted 30 Oct 2020cs.CY cs.CV cs.LGcited by 105

Not on the map. Why?

Abstract (arXiv)

Recent developments in data science in general and machine learning in particular have transformed the way experts envision the future of surgery. Surgical Data Science (SDS) is a new research field that aims to improve the quality of interventional healthcare through the capture, organization, analysis and modeling of data. While an increasing number of data-driven approaches and clinical applications have been studied in the fields of radiological and clinical data science, translational success stories are still lacking in surgery. In this publication, we shed light on the underlying reasons and provide a roadmap for future advances in the field. Based on an international workshop involving leading researchers in the field of SDS, we review current practice, key achievements and initiatives as well as available standards and tools for a number of topics relevant to the field, namely (1) infrastructure for data acquisition, storage and access in the presence of regulatory constraints, (2) data annotation and sharing and (3) data analytics. We further complement this technical perspective with (4) a review of currently available SDS products and the translational progress from academia and (5) a roadmap for faster clinical translation and exploitation of the full potential of SDS, based on an international multi-round Delphi process.

Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 14; 2023: 21; 2024: 27; 2025: 24; 2026: 17.

105 papers.

Sort:

By area:

  1. 2022AutoLaparo: A New Dataset of Integrated Multi-tasks for Image-guided Surgical Automation in Laparoscopic Hysterectomycited by 85
  2. 2023Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lecturescited by 68
  3. 2021Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmarkcited by 58
  4. 2022Dissecting Self-Supervised Learning Methods for Surgical Computer Visioncited by 48
  5. 2024Pixel-Wise Recognition for Holistic Surgical Scene Understandingcited by 48
  6. 2024Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruningcited by 46
  7. 2023Advancing Surgical VQA with Scene Graph Knowledgecited by 41
  8. 2023Challenges in Multi-centric Generalization: Phase and Step Recognition in Roux-en-Y Gastric Bypass Surgerycited by 40
  9. 2024Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentationcited by 38
  10. 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
  11. 2022Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentationcited by 27
  12. 2025Scaling up self-supervised learning for improved surgical foundation modelscited by 25
38 more
  1. 2023The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmarkcited by 21
  2. 2022Labeling instructions matter in biomedical image analysiscited by 20
  3. 2022On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysiscited by 19
  4. 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settingscited by 19
  5. 2022Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phasescited by 18
  6. 2023Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the artcited by 18
  7. 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challengecited by 18
  8. 2023Human-in-the-loop Embodied Intelligence with Interactive Simulation Environment for Surgical Robot Learningcited by 11
  9. 2024PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgerycited by 10
  10. 2025Large-scale Self-supervised Video Foundation Model for Intelligent Surgerycited by 10
  11. 2023Self-distillation for surgical action recognitioncited by 9
  12. 2023Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applicationscited by 9
  13. 2024Creating a Digital Twin of Spinal Surgery: A Proof of Conceptcited by 9
  14. 2024Online 3D reconstruction and dense tracking in endoscopic videoscited by 9
  15. 2024VISAGE: Video Synthesis using Action Graphs for Surgerycited by 9
  16. 2023Jumpstarting Surgical Computer Visioncited by 8
  17. 2024MuST: Multi-Scale Transformers for Surgical Phase Recognitioncited by 8
  18. 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Modelscited by 8
  19. 2025Video Dataset for Surgical Phase, Keypoint, and Instrument Recognition in Laparoscopic Surgery (PhaKIR)cited by 8
  20. 20223D Human Pose Estimation in Multi-View Operating Room Videos Using Differentiable Camera Projectionscited by 7
  21. 2024OSSAR: Towards Open-Set Surgical Activity Recognition in Robot-assisted Surgerycited by 7
  22. 2024VS-Assistant: Versatile Surgery Assistant on the Demand of Surgeonscited by 7
  23. 2024SegSTRONG-C: Segmenting Surgical Tools Robustly On Non-adversarial Generated Corruptions -- An EndoVis'24 Challengecited by 7
  24. 2024Exploring the Effect of Dataset Diversity in Self-Supervised Learning for Surgical Computer Visioncited by 7
  25. 2022Know your sensORs -- A Modality Study For Surgical Action Classificationcited by 6
  26. 2023TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognitioncited by 6
  27. 2023Surgical Temporal Action-aware Network with Sequence Regularization for Phase Recognitioncited by 6
  28. 2023ST(OR)2: Spatio-Temporal Object Level Reasoning for Activity Recognition in the Operating Roomcited by 6
  29. 2025Beyond Role-Based Surgical Domain Modeling: Generalizable Re-Identification in the Operating Roomcited by 6
  30. 2025The SAGES Critical View of Safety Challenge: A Global Benchmark for AI-Assisted Surgical Quality Assessmentcited by 6
  31. 2022Bounded Future MS-TCN++ for surgical gesture recognitioncited by 5
  32. 2024Multitask Learning in Minimally Invasive Surgical Vision: A Reviewcited by 5
  33. 2024SR-Mamba: Effective Surgical Phase Recognition with State Space Modelcited by 5
  34. 2023VideoSum: A Python Library for Surgical Video Summarizationcited by 4
  35. 2023A Client-server Deep Federated Learning for Cross-domain Surgical Image Segmentationcited by 4
  36. 2024Surgical Triplet Recognition via Diffusion Modelcited by 4
  37. 2024Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videoscited by 4
  38. 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Modelscited by 4

50 most cited of 105 All 105 (JSON)