Beyond Role-Based Surgical Domain Modeling: Generalizable Re-Identification in the Operating Room
Not on the map. Why?
Abstract (arXiv)
Surgical domain models improve workflow optimization through automated predictions of each staff member's surgical role. However, mounting evidence indicates that team familiarity and individuality impact surgical outcomes. We present a novel staff-centric modeling approach that characterizes individual team members through their distinctive movement patterns and physical characteristics, enabling long-term tracking and analysis of surgical personnel across multiple procedures. To address the challenge of inter-clinic variability, we develop a generalizable re-identification framework that encodes sequences of 3D point clouds to capture shape and articulated motion patterns unique to each individual. Our method achieves 86.19% accuracy on realistic clinical data while maintaining 75.27% accuracy when transferring between different environments - a 12% improvement over existing methods. When used to augment markerless personnel tracking, our approach improves accuracy by over 50%. Through extensive validation across three datasets and the introduction of a novel workflow visualization technique, we demonstrate how our framework can reveal novel insights into surgical team dynamics and space utilization patterns, advancing methods to analyze surgical workflows and team coordination.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 96 references that are in the map. First posted on arXiv 17 Mar 2025.
Builds on
40 of 96 references.
References · 40
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2017Random Erasing Data Augmentationcited by 1,239
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 786
- 2019A Strong Baseline and Batch Normalization Neck for Deep Person Re-identificationcited by 155
- 2020Style Normalization and Restitution for Generalizable Person Re-identificationcited by 136
- 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 114
- 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
- 2020Meta Batch-Instance Normalization for Generalizable Person Re-Identificationcited by 77
- 2021Generalizable Person Re-identification with Relevance-aware Mixture of Expertscited by 77
- 2018Horizontal Pyramid Matching for Person Re-identificationcited by 70
28 more
- 2021Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularizationcited by 69
- 2022Towards a Deeper Understanding of Skeleton-based Gait Recognitioncited by 56
- 2022LidarGait: Benchmarking 3D Gait Recognition with Point Cloudscited by 55
- 2018MVOR: A Multi-view RGB-D Operating Room Dataset for 2D and 3D Human Pose Estimationcited by 49
- 2021Towards Unified Surgical Skill Assessmentcited by 49
- 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
- 2021Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Methodcited by 42
- 2023Part-Aware Transformer for Generalizable Person Re-identificationcited by 35
- 2020Automatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgerycited by 34
- 2023Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identificationcited by 34
- 2023GaitGCI: Generative Counterfactual Intervention for Gait Recognitioncited by 31
- 2025MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environmentscited by 28
- 2021Deep learning-based person re-identification methods: A survey and outlook of recent workscited by 23
- 2017Automated Surgical Skill Assessment in RMIS Trainingcited by 21
- 2024SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimationcited by 21
- 2021Mimic Embedding via Adaptive Aggregation: Learning Generalizable Person Re-identificationcited by 19
- 2021Class-Incremental Domain Adaptation with Smoothing and Calibration for Surgical Report Generationcited by 18
- 2022Person Re-identification: A Retrospective on Domain Specific Open Challenges and Future Trendscited by 15
- 2020A Robotic 3D Perception System for Operating Room Environment Awarenesscited by 13
- 2023Identity-Seeking Self-Supervised Representation Learning for Generalizable Person Re-identificationcited by 13
- 2017Towards Vision-Based Smart Hospitals: A System for Tracking and Monitoring Hand Hygiene Compliancecited by 9
- 2023DisguisOR: Holistic Face Anonymization for the Operating Roomcited by 9
- 2022Combining the Silhouette and Skeleton Data for Gait Recognitioncited by 8
- 20223D Human Pose Estimation in Multi-View Operating Room Videos Using Differentiable Camera Projectionscited by 7
- 2022Know your sensORs -- A Modality Study For Surgical Action Classificationcited by 6
- 2022Surgical Workflow Recognition: from Analysis of Challenges to Architectural Studycited by 6
- 2018FaceOff: Anonymizing Videos in the Operating Roomscited by 5
- 2023Mitigate Domain Shift by Primary-Auxiliary Objectives Association for Generalizing Person ReIDcited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunitiescited by 4
- 2025TrackOR: Towards Personalized Intelligent Operating Rooms Through Robust Trackingcited by 2
- 2026COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimationcited by 1
- 2026TopoOR: A Unified Topological Scene Representation for the Operating Roomcited by 1
- 2025Mitigating Biases in Surgical Operating Rooms with Geometrycited by 0
- 2026DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimationcited by 0
- 2026DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation5 Jun 2026
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunities1 Apr 2026
- 2026TopoOR: A Unified Topological Scene Representation for the Operating Room10 Mar 2026
- 2026COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation14 Jan 2026
- 2025Mitigating Biases in Surgical Operating Rooms with Geometry11 Aug 2025
- 2025TrackOR: Towards Personalized Intelligent Operating Rooms Through Robust Tracking11 Aug 2025