Agentic Surgical AI: Surgeon Style Fingerprinting and Privacy Risk Quantification via Discrete Diffusion in a Vision-Language-Action Framework
On the map: Diffusion models → Diffusion and flow policies for robotics
also in 1 more
Abstract (arXiv)
Surgeons exhibit distinct operating styles shaped by training, experience, and motor behavior-yet most surgical AI systems overlook this personalization signal. We propose a novel agentic modeling approach for surgeon-specific behavior prediction in robotic surgery, combining a discrete diffusion framework with a vision-language-action (VLA) pipeline. Gesture prediction is framed as a structured sequence denoising task, conditioned on multimodal inputs including surgical video, intent language, and personalized embeddings of surgeon identity and skill. These embeddings are encoded through natural language prompts using third-party language models, allowing the model to retain individual behavioral style without exposing explicit identity. We evaluate our method on the JIGSAWS dataset and demonstrate that it accurately reconstructs gesture sequences while learning meaningful motion fingerprints unique to each surgeon. To quantify the privacy implications of personalization, we perform membership inference attacks and find that more expressive embeddings improve task performance but simultaneously increase susceptibility to identity leakage. These findings demonstrate that while personalized embeddings improve performance, they also increase vulnerability to identity leakage, revealing the importance of balancing personalization with privacy risk in surgical modeling. Code is available at: https://github.com/huixin-zhan-ai/Surgeon_style_fingerprinting.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 14 of its 22 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
14 of 22 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2016Segmental Spatiotemporal CNNs for Fine-grained Action Segmentationcited by 78
- 2019Video-based surgical skill assessment using 3D convolutional neural networkscited by 57
- 2021Gesture Recognition in Robotic Surgery: a Reviewcited by 23
- 2022Recognition and Prediction of Surgical Gestures and Trajectories Using Transformer Models in Robot-Assisted Surgerycited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Cosmos-H-Surgical: Learning Surgical Robot Policies from Videos via World Modeling
- 2026SurgVLA-Bench: Towards Evaluating Vision-Language-Action Models for Laparoscopic Surgical Robotics
- 2025SuFIA-BC: Generating High Quality Demonstration Data for Visuomotor Policy Learning in Surgical Subtasks
- 2026Latent-Action-Guided Video-Language Feature Learning for Surgical Instrument-Tissue Interaction Recognition
- 2026SurgVIL: Scaling Surgical Robot Imitation Learning with Open-source Surgical Videos
- 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation
- 2026TrajPred: Trajectory-Conditioned Joint Embedding Prediction for Surgical Instrument-Tissue Interaction Recognition in Vision-Language Models
- 2025SurgXBench: Explainable Vision-Language Model Benchmark for Surgery