CauCLIP: Bridging the Sim-to-Real Gap in Surgical Video Understanding via Causality-Inspired Vision-Language Modeling
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
Surgical phase recognition is a critical component for context-aware decision support in intelligent operating rooms, yet training robust models is hindered by limited annotated clinical videos and large domain gaps between synthetic and real surgical data. To address this, we propose CauCLIP, a causality-inspired vision-language framework that leverages CLIP to learn domain-invariant representations for surgical phase recognition without access to target domain data. Our approach integrates a frequency-based augmentation strategy to perturb domain-specific attributes while preserving semantic structures, and a causal suppression loss that mitigates non-causal biases and reinforces causal surgical features. These components are combined in a unified training framework that enables the model to focus on stable causal factors underlying surgical workflows. Experiments on the SurgVisDom hard adaptation benchmark demonstrate that our method substantially outperforms all competing approaches, highlighting the effectiveness of causality-guided vision-language models for domain-generalizable surgical video understanding.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 21 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
18 of 21 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
- 2021Domain Generalization with MixStylecited by 563
- 2021ActionCLIP: A New Paradigm for Video Action Recognitioncited by 317
- 2022Causality Inspired Representation Learning for Domain Generalizationcited by 136
- 2021Open Domain Generalization with Domain-Augmented Meta-Learningcited by 115
6 more
- 2022Disentangled Representation Learning for Text-Video Retrievalcited by 77
- 2022PODA: Prompt-driven Zero-shot Domain Adaptationcited by 60
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2023Generalizable Decision Boundaries: Dualistic Meta-Learning for Open Set Domain Generalizationcited by 24
- 2023Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanismscited by 14
- 2021Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challengecited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LaSeD: Label-Semantic Self-Distillation for Visual-Only Surgical Phase Recognition
- 2025Recognizing Surgical Phases Anywhere: Few-Shot Test-time Adaptation and Task-graph Guided Refinement
- 2026SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding
- 2025Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence
- 2026HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space
- 2023Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures
- 2025SurgVidLM: Towards Multi-grained Surgical Video Understanding with Large Language Model
- 2026An Approach to Enriching Surgical Video Datasets for Fine-Grained Spatial-Temporal Understanding of Vision-Language Models